[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:33:35 dist-test-slave-twwt krb5kdc[11799](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:33:35 dist-test-slave-twwt krb5kdc[11799](info): set up 2 sockets
Aug 08 14:33:35 dist-test-slave-twwt krb5kdc[11799](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260808 14:33:36.792086 11791 mini_kdc.cc:121] Time spent starting KDC: real 1.492s user 0.008s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Aug 08 14:33:36 dist-test-slave-twwt krb5kdc[11799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199616, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:33:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:33:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.131.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
I20260808 14:33:36.930655 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:36329
--webserver_interface=127.11.131.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:36489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:36329
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:33:37.052376 11817 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:33:37.052742 11817 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:33:37.052829 11817 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:33:37.056988 11817 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:33:37.057101 11817 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:33:37.057138 11817 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:33:37.057176 11817 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:33:37.057210 11817 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:33:37.062716 11817 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:36489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:36329
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:36329
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.131.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11817
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:33:37.063997 11817 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:33:37.065135 11817 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 14:33:37.074438 11817 server_base.cc:1034] running on GCE node
W20260808 14:33:37.074733 11824 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:33:37.074770 11826 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:33:37.074771 11831 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:33:37.075536 11817 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:33:37.076601 11817 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:33:37.077750 11817 hybrid_clock.cc:648] HybridClock initialized: now 1786199617077760 us; error 61 us; skew 500 ppm
Aug 08 14:33:37 dist-test-slave-twwt krb5kdc[11799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199617, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:33:37.080785 11817 init.cc:377] Logged in from keytab as kudu/127.11.131.254@KRBTEST.COM (short username kudu)
I20260808 14:33:37.081779 11817 webserver.cc:460] Webserver started at http://127.11.131.254:42233/ using document root <none> and password file <none>
I20260808 14:33:37.082361 11817 fs_manager.cc:359] Metadata directory not provided
I20260808 14:33:37.082463 11817 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:33:37.082780 11817 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:33:37.085021 11817 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/master-0/data/instance:
uuid: "c7904fb34be14cce93faf74f818ef0c8"
format_stamp: "Formatted at 2026-08-08 14:33:37 on dist-test-slave-twwt"
server_key: "539d1a1dc6f39afbcff79fa0348112a1"
server_key_iv: "79195d83cb05e4a5da44cd15175a325a"
server_key_version: "encryptionkey@0"
I20260808 14:33:37.085640 11817 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/master-0/wal/instance:
uuid: "c7904fb34be14cce93faf74f818ef0c8"
format_stamp: "Formatted at 2026-08-08 14:33:37 on dist-test-slave-twwt"
server_key: "539d1a1dc6f39afbcff79fa0348112a1"
server_key_iv: "79195d83cb05e4a5da44cd15175a325a"
server_key_version: "encryptionkey@0"
I20260808 14:33:37.089591 11817 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 14:33:37.092109 11843 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:37.093418 11817 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 14:33:37.093571 11817 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "c7904fb34be14cce93faf74f818ef0c8"
format_stamp: "Formatted at 2026-08-08 14:33:37 on dist-test-slave-twwt"
server_key: "539d1a1dc6f39afbcff79fa0348112a1"
server_key_iv: "79195d83cb05e4a5da44cd15175a325a"
server_key_version: "encryptionkey@0"
I20260808 14:33:37.093690 11817 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:33:37.103607 11817 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:33:37.106887 11817 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:33:37.107100 11817 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:33:37.114775 11817 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.254:36329
I20260808 14:33:37.114816 11920 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.254:36329 every 8 connection(s)
I20260808 14:33:37.115768 11817 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:33:37.118711 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 11817
I20260808 14:33:37.118834 11926 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:33:37.118887 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/master-0/wal/instance
I20260808 14:33:37.120679 11791 external_mini_cluster.cc:1428] Setting key 79b73037ecd9b0d1e5ddb58a1eab388b
I20260808 14:33:37.126444 11926 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7904fb34be14cce93faf74f818ef0c8: Bootstrap starting.
I20260808 14:33:37.129441 11926 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c7904fb34be14cce93faf74f818ef0c8: Neither blocks nor log segments found. Creating new log.
I20260808 14:33:37.130398 11926 log.cc:824] T 00000000000000000000000000000000 P c7904fb34be14cce93faf74f818ef0c8: Log is configured to *not* fsync() on all Append() calls
I20260808 14:33:37.133028 11926 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7904fb34be14cce93faf74f818ef0c8: No bootstrap required, opened a new log
I20260808 14:33:37.137713 11926 raft_consensus.cc:348] T 00000000000000000000000000000000 P c7904fb34be14cce93faf74f818ef0c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7904fb34be14cce93faf74f818ef0c8" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 36329 } }
I20260808 14:33:37.137988 11926 raft_consensus.cc:374] T 00000000000000000000000000000000 P c7904fb34be14cce93faf74f818ef0c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:33:37.138055 11926 raft_consensus.cc:729] T 00000000000000000000000000000000 P c7904fb34be14cce93faf74f818ef0c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7904fb34be14cce93faf74f818ef0c8, State: Initialized, Role: FOLLOWER
I20260808 14:33:37.138525 11926 consensus_queue.cc:260] T 00000000000000000000000000000000 P c7904fb34be14cce93faf74f818ef0c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7904fb34be14cce93faf74f818ef0c8" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 36329 } }
I20260808 14:33:37.138711 11926 raft_consensus.cc:388] T 00000000000000000000000000000000 P c7904fb34be14cce93faf74f818ef0c8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:33:37.138795 11926 raft_consensus.cc:482] T 00000000000000000000000000000000 P c7904fb34be14cce93faf74f818ef0c8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:33:37.138921 11926 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c7904fb34be14cce93faf74f818ef0c8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:33:37.140311 11926 raft_consensus.cc:504] T 00000000000000000000000000000000 P c7904fb34be14cce93faf74f818ef0c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7904fb34be14cce93faf74f818ef0c8" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 36329 } }
I20260808 14:33:37.140717 11926 leader_election.cc:302] T 00000000000000000000000000000000 P c7904fb34be14cce93faf74f818ef0c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c7904fb34be14cce93faf74f818ef0c8; no voters:
I20260808 14:33:37.141122 11926 leader_election.cc:288] T 00000000000000000000000000000000 P c7904fb34be14cce93faf74f818ef0c8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:33:37.141232 11932 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c7904fb34be14cce93faf74f818ef0c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:33:37.141537 11932 raft_consensus.cc:686] T 00000000000000000000000000000000 P c7904fb34be14cce93faf74f818ef0c8 [term 1 LEADER]: Becoming Leader. State: Replica: c7904fb34be14cce93faf74f818ef0c8, State: Running, Role: LEADER
I20260808 14:33:37.141917 11932 consensus_queue.cc:237] T 00000000000000000000000000000000 P c7904fb34be14cce93faf74f818ef0c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7904fb34be14cce93faf74f818ef0c8" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 36329 } }
I20260808 14:33:37.142696 11926 sys_catalog.cc:564] T 00000000000000000000000000000000 P c7904fb34be14cce93faf74f818ef0c8 [sys.catalog]: configured and running, proceeding with master startup.
Aug 08 14:33:37 dist-test-slave-twwt krb5kdc[11799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199616, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:33:37.143862 11935 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7904fb34be14cce93faf74f818ef0c8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c7904fb34be14cce93faf74f818ef0c8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7904fb34be14cce93faf74f818ef0c8" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 36329 } } }
I20260808 14:33:37.144001 11935 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7904fb34be14cce93faf74f818ef0c8 [sys.catalog]: This master's current role is: LEADER
I20260808 14:33:37.144393 11936 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7904fb34be14cce93faf74f818ef0c8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c7904fb34be14cce93faf74f818ef0c8. Latest consensus state: current_term: 1 leader_uuid: "c7904fb34be14cce93faf74f818ef0c8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7904fb34be14cce93faf74f818ef0c8" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 36329 } } }
I20260808 14:33:37.144572 11936 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7904fb34be14cce93faf74f818ef0c8 [sys.catalog]: This master's current role is: LEADER
I20260808 14:33:37.144699 11949 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:33:37.148615 11949 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:33:37.151367 11928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:37.124749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40392 (local address 127.11.131.254:36329)
0808 14:33:37.125281 (+ 532us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:37.125304 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:37.126464 (+ 1160us) server_negotiation.cc:407] Connection header received
0808 14:33:37.130847 (+ 4383us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:37.130876 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:37.131316 (+ 440us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:37.131638 (+ 322us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:33:37.134938 (+ 3300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:37.135963 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:37.137798 (+ 1835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:37.138448 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:37.138576 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:37.144097 (+ 5521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:33:37.144104 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:33:37.144121 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:33:37.144153 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:33:37.146783 (+ 2630us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:37.147469 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:37.147476 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:37.147482 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:37.147623 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:37.148038 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:37.148042 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:37.148044 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:37.148698 (+ 654us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:33:37.148931 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:37.150015 (+ 1084us) server_negotiation.cc:299] Negotiation successful
0808 14:33:37.150337 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":151,"threads_started":1}
I20260808 14:33:37.156563 11949 catalog_manager.cc:1347] Generated new cluster ID: 1da95b1a60354cf59f7ecdd44a5ba0dd
I20260808 14:33:37.156642 11949 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:33:37.164055 11949 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:33:37.165280 11949 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:33:37.178644 11949 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c7904fb34be14cce93faf74f818ef0c8: Generated new TSK 0
I20260808 14:33:37.179440 11949 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.131.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab.
Entry for principal kudu/127.11.131.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab.
I20260808 14:33:37.222363 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.193:0
--local_ip_for_outbound_sockets=127.11.131.193
--webserver_interface=127.11.131.193
--webserver_port=0
--tserver_master_addrs=127.11.131.254:36329
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab
--principal=kudu/127.11.131.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:36489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:33:37.352950 11971 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:33:37.353250 11971 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:33:37.353335 11971 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:33:37.357383 11971 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:33:37.357481 11971 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:33:37.357570 11971 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.193
I20260808 14:33:37.363549 11971 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:36489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab
--principal=kudu/127.11.131.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.131.193
--webserver_port=0
--tserver_master_addrs=127.11.131.254:36329
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11971
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.193
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:33:37.364768 11971 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:33:37.365921 11971 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:33:37.376713 11978 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:33:37.376730 11979 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:33:37.376727 11984 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:33:37.376806 11971 server_base.cc:1034] running on GCE node
I20260808 14:33:37.377377 11971 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:33:37.378050 11971 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:33:37.379215 11971 hybrid_clock.cc:648] HybridClock initialized: now 1786199617379200 us; error 26 us; skew 500 ppm
Aug 08 14:33:37 dist-test-slave-twwt krb5kdc[11799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199617, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:33:37.382032 11971 init.cc:377] Logged in from keytab as kudu/127.11.131.193@KRBTEST.COM (short username kudu)
I20260808 14:33:37.383013 11971 webserver.cc:460] Webserver started at http://127.11.131.193:40805/ using document root <none> and password file <none>
I20260808 14:33:37.383589 11971 fs_manager.cc:359] Metadata directory not provided
I20260808 14:33:37.383679 11971 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:33:37.383929 11971 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:33:37.385989 11971 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/ts-0/data/instance:
uuid: "ff301bbfaf0044f4a37e99fea78fd469"
format_stamp: "Formatted at 2026-08-08 14:33:37 on dist-test-slave-twwt"
server_key: "88d2e92c17c2d683e82bf49be70bbd46"
server_key_iv: "a98ceb162da0a6b0e45a9e142aeb0f6f"
server_key_version: "encryptionkey@0"
I20260808 14:33:37.386565 11971 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/ts-0/wal/instance:
uuid: "ff301bbfaf0044f4a37e99fea78fd469"
format_stamp: "Formatted at 2026-08-08 14:33:37 on dist-test-slave-twwt"
server_key: "88d2e92c17c2d683e82bf49be70bbd46"
server_key_iv: "a98ceb162da0a6b0e45a9e142aeb0f6f"
server_key_version: "encryptionkey@0"
I20260808 14:33:37.390367 11971 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260808 14:33:37.392961 11993 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:37.394397 11971 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 14:33:37.394536 11971 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/ts-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/ts-0/wal
uuid: "ff301bbfaf0044f4a37e99fea78fd469"
format_stamp: "Formatted at 2026-08-08 14:33:37 on dist-test-slave-twwt"
server_key: "88d2e92c17c2d683e82bf49be70bbd46"
server_key_iv: "a98ceb162da0a6b0e45a9e142aeb0f6f"
server_key_version: "encryptionkey@0"
I20260808 14:33:37.394719 11971 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:33:37.413306 11971 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:33:37.416342 11971 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:33:37.416554 11971 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:33:37.417182 11971 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:33:37.418059 11971 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:33:37.418107 11971 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:37.418179 11971 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:33:37.418207 11971 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:37.428421 11971 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.193:40061
I20260808 14:33:37.428449 12166 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.193:40061 every 8 connection(s)
I20260808 14:33:37.429400 11971 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
I20260808 14:33:37.431416 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 11971
I20260808 14:33:37.431527 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/ts-0/wal/instance
I20260808 14:33:37.431811 11791 external_mini_cluster.cc:1428] Setting key a2f8c3063de8fca9c201deb1cd21976c
Aug 08 14:33:37 dist-test-slave-twwt krb5kdc[11799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199617, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.193@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.131.194@KRBTEST.COM; defaulting to no policy
I20260808 14:33:37.445169 11928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:37.431538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:54955 (local address 127.11.131.254:36329)
0808 14:33:37.431694 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:37.431700 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:37.432841 (+ 1141us) server_negotiation.cc:407] Connection header received
0808 14:33:37.434376 (+ 1535us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:37.434380 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:37.434435 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:37.434516 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:33:37.435804 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:37.436348 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:37.437782 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:37.438016 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:37.438107 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:37.441166 (+ 3059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:33:37.441170 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:33:37.441172 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:33:37.441197 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:33:37.442795 (+ 1598us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:37.443344 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:37.443348 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:37.443349 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:37.443439 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:37.443895 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:37.443900 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:37.443901 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:37.444110 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:33:37.444227 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:37.444823 (+ 596us) server_negotiation.cc:299] Negotiation successful
0808 14:33:37.444983 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 14:33:37.446127 12172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:37.432055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:36329 (local address 127.11.131.193:54955)
0808 14:33:37.432634 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:37.432725 (+ 91us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:37.434151 (+ 1426us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:37.434724 (+ 573us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:37.434732 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:37.435113 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:33:37.435648 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:37.435662 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:37.436487 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:37.436490 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:37.437641 (+ 1151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:37.437658 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:37.438189 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:37.438196 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:37.438454 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:37.439175 (+ 721us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:33:37.439201 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:33:37.440975 (+ 1774us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:33:37.442920 (+ 1945us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:37.442929 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:37.442945 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:37.443228 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:37.443570 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:37.443573 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:37.443575 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:37.443792 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:37.444227 (+ 435us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:33:37.444235 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:33:37.444522 (+ 287us) client_negotiation.cc:769] Sending connection context
0808 14:33:37.444777 (+ 255us) client_negotiation.cc:240] Negotiation successful
0808 14:33:37.445140 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":157,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.194@KRBTEST.COM" created.
I20260808 14:33:37.447535 12168 heartbeater.cc:347] Connected to a master server at 127.11.131.254:36329
I20260808 14:33:37.447830 12168 heartbeater.cc:464] Registering TS with master...
I20260808 14:33:37.448491 12168 heartbeater.cc:511] Master 127.11.131.254:36329 requested a full tablet report, sending...
I20260808 14:33:37.450301 11866 ts_manager.cc:194] Registered new tserver with Master: ff301bbfaf0044f4a37e99fea78fd469 (127.11.131.193:40061)
I20260808 14:33:37.452082 11866 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.193@KRBTEST.COM'} at 127.11.131.193:54955
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab.
Entry for principal kudu/127.11.131.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab.
I20260808 14:33:37.465518 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.194:0
--local_ip_for_outbound_sockets=127.11.131.194
--webserver_interface=127.11.131.194
--webserver_port=0
--tserver_master_addrs=127.11.131.254:36329
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab
--principal=kudu/127.11.131.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:36489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:33:37.592200 12179 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:33:37.592465 12179 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:33:37.592511 12179 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:33:37.596518 12179 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:33:37.596575 12179 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:33:37.596675 12179 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.194
I20260808 14:33:37.602345 12179 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:36489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab
--principal=kudu/127.11.131.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.131.194
--webserver_port=0
--tserver_master_addrs=127.11.131.254:36329
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12179
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.194
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:33:37.603528 12179 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:33:37.604591 12179 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:33:37.614735 12189 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:33:37.614737 12190 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:33:37.614735 12194 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:33:37.614964 12179 server_base.cc:1034] running on GCE node
I20260808 14:33:37.615584 12179 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:33:37.616377 12179 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:33:37.617552 12179 hybrid_clock.cc:648] HybridClock initialized: now 1786199617617533 us; error 32 us; skew 500 ppm
Aug 08 14:33:37 dist-test-slave-twwt krb5kdc[11799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199617, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:33:37.620649 12179 init.cc:377] Logged in from keytab as kudu/127.11.131.194@KRBTEST.COM (short username kudu)
I20260808 14:33:37.621596 12179 webserver.cc:460] Webserver started at http://127.11.131.194:40351/ using document root <none> and password file <none>
I20260808 14:33:37.622210 12179 fs_manager.cc:359] Metadata directory not provided
I20260808 14:33:37.622274 12179 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:33:37.622539 12179 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:33:37.624830 12179 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/ts-1/data/instance:
uuid: "8aa06bbf81a34143a41ca19baf7bb7c1"
format_stamp: "Formatted at 2026-08-08 14:33:37 on dist-test-slave-twwt"
server_key: "ca8616bba2eaa3ca97b6d70d608fb3a7"
server_key_iv: "192855c7da8cab82ee05a00f37fbcd43"
server_key_version: "encryptionkey@0"
I20260808 14:33:37.625520 12179 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/ts-1/wal/instance:
uuid: "8aa06bbf81a34143a41ca19baf7bb7c1"
format_stamp: "Formatted at 2026-08-08 14:33:37 on dist-test-slave-twwt"
server_key: "ca8616bba2eaa3ca97b6d70d608fb3a7"
server_key_iv: "192855c7da8cab82ee05a00f37fbcd43"
server_key_version: "encryptionkey@0"
I20260808 14:33:37.629573 12179 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260808 14:33:37.632297 12205 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:37.633605 12179 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 14:33:37.633733 12179 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/ts-1/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/ts-1/wal
uuid: "8aa06bbf81a34143a41ca19baf7bb7c1"
format_stamp: "Formatted at 2026-08-08 14:33:37 on dist-test-slave-twwt"
server_key: "ca8616bba2eaa3ca97b6d70d608fb3a7"
server_key_iv: "192855c7da8cab82ee05a00f37fbcd43"
server_key_version: "encryptionkey@0"
I20260808 14:33:37.633847 12179 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:33:37.653473 12179 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:33:37.656986 12179 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:33:37.657164 12179 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:33:37.657732 12179 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:33:37.658574 12179 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:33:37.658668 12179 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:37.658740 12179 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:33:37.658763 12179 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:37.668612 12179 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.194:36133
I20260808 14:33:37.668642 12403 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.194:36133 every 8 connection(s)
I20260808 14:33:37.669508 12179 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
I20260808 14:33:37.674139 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 12179
I20260808 14:33:37.674261 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/ts-1/wal/instance
I20260808 14:33:37.674528 11791 external_mini_cluster.cc:1428] Setting key e0ac3c9188c089e0bd9cfd274aa5998d
Aug 08 14:33:37 dist-test-slave-twwt krb5kdc[11799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199617, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.194@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:33:37.685150 11928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:37.671441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:35235 (local address 127.11.131.254:36329)
0808 14:33:37.671580 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:37.671584 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:37.672406 (+ 822us) server_negotiation.cc:407] Connection header received
0808 14:33:37.673732 (+ 1326us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:37.673736 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:37.673798 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:37.673930 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:33:37.675353 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:37.676126 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:37.677879 (+ 1753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:37.678231 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:37.678384 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:37.681029 (+ 2645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:33:37.681037 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:33:37.681043 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:33:37.681082 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:33:37.682941 (+ 1859us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:37.683441 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:37.683447 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:37.683452 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:37.683556 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:37.683912 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:37.683918 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:37.683922 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:37.684176 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:33:37.684289 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:37.684788 (+ 499us) server_negotiation.cc:299] Negotiation successful
0808 14:33:37.684943 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 14:33:37.685876 12406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:37.671791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:36329 (local address 127.11.131.194:35235)
0808 14:33:37.672237 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:37.672282 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:37.673505 (+ 1223us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:37.674103 (+ 598us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:37.674111 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:37.674561 (+ 450us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:33:37.675185 (+ 624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:37.675204 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:37.676266 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:37.676270 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:37.677739 (+ 1469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:37.677755 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:37.678424 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:37.678427 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:37.678584 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:37.679305 (+ 721us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:33:37.679321 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:33:37.680846 (+ 1525us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:33:37.683060 (+ 2214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:37.683065 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:37.683078 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:37.683332 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:37.683662 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:37.683664 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:37.683666 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:37.683804 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:37.684284 (+ 480us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:33:37.684289 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:33:37.684533 (+ 244us) client_negotiation.cc:769] Sending connection context
0808 14:33:37.684690 (+ 157us) client_negotiation.cc:240] Negotiation successful
0808 14:33:37.684944 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":116,"threads_started":1}
WARNING: no policy specified for kudu/127.11.131.195@KRBTEST.COM; defaulting to no policy
I20260808 14:33:37.687126 12404 heartbeater.cc:347] Connected to a master server at 127.11.131.254:36329
I20260808 14:33:37.687386 12404 heartbeater.cc:464] Registering TS with master...
I20260808 14:33:37.687906 12404 heartbeater.cc:511] Master 127.11.131.254:36329 requested a full tablet report, sending...
I20260808 14:33:37.689013 11866 ts_manager.cc:194] Registered new tserver with Master: 8aa06bbf81a34143a41ca19baf7bb7c1 (127.11.131.194:36133)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.195@KRBTEST.COM" created.
I20260808 14:33:37.689751 11866 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.194@KRBTEST.COM'} at 127.11.131.194:35235
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab.
Entry for principal kudu/127.11.131.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab.
I20260808 14:33:37.706293 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.195:0
--local_ip_for_outbound_sockets=127.11.131.195
--webserver_interface=127.11.131.195
--webserver_port=0
--tserver_master_addrs=127.11.131.254:36329
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab
--principal=kudu/127.11.131.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:36489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:33:37.825644 12411 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:33:37.826133 12411 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:33:37.826224 12411 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:33:37.830327 12411 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:33:37.830427 12411 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:33:37.830524 12411 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.195
I20260808 14:33:37.836105 12411 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:36489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab
--principal=kudu/127.11.131.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.131.195
--webserver_port=0
--tserver_master_addrs=127.11.131.254:36329
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12411
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.195
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:33:37.837407 12411 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:33:37.838588 12411 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:33:37.849435 12421 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:33:37.849445 12420 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:33:37.849542 12411 server_base.cc:1034] running on GCE node
W20260808 14:33:37.849463 12423 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:33:37.850211 12411 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:33:37.851003 12411 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:33:37.852172 12411 hybrid_clock.cc:648] HybridClock initialized: now 1786199617852156 us; error 30 us; skew 500 ppm
Aug 08 14:33:37 dist-test-slave-twwt krb5kdc[11799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199617, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:33:37.855216 12411 init.cc:377] Logged in from keytab as kudu/127.11.131.195@KRBTEST.COM (short username kudu)
I20260808 14:33:37.856178 12411 webserver.cc:460] Webserver started at http://127.11.131.195:42473/ using document root <none> and password file <none>
I20260808 14:33:37.856793 12411 fs_manager.cc:359] Metadata directory not provided
I20260808 14:33:37.856858 12411 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:33:37.857143 12411 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:33:37.859340 12411 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/ts-2/data/instance:
uuid: "56bd335edad34579bad635f6547575d5"
format_stamp: "Formatted at 2026-08-08 14:33:37 on dist-test-slave-twwt"
server_key: "a686da97145b798ee81ffd64e6eaa378"
server_key_iv: "9b6ba91eb7ecfdb6f3b58cfc6d6244d7"
server_key_version: "encryptionkey@0"
I20260808 14:33:37.859933 12411 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/ts-2/wal/instance:
uuid: "56bd335edad34579bad635f6547575d5"
format_stamp: "Formatted at 2026-08-08 14:33:37 on dist-test-slave-twwt"
server_key: "a686da97145b798ee81ffd64e6eaa378"
server_key_iv: "9b6ba91eb7ecfdb6f3b58cfc6d6244d7"
server_key_version: "encryptionkey@0"
I20260808 14:33:37.863837 12411 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 14:33:37.866357 12431 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:37.867678 12411 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 14:33:37.867812 12411 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/ts-2/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/ts-2/wal
uuid: "56bd335edad34579bad635f6547575d5"
format_stamp: "Formatted at 2026-08-08 14:33:37 on dist-test-slave-twwt"
server_key: "a686da97145b798ee81ffd64e6eaa378"
server_key_iv: "9b6ba91eb7ecfdb6f3b58cfc6d6244d7"
server_key_version: "encryptionkey@0"
I20260808 14:33:37.867941 12411 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:33:37.889339 12411 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:33:37.892396 12411 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:33:37.892563 12411 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:33:37.893234 12411 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:33:37.894147 12411 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:33:37.894197 12411 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:37.894269 12411 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:33:37.894312 12411 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:37.904898 12411 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.195:40687
I20260808 14:33:37.904928 12612 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.195:40687 every 8 connection(s)
I20260808 14:33:37.905880 12411 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
I20260808 14:33:37.913470 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 12411
I20260808 14:33:37.913609 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786199615258783-11791-0/minicluster-data/ts-2/wal/instance
I20260808 14:33:37.913923 11791 external_mini_cluster.cc:1428] Setting key 8cacf0bd3e7153a4c235d74eccc08952
Aug 08 14:33:37 dist-test-slave-twwt krb5kdc[11799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199617, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.195@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:33:37.920810 11928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:37.907830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:41509 (local address 127.11.131.254:36329)
0808 14:33:37.907985 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:37.907989 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:37.908864 (+ 875us) server_negotiation.cc:407] Connection header received
0808 14:33:37.910314 (+ 1450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:37.910317 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:37.910382 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:37.910500 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:33:37.911808 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:37.912351 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:37.913795 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:37.914080 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:37.914175 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:37.917210 (+ 3035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:33:37.917214 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:33:37.917216 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:33:37.917246 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:33:37.918704 (+ 1458us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:37.919228 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:37.919231 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:37.919233 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:37.919330 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:37.919677 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:37.919680 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:37.919681 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:37.919888 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:33:37.919979 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:37.920521 (+ 542us) server_negotiation.cc:299] Negotiation successful
0808 14:33:37.920645 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 14:33:37.921655 12621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:37.908240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:36329 (local address 127.11.131.195:41509)
0808 14:33:37.908698 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:37.908742 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:37.910071 (+ 1329us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:37.910741 (+ 670us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:37.910748 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:37.911134 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:33:37.911647 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:37.911662 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:37.912495 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:37.912499 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:37.913605 (+ 1106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:37.913619 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:37.914251 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:37.914255 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:37.914488 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:37.915221 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:33:37.915247 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:33:37.917006 (+ 1759us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:33:37.918820 (+ 1814us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:37.918826 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:37.918839 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:37.919120 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:37.919419 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:37.919421 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:37.919423 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:37.919566 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:37.919988 (+ 422us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:33:37.919994 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:33:37.920246 (+ 252us) client_negotiation.cc:769] Sending connection context
0808 14:33:37.920418 (+ 172us) client_negotiation.cc:240] Negotiation successful
0808 14:33:37.920691 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":124,"threads_started":1}
I20260808 14:33:37.922955 12615 heartbeater.cc:347] Connected to a master server at 127.11.131.254:36329
I20260808 14:33:37.923218 12615 heartbeater.cc:464] Registering TS with master...
I20260808 14:33:37.923763 12615 heartbeater.cc:511] Master 127.11.131.254:36329 requested a full tablet report, sending...
I20260808 14:33:37.924878 11866 ts_manager.cc:194] Registered new tserver with Master: 56bd335edad34579bad635f6547575d5 (127.11.131.195:40687)
I20260808 14:33:37.925459 11866 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.195@KRBTEST.COM'} at 127.11.131.195:41509
I20260808 14:33:37.928787 11791 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 14:33:37 dist-test-slave-twwt krb5kdc[11799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199617, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 14:33:37 dist-test-slave-twwt krb5kdc[11799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199617, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.131.193@KRBTEST.COM
I20260808 14:33:37.960291 12627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:37.948165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45702 (local address 127.11.131.193:40061)
0808 14:33:37.948461 (+ 296us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:37.948468 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:37.948497 (+ 29us) server_negotiation.cc:407] Connection header received
0808 14:33:37.948560 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:37.948566 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:37.948757 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:37.948884 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:33:37.949554 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:37.950656 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:37.952100 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:37.952708 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:37.952831 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:37.955813 (+ 2982us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:33:37.955826 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:33:37.955844 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:33:37.955889 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:33:37.957930 (+ 2041us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:37.958457 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:37.958465 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:37.958467 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:37.958573 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:37.958935 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:37.958938 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:37.958940 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:37.959273 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:33:37.959485 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:37.959917 (+ 432us) server_negotiation.cc:299] Negotiation successful
0808 14:33:37.960099 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":114,"threads_started":1}
W20260808 14:33:37.961686 12044 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45702
Aug 08 14:33:37 dist-test-slave-twwt krb5kdc[11799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199617, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 14:33:37 dist-test-slave-twwt krb5kdc[11799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199617, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.131.193@KRBTEST.COM
I20260808 14:33:37.990301 12627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:37.981778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45714 (local address 127.11.131.193:40061)
0808 14:33:37.981932 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:37.981936 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:37.982101 (+ 165us) server_negotiation.cc:407] Connection header received
0808 14:33:37.982222 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:37.982225 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:37.982270 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:37.982352 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:33:37.983105 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:37.983610 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:37.984445 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:37.984664 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:37.984744 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:37.987259 (+ 2515us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:33:37.987263 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:33:37.987265 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:33:37.987288 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:33:37.988827 (+ 1539us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:37.989224 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:37.989228 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:37.989229 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:37.989312 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:37.989581 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:37.989583 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:37.989584 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:37.989745 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:33:37.989849 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:37.990073 (+ 224us) server_negotiation.cc:299] Negotiation successful
0808 14:33:37.990175 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 14:33:37.991479 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 11971
I20260808 14:33:38.006579 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 12179
I20260808 14:33:38.024796 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 12411
I20260808 14:33:38.041486 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 11817
2026-08-08T14:33:38Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2784 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:33:38 dist-test-slave-twwt krb5kdc[12636](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:33:38 dist-test-slave-twwt krb5kdc[12636](info): set up 2 sockets
Aug 08 14:33:38 dist-test-slave-twwt krb5kdc[12636](info): commencing operation
krb5kdc: starting...
W20260808 14:33:39.303870 11791 mini_kdc.cc:121] Time spent starting KDC: real 1.228s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Aug 08 14:33:39 dist-test-slave-twwt krb5kdc[12636](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199619, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:33:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:33:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.131.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
I20260808 14:33:39.437400 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:41119
--webserver_interface=127.11.131.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:40925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:41119
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:33:39.555191 12655 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:33:39.555502 12655 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:33:39.555591 12655 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:33:39.559693 12655 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:33:39.559777 12655 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:33:39.559816 12655 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:33:39.559875 12655 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:33:39.559914 12655 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:33:39.565388 12655 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:40925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:41119
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:41119
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.131.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12655
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:33:39.566529 12655 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:33:39.567646 12655 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:33:39.576647 12669 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:33:39.576799 12655 server_base.cc:1034] running on GCE node
W20260808 14:33:39.576673 12663 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:33:39.576995 12664 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:33:39.577593 12655 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:33:39.578922 12655 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:33:39.580119 12655 hybrid_clock.cc:648] HybridClock initialized: now 1786199619580090 us; error 39 us; skew 500 ppm
Aug 08 14:33:39 dist-test-slave-twwt krb5kdc[12636](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199619, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:33:39.583309 12655 init.cc:377] Logged in from keytab as kudu/127.11.131.254@KRBTEST.COM (short username kudu)
I20260808 14:33:39.584270 12655 webserver.cc:460] Webserver started at http://127.11.131.254:40129/ using document root <none> and password file <none>
I20260808 14:33:39.584858 12655 fs_manager.cc:359] Metadata directory not provided
I20260808 14:33:39.584923 12655 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:33:39.585108 12655 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:33:39.587366 12655 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/master-0/data/instance:
uuid: "7d18383962604ed5b908ed5bffd57a8d"
format_stamp: "Formatted at 2026-08-08 14:33:39 on dist-test-slave-twwt"
server_key: "107d25c6d9844b2fb445cf2ee77e444c"
server_key_iv: "86120831d2227fe2381a99317591c60e"
server_key_version: "encryptionkey@0"
I20260808 14:33:39.587937 12655 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/master-0/wal/instance:
uuid: "7d18383962604ed5b908ed5bffd57a8d"
format_stamp: "Formatted at 2026-08-08 14:33:39 on dist-test-slave-twwt"
server_key: "107d25c6d9844b2fb445cf2ee77e444c"
server_key_iv: "86120831d2227fe2381a99317591c60e"
server_key_version: "encryptionkey@0"
I20260808 14:33:39.591941 12655 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 14:33:39.594482 12678 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:39.595830 12655 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 14:33:39.595976 12655 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "7d18383962604ed5b908ed5bffd57a8d"
format_stamp: "Formatted at 2026-08-08 14:33:39 on dist-test-slave-twwt"
server_key: "107d25c6d9844b2fb445cf2ee77e444c"
server_key_iv: "86120831d2227fe2381a99317591c60e"
server_key_version: "encryptionkey@0"
I20260808 14:33:39.596092 12655 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:33:39.621294 12655 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:33:39.624962 12655 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:33:39.625182 12655 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:33:39.633000 12655 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.254:41119
I20260808 14:33:39.633024 12758 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.254:41119 every 8 connection(s)
I20260808 14:33:39.634116 12655 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:33:39.634507 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 12655
I20260808 14:33:39.634660 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/master-0/wal/instance
I20260808 14:33:39.634946 11791 external_mini_cluster.cc:1428] Setting key 3a570fecf3ae61059e6fe504cd546e66
I20260808 14:33:39.637660 12760 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:33:39.644450 12760 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d18383962604ed5b908ed5bffd57a8d: Bootstrap starting.
Aug 08 14:33:39 dist-test-slave-twwt krb5kdc[12636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199619, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:33:39.647367 12760 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7d18383962604ed5b908ed5bffd57a8d: Neither blocks nor log segments found. Creating new log.
I20260808 14:33:39.648337 12760 log.cc:824] T 00000000000000000000000000000000 P 7d18383962604ed5b908ed5bffd57a8d: Log is configured to *not* fsync() on all Append() calls
I20260808 14:33:39.650377 12765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:39.636406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42982 (local address 127.11.131.254:41119)
0808 14:33:39.636845 (+ 439us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:39.636865 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:39.636909 (+ 44us) server_negotiation.cc:407] Connection header received
0808 14:33:39.637776 (+ 867us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:39.637799 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:39.638212 (+ 413us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:39.638587 (+ 375us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:33:39.639329 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:39.640855 (+ 1526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:39.641736 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:39.642419 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:39.642597 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:39.645179 (+ 2582us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:33:39.645185 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:33:39.645201 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:33:39.645232 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:33:39.647218 (+ 1986us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:39.647697 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:39.647704 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:39.647710 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:39.647855 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:39.648134 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:39.648137 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:39.648139 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:39.648677 (+ 538us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:33:39.648864 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:39.649142 (+ 278us) server_negotiation.cc:299] Negotiation successful
0808 14:33:39.649476 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":292,"thread_start_us":123,"threads_started":1}
I20260808 14:33:39.650665 12760 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d18383962604ed5b908ed5bffd57a8d: No bootstrap required, opened a new log
I20260808 14:33:39.654603 12760 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7d18383962604ed5b908ed5bffd57a8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d18383962604ed5b908ed5bffd57a8d" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 41119 } }
I20260808 14:33:39.654873 12760 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7d18383962604ed5b908ed5bffd57a8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:33:39.654919 12760 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7d18383962604ed5b908ed5bffd57a8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d18383962604ed5b908ed5bffd57a8d, State: Initialized, Role: FOLLOWER
I20260808 14:33:39.655287 12760 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7d18383962604ed5b908ed5bffd57a8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d18383962604ed5b908ed5bffd57a8d" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 41119 } }
I20260808 14:33:39.655422 12760 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7d18383962604ed5b908ed5bffd57a8d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:33:39.655471 12760 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7d18383962604ed5b908ed5bffd57a8d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:33:39.655542 12760 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7d18383962604ed5b908ed5bffd57a8d [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:33:39.656462 12760 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7d18383962604ed5b908ed5bffd57a8d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d18383962604ed5b908ed5bffd57a8d" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 41119 } }
I20260808 14:33:39.656760 12760 leader_election.cc:302] T 00000000000000000000000000000000 P 7d18383962604ed5b908ed5bffd57a8d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7d18383962604ed5b908ed5bffd57a8d; no voters:
I20260808 14:33:39.657076 12760 leader_election.cc:288] T 00000000000000000000000000000000 P 7d18383962604ed5b908ed5bffd57a8d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:33:39.657227 12768 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7d18383962604ed5b908ed5bffd57a8d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:33:39.657483 12768 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7d18383962604ed5b908ed5bffd57a8d [term 1 LEADER]: Becoming Leader. State: Replica: 7d18383962604ed5b908ed5bffd57a8d, State: Running, Role: LEADER
I20260808 14:33:39.657815 12768 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7d18383962604ed5b908ed5bffd57a8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d18383962604ed5b908ed5bffd57a8d" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 41119 } }
I20260808 14:33:39.658418 12760 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7d18383962604ed5b908ed5bffd57a8d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:33:39.659804 12770 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d18383962604ed5b908ed5bffd57a8d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7d18383962604ed5b908ed5bffd57a8d. Latest consensus state: current_term: 1 leader_uuid: "7d18383962604ed5b908ed5bffd57a8d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d18383962604ed5b908ed5bffd57a8d" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 41119 } } }
I20260808 14:33:39.659940 12770 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d18383962604ed5b908ed5bffd57a8d [sys.catalog]: This master's current role is: LEADER
I20260808 14:33:39.660224 12769 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d18383962604ed5b908ed5bffd57a8d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7d18383962604ed5b908ed5bffd57a8d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d18383962604ed5b908ed5bffd57a8d" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 41119 } } }
I20260808 14:33:39.660328 12769 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d18383962604ed5b908ed5bffd57a8d [sys.catalog]: This master's current role is: LEADER
W20260808 14:33:39.663061 12787 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7d18383962604ed5b908ed5bffd57a8d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:33:39.663127 12787 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:33:39.663213 12780 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:33:39.663952 12780 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:33:39.669700 12780 catalog_manager.cc:1347] Generated new cluster ID: 1ee970cce4bd4a05bb6e3e27159116e3
I20260808 14:33:39.669770 12780 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:33:39.681066 12780 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:33:39.682067 12780 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:33:39.693013 12780 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7d18383962604ed5b908ed5bffd57a8d: Generated new TSK 0
I20260808 14:33:39.693835 12780 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.131.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab.
Entry for principal kudu/127.11.131.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab.
I20260808 14:33:39.731725 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.193:0
--local_ip_for_outbound_sockets=127.11.131.193
--webserver_interface=127.11.131.193
--webserver_port=0
--tserver_master_addrs=127.11.131.254:41119
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab
--principal=kudu/127.11.131.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:40925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:33:39.852324 12794 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:33:39.852587 12794 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:33:39.852633 12794 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:33:39.856596 12794 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:33:39.856652 12794 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:33:39.856710 12794 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.193
I20260808 14:33:39.862511 12794 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:40925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab
--principal=kudu/127.11.131.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.131.193
--webserver_port=0
--tserver_master_addrs=127.11.131.254:41119
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12794
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.193
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:33:39.863653 12794 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:33:39.864673 12794 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:33:39.875001 12811 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:33:39.875067 12794 server_base.cc:1034] running on GCE node
W20260808 14:33:39.874984 12800 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:33:39.875002 12804 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:33:39.875671 12794 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:33:39.876400 12794 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:33:39.877611 12794 hybrid_clock.cc:648] HybridClock initialized: now 1786199619877578 us; error 53 us; skew 500 ppm
Aug 08 14:33:39 dist-test-slave-twwt krb5kdc[12636](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199619, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:33:39.885061 12794 init.cc:377] Logged in from keytab as kudu/127.11.131.193@KRBTEST.COM (short username kudu)
I20260808 14:33:39.886075 12794 webserver.cc:460] Webserver started at http://127.11.131.193:41721/ using document root <none> and password file <none>
I20260808 14:33:39.886772 12794 fs_manager.cc:359] Metadata directory not provided
I20260808 14:33:39.886875 12794 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:33:39.887130 12794 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:33:39.889285 12794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/ts-0/data/instance:
uuid: "7fd759210e18428cb2aa7a719885f06c"
format_stamp: "Formatted at 2026-08-08 14:33:39 on dist-test-slave-twwt"
server_key: "c0de80bcdd03bcdc84b79e830757d439"
server_key_iv: "095c51020a320df0bbab042d7dc2bb05"
server_key_version: "encryptionkey@0"
I20260808 14:33:39.889901 12794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/ts-0/wal/instance:
uuid: "7fd759210e18428cb2aa7a719885f06c"
format_stamp: "Formatted at 2026-08-08 14:33:39 on dist-test-slave-twwt"
server_key: "c0de80bcdd03bcdc84b79e830757d439"
server_key_iv: "095c51020a320df0bbab042d7dc2bb05"
server_key_version: "encryptionkey@0"
I20260808 14:33:39.893967 12794 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 14:33:39.896610 12824 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:39.897981 12794 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260808 14:33:39.898144 12794 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/ts-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/ts-0/wal
uuid: "7fd759210e18428cb2aa7a719885f06c"
format_stamp: "Formatted at 2026-08-08 14:33:39 on dist-test-slave-twwt"
server_key: "c0de80bcdd03bcdc84b79e830757d439"
server_key_iv: "095c51020a320df0bbab042d7dc2bb05"
server_key_version: "encryptionkey@0"
I20260808 14:33:39.898267 12794 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:33:39.921473 12794 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:33:39.924615 12794 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:33:39.924835 12794 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:33:39.925475 12794 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:33:39.926353 12794 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:33:39.926440 12794 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:39.926517 12794 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:33:39.926553 12794 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:39.936131 12794 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.193:34401
I20260808 14:33:39.936163 13013 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.193:34401 every 8 connection(s)
I20260808 14:33:39.937041 12794 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
I20260808 14:33:39.939354 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 12794
I20260808 14:33:39.939473 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/ts-0/wal/instance
I20260808 14:33:39.939736 11791 external_mini_cluster.cc:1428] Setting key eaf4aa96f72996f6ae9db4a92d7dfe13
Aug 08 14:33:39 dist-test-slave-twwt krb5kdc[12636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199619, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.193@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.131.194@KRBTEST.COM; defaulting to no policy
I20260808 14:33:39.951367 12765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:39.938826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:40643 (local address 127.11.131.254:41119)
0808 14:33:39.938983 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:39.938987 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:39.939855 (+ 868us) server_negotiation.cc:407] Connection header received
0808 14:33:39.941434 (+ 1579us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:39.941437 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:39.941494 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:39.941574 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:33:39.942849 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:39.943431 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:39.944594 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:39.944833 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:39.944966 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:39.947549 (+ 2583us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:33:39.947553 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:33:39.947555 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:33:39.947579 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:33:39.949059 (+ 1480us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:39.949590 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:39.949598 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:39.949599 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:39.949677 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:39.950038 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:39.950041 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:39.950043 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:39.950302 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:33:39.950434 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:39.951013 (+ 579us) server_negotiation.cc:299] Negotiation successful
0808 14:33:39.951197 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 14:33:39.952174 13018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:39.939213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:41119 (local address 127.11.131.193:40643)
0808 14:33:39.939690 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:39.939746 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:39.941214 (+ 1468us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:39.941750 (+ 536us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:39.941757 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:39.942120 (+ 363us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:33:39.942697 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:39.942714 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:39.943569 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:39.943572 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:39.944459 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:39.944468 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:39.945012 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:39.945016 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:39.945188 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:39.945837 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:33:39.945853 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:33:39.947373 (+ 1520us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:33:39.949186 (+ 1813us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:39.949192 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:39.949206 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:39.949474 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:39.949774 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:39.949777 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:39.949779 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:39.949930 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:39.950433 (+ 503us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:33:39.950440 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:33:39.950746 (+ 306us) client_negotiation.cc:769] Sending connection context
0808 14:33:39.950951 (+ 205us) client_negotiation.cc:240] Negotiation successful
0808 14:33:39.951282 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":136,"threads_started":1}
I20260808 14:33:39.953876 13014 heartbeater.cc:347] Connected to a master server at 127.11.131.254:41119
I20260808 14:33:39.954178 13014 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.194@KRBTEST.COM" created.
I20260808 14:33:39.954882 13014 heartbeater.cc:511] Master 127.11.131.254:41119 requested a full tablet report, sending...
I20260808 14:33:39.957769 12701 ts_manager.cc:194] Registered new tserver with Master: 7fd759210e18428cb2aa7a719885f06c (127.11.131.193:34401)
I20260808 14:33:39.959615 12701 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.193@KRBTEST.COM'} at 127.11.131.193:40643
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab.
Entry for principal kudu/127.11.131.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab.
I20260808 14:33:39.973428 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.194:0
--local_ip_for_outbound_sockets=127.11.131.194
--webserver_interface=127.11.131.194
--webserver_port=0
--tserver_master_addrs=127.11.131.254:41119
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab
--principal=kudu/127.11.131.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:40925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:33:40.091985 13023 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:33:40.092308 13023 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:33:40.092396 13023 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:33:40.096518 13023 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:33:40.096618 13023 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:33:40.096722 13023 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.194
I20260808 14:33:40.102623 13023 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:40925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab
--principal=kudu/127.11.131.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.131.194
--webserver_port=0
--tserver_master_addrs=127.11.131.254:41119
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13023
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.194
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:33:40.103837 13023 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:33:40.104981 13023 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:33:40.115717 13034 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:33:40.115739 13030 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:33:40.116103 13023 server_base.cc:1034] running on GCE node
W20260808 14:33:40.115762 13029 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:33:40.116636 13023 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:33:40.117379 13023 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:33:40.118557 13023 hybrid_clock.cc:648] HybridClock initialized: now 1786199620118523 us; error 46 us; skew 500 ppm
Aug 08 14:33:40 dist-test-slave-twwt krb5kdc[12636](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199620, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:33:40.121647 13023 init.cc:377] Logged in from keytab as kudu/127.11.131.194@KRBTEST.COM (short username kudu)
I20260808 14:33:40.122742 13023 webserver.cc:460] Webserver started at http://127.11.131.194:41643/ using document root <none> and password file <none>
I20260808 14:33:40.123386 13023 fs_manager.cc:359] Metadata directory not provided
I20260808 14:33:40.123490 13023 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:33:40.123755 13023 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:33:40.126030 13023 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/ts-1/data/instance:
uuid: "f62f6d82fc5f480fa5cc5a97deb6e49a"
format_stamp: "Formatted at 2026-08-08 14:33:40 on dist-test-slave-twwt"
server_key: "744ba49ef864213e55e23f7270b3d975"
server_key_iv: "ecbf62b804fc85312c3d662a42f4a4a3"
server_key_version: "encryptionkey@0"
I20260808 14:33:40.126754 13023 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/ts-1/wal/instance:
uuid: "f62f6d82fc5f480fa5cc5a97deb6e49a"
format_stamp: "Formatted at 2026-08-08 14:33:40 on dist-test-slave-twwt"
server_key: "744ba49ef864213e55e23f7270b3d975"
server_key_iv: "ecbf62b804fc85312c3d662a42f4a4a3"
server_key_version: "encryptionkey@0"
I20260808 14:33:40.131057 13023 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 14:33:40.133948 13047 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:40.135386 13023 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 14:33:40.135536 13023 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/ts-1/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/ts-1/wal
uuid: "f62f6d82fc5f480fa5cc5a97deb6e49a"
format_stamp: "Formatted at 2026-08-08 14:33:40 on dist-test-slave-twwt"
server_key: "744ba49ef864213e55e23f7270b3d975"
server_key_iv: "ecbf62b804fc85312c3d662a42f4a4a3"
server_key_version: "encryptionkey@0"
I20260808 14:33:40.135653 13023 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:33:40.147970 13023 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:33:40.151378 13023 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:33:40.151589 13023 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:33:40.152210 13023 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:33:40.153082 13023 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:33:40.153129 13023 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:40.153192 13023 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:33:40.153226 13023 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:40.162341 13023 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.194:46385
I20260808 14:33:40.162429 13214 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.194:46385 every 8 connection(s)
I20260808 14:33:40.163352 13023 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
I20260808 14:33:40.171201 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 13023
I20260808 14:33:40.171303 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/ts-1/wal/instance
I20260808 14:33:40.171578 11791 external_mini_cluster.cc:1428] Setting key 5e618eb4d24e0b147fc815585a99f35f
Aug 08 14:33:40 dist-test-slave-twwt krb5kdc[12636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199620, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.194@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:33:40.178821 12765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:40.165393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:59455 (local address 127.11.131.254:41119)
0808 14:33:40.165543 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:40.165547 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:40.166521 (+ 974us) server_negotiation.cc:407] Connection header received
0808 14:33:40.167983 (+ 1462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:40.167986 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:40.168049 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:40.168157 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:33:40.169407 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:40.169942 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:40.171229 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:40.171550 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:40.171663 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:40.174672 (+ 3009us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:33:40.174676 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:33:40.174679 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:33:40.174710 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:33:40.176588 (+ 1878us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:40.177159 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:40.177163 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:40.177165 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:40.177255 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:40.177636 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:40.177640 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:40.177642 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:40.177838 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:33:40.177959 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:40.178501 (+ 542us) server_negotiation.cc:299] Negotiation successful
0808 14:33:40.178655 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 14:33:40.179678 13217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:40.165843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:41119 (local address 127.11.131.194:59455)
0808 14:33:40.166350 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:40.166395 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:40.167731 (+ 1336us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:40.168355 (+ 624us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:40.168362 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:40.168755 (+ 393us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:33:40.169248 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:40.169261 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:40.170076 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:40.170080 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:40.171090 (+ 1010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:40.171101 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:40.171726 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:40.171730 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:40.171919 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:40.172591 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:33:40.172611 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:33:40.174484 (+ 1873us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:33:40.176737 (+ 2253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:40.176743 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:40.176756 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:40.177040 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:40.177365 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:40.177368 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:40.177370 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:40.177532 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:40.177960 (+ 428us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:33:40.177968 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:33:40.178231 (+ 263us) client_negotiation.cc:769] Sending connection context
0808 14:33:40.178453 (+ 222us) client_negotiation.cc:240] Negotiation successful
0808 14:33:40.178820 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":141,"threads_started":1}
I20260808 14:33:40.180932 13215 heartbeater.cc:347] Connected to a master server at 127.11.131.254:41119
I20260808 14:33:40.181221 13215 heartbeater.cc:464] Registering TS with master...
I20260808 14:33:40.181761 13215 heartbeater.cc:511] Master 127.11.131.254:41119 requested a full tablet report, sending...
I20260808 14:33:40.182967 12701 ts_manager.cc:194] Registered new tserver with Master: f62f6d82fc5f480fa5cc5a97deb6e49a (127.11.131.194:46385)
WARNING: no policy specified for kudu/127.11.131.195@KRBTEST.COM; defaulting to no policy
I20260808 14:33:40.183699 12701 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.194@KRBTEST.COM'} at 127.11.131.194:59455
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab.
Entry for principal kudu/127.11.131.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab.
I20260808 14:33:40.206827 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.195:0
--local_ip_for_outbound_sockets=127.11.131.195
--webserver_interface=127.11.131.195
--webserver_port=0
--tserver_master_addrs=127.11.131.254:41119
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab
--principal=kudu/127.11.131.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:40925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:33:40.329792 13221 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:33:40.330076 13221 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:33:40.330121 13221 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:33:40.334453 13221 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:33:40.334515 13221 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:33:40.334641 13221 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.195
I20260808 14:33:40.340262 13221 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:40925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab
--principal=kudu/127.11.131.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.131.195
--webserver_port=0
--tserver_master_addrs=127.11.131.254:41119
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13221
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.195
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:33:40.341387 13221 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:33:40.342464 13221 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:33:40.352612 13230 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:33:40.352607 13231 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:33:40.352902 13221 server_base.cc:1034] running on GCE node
W20260808 14:33:40.352654 13235 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:33:40.353403 13221 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:33:40.354143 13221 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:33:40.355365 13221 hybrid_clock.cc:648] HybridClock initialized: now 1786199620355342 us; error 31 us; skew 500 ppm
Aug 08 14:33:40 dist-test-slave-twwt krb5kdc[12636](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199620, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:33:40.358340 13221 init.cc:377] Logged in from keytab as kudu/127.11.131.195@KRBTEST.COM (short username kudu)
I20260808 14:33:40.359535 13221 webserver.cc:460] Webserver started at http://127.11.131.195:45593/ using document root <none> and password file <none>
I20260808 14:33:40.360288 13221 fs_manager.cc:359] Metadata directory not provided
I20260808 14:33:40.360357 13221 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:33:40.360541 13221 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:33:40.362586 13221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/ts-2/data/instance:
uuid: "008f64c515254b4c969802783993c664"
format_stamp: "Formatted at 2026-08-08 14:33:40 on dist-test-slave-twwt"
server_key: "d918aad8b3ddb8196662f09ce633aca9"
server_key_iv: "3c088351207dc317964cc6a2843463ae"
server_key_version: "encryptionkey@0"
I20260808 14:33:40.363220 13221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/ts-2/wal/instance:
uuid: "008f64c515254b4c969802783993c664"
format_stamp: "Formatted at 2026-08-08 14:33:40 on dist-test-slave-twwt"
server_key: "d918aad8b3ddb8196662f09ce633aca9"
server_key_iv: "3c088351207dc317964cc6a2843463ae"
server_key_version: "encryptionkey@0"
I20260808 14:33:40.367061 13221 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 14:33:40.369658 13246 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:40.371116 13221 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:33:40.371217 13221 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/ts-2/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/ts-2/wal
uuid: "008f64c515254b4c969802783993c664"
format_stamp: "Formatted at 2026-08-08 14:33:40 on dist-test-slave-twwt"
server_key: "d918aad8b3ddb8196662f09ce633aca9"
server_key_iv: "3c088351207dc317964cc6a2843463ae"
server_key_version: "encryptionkey@0"
I20260808 14:33:40.371317 13221 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:33:40.394133 13221 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:33:40.397303 13221 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:33:40.397476 13221 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:33:40.398030 13221 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:33:40.398880 13221 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:33:40.398931 13221 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:40.398972 13221 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:33:40.398986 13221 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:40.408773 13221 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.195:35685
I20260808 14:33:40.408821 13416 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.195:35685 every 8 connection(s)
I20260808 14:33:40.409777 13221 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
I20260808 14:33:40.415241 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 13221
I20260808 14:33:40.415385 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786199615258783-11791-0/minicluster-data/ts-2/wal/instance
I20260808 14:33:40.415679 11791 external_mini_cluster.cc:1428] Setting key f33280f299f792334c48dab6cc198683
Aug 08 14:33:40 dist-test-slave-twwt krb5kdc[12636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199620, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.195@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:33:40.425252 12765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:40.411772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:33059 (local address 127.11.131.254:41119)
0808 14:33:40.411951 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:40.411956 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:40.412913 (+ 957us) server_negotiation.cc:407] Connection header received
0808 14:33:40.414313 (+ 1400us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:40.414317 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:40.414379 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:40.414497 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:33:40.416246 (+ 1749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:40.416861 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:40.418458 (+ 1597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:40.418843 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:40.418947 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:40.421620 (+ 2673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:33:40.421623 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:33:40.421625 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:33:40.421652 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:33:40.423090 (+ 1438us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:40.423645 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:40.423648 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:40.423650 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:40.423749 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:40.424115 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:40.424119 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:40.424121 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:40.424324 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:33:40.424438 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:40.424958 (+ 520us) server_negotiation.cc:299] Negotiation successful
0808 14:33:40.425086 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260808 14:33:40.426112 13419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:40.412177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:41119 (local address 127.11.131.195:33059)
0808 14:33:40.412731 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:40.412781 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:40.414065 (+ 1284us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:40.414772 (+ 707us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:40.414780 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:40.415336 (+ 556us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:33:40.416080 (+ 744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:40.416100 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:40.417018 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:40.417025 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:40.418321 (+ 1296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:40.418332 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:40.419014 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:40.419017 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:40.419168 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:40.419778 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:33:40.419795 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:33:40.421422 (+ 1627us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:33:40.423222 (+ 1800us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:40.423228 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:40.423256 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:40.423524 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:40.423853 (+ 329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:40.423856 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:40.423858 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:40.424007 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:40.424439 (+ 432us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:33:40.424447 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:33:40.424710 (+ 263us) client_negotiation.cc:769] Sending connection context
0808 14:33:40.424915 (+ 205us) client_negotiation.cc:240] Negotiation successful
0808 14:33:40.425269 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":125,"threads_started":1}
I20260808 14:33:40.427430 13417 heartbeater.cc:347] Connected to a master server at 127.11.131.254:41119
I20260808 14:33:40.427734 13417 heartbeater.cc:464] Registering TS with master...
I20260808 14:33:40.428346 13417 heartbeater.cc:511] Master 127.11.131.254:41119 requested a full tablet report, sending...
I20260808 14:33:40.429544 12701 ts_manager.cc:194] Registered new tserver with Master: 008f64c515254b4c969802783993c664 (127.11.131.195:35685)
I20260808 14:33:40.430155 11791 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:33:40.430341 12701 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.195@KRBTEST.COM'} at 127.11.131.195:33059
I20260808 14:33:40.441182 12765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:40.433910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42998 (local address 127.11.131.254:41119)
0808 14:33:40.434034 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:40.434038 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:40.434221 (+ 183us) server_negotiation.cc:407] Connection header received
0808 14:33:40.434313 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:40.434315 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:40.434352 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:40.434418 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:33:40.435149 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:40.435636 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:40.436424 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:40.436630 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:40.436708 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:40.438076 (+ 1368us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:33:40.438079 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:33:40.438081 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:33:40.438107 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:33:40.439591 (+ 1484us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:40.440018 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:40.440021 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:40.440022 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:40.440095 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:40.440456 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:40.440460 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:40.440461 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:40.440679 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:33:40.440828 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:40.440980 (+ 152us) server_negotiation.cc:299] Negotiation successful
0808 14:33:40.441071 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 14:33:40.446201 12701 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42998:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:33:40.449343 12701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:33:40.464636 13441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:40.458003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.195:35685 (local address 127.0.0.1:57998)
0808 14:33:40.459302 (+ 1299us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:40.459314 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:40.459502 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:40.459992 (+ 490us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:40.459996 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:40.460026 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:33:40.460494 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:40.460500 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:40.462065 (+ 1565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:40.462068 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:40.463286 (+ 1218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:40.463298 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:40.464083 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:40.464087 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:40.464192 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:40.464228 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 14:33:40.464340 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 14:33:40.464460 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1232,"mutex_wait_us":347,"spinlock_wait_cycles":768,"thread_start_us":99,"threads_started":1}
I20260808 14:33:40.464833 13440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:40.458057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41700 (local address 127.11.131.193:34401)
0808 14:33:40.459428 (+ 1371us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:40.459452 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:40.459481 (+ 29us) server_negotiation.cc:407] Connection header received
0808 14:33:40.459567 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:40.459574 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:40.459784 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:40.459954 (+ 170us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:33:40.460298 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:40.461534 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:40.463336 (+ 1802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:40.464092 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:40.464197 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:40.464301 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:40.464582 (+ 281us) server_negotiation.cc:299] Negotiation successful
0808 14:33:40.464681 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1245,"thread_start_us":82,"threads_started":1}
I20260808 14:33:40.464682 13436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:40.457895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:34401 (local address 127.0.0.1:41700)
0808 14:33:40.458682 (+ 787us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:40.458735 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:40.458877 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:40.459943 (+ 1066us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:40.459950 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:40.459972 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:33:40.460158 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:40.460173 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:40.461666 (+ 1493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:40.461670 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:40.463193 (+ 1523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:40.463204 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:40.464336 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:40.464340 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:40.464427 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:40.464446 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 14:33:40.464517 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 14:33:40.464572 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":578,"mutex_wait_us":114,"thread_start_us":74,"threads_started":1}
I20260808 14:33:40.465315 13443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:40.458695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57998 (local address 127.11.131.195:35685)
0808 14:33:40.459133 (+ 438us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:40.459145 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:40.459423 (+ 278us) server_negotiation.cc:407] Connection header received
0808 14:33:40.459655 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:40.459660 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:40.459858 (+ 198us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:40.460016 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:33:40.460616 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:40.461917 (+ 1301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:40.463391 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:40.463954 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:40.464096 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:40.464241 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:40.465030 (+ 789us) server_negotiation.cc:299] Negotiation successful
0808 14:33:40.465147 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":334,"thread_start_us":107,"threads_started":1}
I20260808 14:33:40.465382 13438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:40.458508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.194:46385 (local address 127.0.0.1:57172)
0808 14:33:40.460198 (+ 1690us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:40.460212 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:40.460335 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:40.460805 (+ 470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:40.460808 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:40.460826 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:33:40.460939 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:40.460945 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:40.462040 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:40.462044 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:40.463037 (+ 993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:40.463048 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:40.464370 (+ 1322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:40.464374 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:40.464464 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:40.464484 (+ 20us) client_negotiation.cc:769] Sending connection context
0808 14:33:40.464580 (+ 96us) client_negotiation.cc:240] Negotiation successful
0808 14:33:40.464655 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1630,"mutex_wait_us":5,"thread_start_us":169,"threads_started":1}
I20260808 14:33:40.465714 13444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:40.458704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57172 (local address 127.11.131.194:46385)
0808 14:33:40.459200 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:40.459212 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:40.460314 (+ 1102us) server_negotiation.cc:407] Connection header received
0808 14:33:40.460464 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:40.460470 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:40.460666 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:40.460827 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:33:40.461044 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:40.461882 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:40.463165 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:40.464015 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:40.464156 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:40.464302 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:40.464752 (+ 450us) server_negotiation.cc:299] Negotiation successful
0808 14:33:40.464853 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":399,"thread_start_us":178,"threads_started":1}
I20260808 14:33:40.468118 13313 tablet_service.cc:1467] Processing CreateTablet for tablet 7b0d8d0e681946089ed9276808483f4f (DEFAULT_TABLE table=test-table [id=4eb595249fa14209a37e5063d72d7170]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:33:40.468276 12908 tablet_service.cc:1467] Processing CreateTablet for tablet 7b0d8d0e681946089ed9276808483f4f (DEFAULT_TABLE table=test-table [id=4eb595249fa14209a37e5063d72d7170]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:33:40.468321 13123 tablet_service.cc:1467] Processing CreateTablet for tablet 7b0d8d0e681946089ed9276808483f4f (DEFAULT_TABLE table=test-table [id=4eb595249fa14209a37e5063d72d7170]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:33:40.469301 13313 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b0d8d0e681946089ed9276808483f4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:33:40.469347 12908 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b0d8d0e681946089ed9276808483f4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:33:40.469347 13123 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b0d8d0e681946089ed9276808483f4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:33:40.476020 13446 tablet_bootstrap.cc:492] T 7b0d8d0e681946089ed9276808483f4f P 008f64c515254b4c969802783993c664: Bootstrap starting.
I20260808 14:33:40.477242 13447 tablet_bootstrap.cc:492] T 7b0d8d0e681946089ed9276808483f4f P 7fd759210e18428cb2aa7a719885f06c: Bootstrap starting.
I20260808 14:33:40.477474 13448 tablet_bootstrap.cc:492] T 7b0d8d0e681946089ed9276808483f4f P f62f6d82fc5f480fa5cc5a97deb6e49a: Bootstrap starting.
I20260808 14:33:40.478351 13446 tablet_bootstrap.cc:654] T 7b0d8d0e681946089ed9276808483f4f P 008f64c515254b4c969802783993c664: Neither blocks nor log segments found. Creating new log.
I20260808 14:33:40.479542 13447 tablet_bootstrap.cc:654] T 7b0d8d0e681946089ed9276808483f4f P 7fd759210e18428cb2aa7a719885f06c: Neither blocks nor log segments found. Creating new log.
I20260808 14:33:40.479681 13446 log.cc:824] T 7b0d8d0e681946089ed9276808483f4f P 008f64c515254b4c969802783993c664: Log is configured to *not* fsync() on all Append() calls
I20260808 14:33:40.480062 13448 tablet_bootstrap.cc:654] T 7b0d8d0e681946089ed9276808483f4f P f62f6d82fc5f480fa5cc5a97deb6e49a: Neither blocks nor log segments found. Creating new log.
I20260808 14:33:40.480631 13447 log.cc:824] T 7b0d8d0e681946089ed9276808483f4f P 7fd759210e18428cb2aa7a719885f06c: Log is configured to *not* fsync() on all Append() calls
I20260808 14:33:40.480903 13448 log.cc:824] T 7b0d8d0e681946089ed9276808483f4f P f62f6d82fc5f480fa5cc5a97deb6e49a: Log is configured to *not* fsync() on all Append() calls
I20260808 14:33:40.481896 13446 tablet_bootstrap.cc:492] T 7b0d8d0e681946089ed9276808483f4f P 008f64c515254b4c969802783993c664: No bootstrap required, opened a new log
I20260808 14:33:40.482100 13446 ts_tablet_manager.cc:1397] T 7b0d8d0e681946089ed9276808483f4f P 008f64c515254b4c969802783993c664: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 14:33:40.482659 13447 tablet_bootstrap.cc:492] T 7b0d8d0e681946089ed9276808483f4f P 7fd759210e18428cb2aa7a719885f06c: No bootstrap required, opened a new log
I20260808 14:33:40.482882 13447 ts_tablet_manager.cc:1397] T 7b0d8d0e681946089ed9276808483f4f P 7fd759210e18428cb2aa7a719885f06c: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 14:33:40.482950 13448 tablet_bootstrap.cc:492] T 7b0d8d0e681946089ed9276808483f4f P f62f6d82fc5f480fa5cc5a97deb6e49a: No bootstrap required, opened a new log
I20260808 14:33:40.483136 13448 ts_tablet_manager.cc:1397] T 7b0d8d0e681946089ed9276808483f4f P f62f6d82fc5f480fa5cc5a97deb6e49a: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 14:33:40.486179 13446 raft_consensus.cc:348] T 7b0d8d0e681946089ed9276808483f4f P 008f64c515254b4c969802783993c664 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fd759210e18428cb2aa7a719885f06c" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 34401 } } peers { permanent_uuid: "008f64c515254b4c969802783993c664" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 35685 } } peers { permanent_uuid: "f62f6d82fc5f480fa5cc5a97deb6e49a" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 46385 } }
I20260808 14:33:40.486290 13447 raft_consensus.cc:348] T 7b0d8d0e681946089ed9276808483f4f P 7fd759210e18428cb2aa7a719885f06c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fd759210e18428cb2aa7a719885f06c" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 34401 } } peers { permanent_uuid: "008f64c515254b4c969802783993c664" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 35685 } } peers { permanent_uuid: "f62f6d82fc5f480fa5cc5a97deb6e49a" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 46385 } }
I20260808 14:33:40.486573 13447 raft_consensus.cc:374] T 7b0d8d0e681946089ed9276808483f4f P 7fd759210e18428cb2aa7a719885f06c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:33:40.486631 13446 raft_consensus.cc:374] T 7b0d8d0e681946089ed9276808483f4f P 008f64c515254b4c969802783993c664 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:33:40.486701 13447 raft_consensus.cc:729] T 7b0d8d0e681946089ed9276808483f4f P 7fd759210e18428cb2aa7a719885f06c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fd759210e18428cb2aa7a719885f06c, State: Initialized, Role: FOLLOWER
I20260808 14:33:40.486878 13446 raft_consensus.cc:729] T 7b0d8d0e681946089ed9276808483f4f P 008f64c515254b4c969802783993c664 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 008f64c515254b4c969802783993c664, State: Initialized, Role: FOLLOWER
I20260808 14:33:40.486965 13448 raft_consensus.cc:348] T 7b0d8d0e681946089ed9276808483f4f P f62f6d82fc5f480fa5cc5a97deb6e49a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fd759210e18428cb2aa7a719885f06c" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 34401 } } peers { permanent_uuid: "008f64c515254b4c969802783993c664" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 35685 } } peers { permanent_uuid: "f62f6d82fc5f480fa5cc5a97deb6e49a" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 46385 } }
I20260808 14:33:40.487260 13448 raft_consensus.cc:374] T 7b0d8d0e681946089ed9276808483f4f P f62f6d82fc5f480fa5cc5a97deb6e49a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:33:40.487342 13448 raft_consensus.cc:729] T 7b0d8d0e681946089ed9276808483f4f P f62f6d82fc5f480fa5cc5a97deb6e49a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f62f6d82fc5f480fa5cc5a97deb6e49a, State: Initialized, Role: FOLLOWER
I20260808 14:33:40.487457 13446 consensus_queue.cc:260] T 7b0d8d0e681946089ed9276808483f4f P 008f64c515254b4c969802783993c664 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fd759210e18428cb2aa7a719885f06c" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 34401 } } peers { permanent_uuid: "008f64c515254b4c969802783993c664" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 35685 } } peers { permanent_uuid: "f62f6d82fc5f480fa5cc5a97deb6e49a" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 46385 } }
I20260808 14:33:40.487459 13447 consensus_queue.cc:260] T 7b0d8d0e681946089ed9276808483f4f P 7fd759210e18428cb2aa7a719885f06c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fd759210e18428cb2aa7a719885f06c" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 34401 } } peers { permanent_uuid: "008f64c515254b4c969802783993c664" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 35685 } } peers { permanent_uuid: "f62f6d82fc5f480fa5cc5a97deb6e49a" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 46385 } }
I20260808 14:33:40.487756 13448 consensus_queue.cc:260] T 7b0d8d0e681946089ed9276808483f4f P f62f6d82fc5f480fa5cc5a97deb6e49a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fd759210e18428cb2aa7a719885f06c" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 34401 } } peers { permanent_uuid: "008f64c515254b4c969802783993c664" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 35685 } } peers { permanent_uuid: "f62f6d82fc5f480fa5cc5a97deb6e49a" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 46385 } }
I20260808 14:33:40.488168 13014 heartbeater.cc:503] Master 127.11.131.254:41119 was elected leader, sending a full tablet report...
I20260808 14:33:40.488495 13215 heartbeater.cc:503] Master 127.11.131.254:41119 was elected leader, sending a full tablet report...
I20260808 14:33:40.488611 13446 ts_tablet_manager.cc:1428] T 7b0d8d0e681946089ed9276808483f4f P 008f64c515254b4c969802783993c664: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260808 14:33:40.488965 13417 heartbeater.cc:503] Master 127.11.131.254:41119 was elected leader, sending a full tablet report...
I20260808 14:33:40.489709 13447 ts_tablet_manager.cc:1428] T 7b0d8d0e681946089ed9276808483f4f P 7fd759210e18428cb2aa7a719885f06c: Time spent starting tablet: real 0.007s user 0.002s sys 0.003s
I20260808 14:33:40.489926 13448 ts_tablet_manager.cc:1428] T 7b0d8d0e681946089ed9276808483f4f P f62f6d82fc5f480fa5cc5a97deb6e49a: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260808 14:33:40.513695 13453 raft_consensus.cc:482] T 7b0d8d0e681946089ed9276808483f4f P 008f64c515254b4c969802783993c664 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:33:40.513962 13453 raft_consensus.cc:504] T 7b0d8d0e681946089ed9276808483f4f P 008f64c515254b4c969802783993c664 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fd759210e18428cb2aa7a719885f06c" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 34401 } } peers { permanent_uuid: "008f64c515254b4c969802783993c664" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 35685 } } peers { permanent_uuid: "f62f6d82fc5f480fa5cc5a97deb6e49a" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 46385 } }
I20260808 14:33:40.515285 13453 leader_election.cc:288] T 7b0d8d0e681946089ed9276808483f4f P 008f64c515254b4c969802783993c664 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fd759210e18428cb2aa7a719885f06c (127.11.131.193:34401), f62f6d82fc5f480fa5cc5a97deb6e49a (127.11.131.194:46385)
I20260808 14:33:40.519703 13419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:40.515478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:34401 (local address 127.11.131.195:33931)
0808 14:33:40.515630 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:40.515647 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:40.515742 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:40.516084 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:40.516090 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:40.516111 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:33:40.516251 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:40.516256 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:40.517306 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:40.517308 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:40.518496 (+ 1188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:40.518506 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:40.519274 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:40.519278 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:40.519386 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:40.519407 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 14:33:40.519482 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 14:33:40.519547 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60,"mutex_wait_us":71}
I20260808 14:33:40.519748 13440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:40.515695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:33931 (local address 127.11.131.193:34401)
0808 14:33:40.515848 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:40.515854 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:40.515870 (+ 16us) server_negotiation.cc:407] Connection header received
0808 14:33:40.515931 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:40.515933 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:40.515972 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:40.516038 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:33:40.516413 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:40.517190 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:40.518644 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:40.519145 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:40.519242 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:40.519284 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:40.519522 (+ 238us) server_negotiation.cc:299] Negotiation successful
0808 14:33:40.519618 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 14:33:40.519825 13444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:40.515717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:51645 (local address 127.11.131.194:46385)
0808 14:33:40.515853 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:40.515858 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:40.516131 (+ 273us) server_negotiation.cc:407] Connection header received
0808 14:33:40.516195 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:40.516198 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:40.516239 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:40.516299 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:33:40.516578 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:40.517318 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:40.518797 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:40.519215 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:40.519365 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:40.519417 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:40.519626 (+ 209us) server_negotiation.cc:299] Negotiation successful
0808 14:33:40.519701 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 14:33:40.519871 13455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:40.515596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.194:46385 (local address 127.11.131.195:51645)
0808 14:33:40.516000 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:40.516011 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:40.516120 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:40.516343 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:40.516349 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:40.516372 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:33:40.516476 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:40.516481 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:40.517444 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:40.517450 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:40.518676 (+ 1226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:40.518689 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:40.519371 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:40.519375 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:40.519490 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:40.519517 (+ 27us) client_negotiation.cc:769] Sending connection context
0808 14:33:40.519595 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 14:33:40.519659 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":353,"mutex_wait_us":64,"thread_start_us":140,"threads_started":1}
I20260808 14:33:40.520510 13150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b0d8d0e681946089ed9276808483f4f" candidate_uuid: "008f64c515254b4c969802783993c664" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f62f6d82fc5f480fa5cc5a97deb6e49a" is_pre_election: true
I20260808 14:33:40.520509 12936 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b0d8d0e681946089ed9276808483f4f" candidate_uuid: "008f64c515254b4c969802783993c664" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fd759210e18428cb2aa7a719885f06c" is_pre_election: true
I20260808 14:33:40.520807 13150 raft_consensus.cc:2454] T 7b0d8d0e681946089ed9276808483f4f P f62f6d82fc5f480fa5cc5a97deb6e49a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 008f64c515254b4c969802783993c664 in term 0.
I20260808 14:33:40.520820 12936 raft_consensus.cc:2454] T 7b0d8d0e681946089ed9276808483f4f P 7fd759210e18428cb2aa7a719885f06c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 008f64c515254b4c969802783993c664 in term 0.
I20260808 14:33:40.521297 13252 leader_election.cc:302] T 7b0d8d0e681946089ed9276808483f4f P 008f64c515254b4c969802783993c664 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 008f64c515254b4c969802783993c664, 7fd759210e18428cb2aa7a719885f06c; no voters:
I20260808 14:33:40.521598 13453 raft_consensus.cc:2781] T 7b0d8d0e681946089ed9276808483f4f P 008f64c515254b4c969802783993c664 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:33:40.521698 13453 raft_consensus.cc:482] T 7b0d8d0e681946089ed9276808483f4f P 008f64c515254b4c969802783993c664 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:33:40.521742 13453 raft_consensus.cc:3037] T 7b0d8d0e681946089ed9276808483f4f P 008f64c515254b4c969802783993c664 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:33:40.522856 13453 raft_consensus.cc:504] T 7b0d8d0e681946089ed9276808483f4f P 008f64c515254b4c969802783993c664 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fd759210e18428cb2aa7a719885f06c" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 34401 } } peers { permanent_uuid: "008f64c515254b4c969802783993c664" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 35685 } } peers { permanent_uuid: "f62f6d82fc5f480fa5cc5a97deb6e49a" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 46385 } }
I20260808 14:33:40.523195 13453 leader_election.cc:288] T 7b0d8d0e681946089ed9276808483f4f P 008f64c515254b4c969802783993c664 [CANDIDATE]: Term 1 election: Requested vote from peers 7fd759210e18428cb2aa7a719885f06c (127.11.131.193:34401), f62f6d82fc5f480fa5cc5a97deb6e49a (127.11.131.194:46385)
I20260808 14:33:40.523509 12936 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b0d8d0e681946089ed9276808483f4f" candidate_uuid: "008f64c515254b4c969802783993c664" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fd759210e18428cb2aa7a719885f06c"
I20260808 14:33:40.523582 13150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b0d8d0e681946089ed9276808483f4f" candidate_uuid: "008f64c515254b4c969802783993c664" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f62f6d82fc5f480fa5cc5a97deb6e49a"
I20260808 14:33:40.523643 12936 raft_consensus.cc:3037] T 7b0d8d0e681946089ed9276808483f4f P 7fd759210e18428cb2aa7a719885f06c [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:33:40.523717 13150 raft_consensus.cc:3037] T 7b0d8d0e681946089ed9276808483f4f P f62f6d82fc5f480fa5cc5a97deb6e49a [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:33:40.524775 13150 raft_consensus.cc:2454] T 7b0d8d0e681946089ed9276808483f4f P f62f6d82fc5f480fa5cc5a97deb6e49a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 008f64c515254b4c969802783993c664 in term 1.
I20260808 14:33:40.524777 12936 raft_consensus.cc:2454] T 7b0d8d0e681946089ed9276808483f4f P 7fd759210e18428cb2aa7a719885f06c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 008f64c515254b4c969802783993c664 in term 1.
I20260808 14:33:40.525154 13254 leader_election.cc:302] T 7b0d8d0e681946089ed9276808483f4f P 008f64c515254b4c969802783993c664 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 008f64c515254b4c969802783993c664, 7fd759210e18428cb2aa7a719885f06c, f62f6d82fc5f480fa5cc5a97deb6e49a; no voters:
I20260808 14:33:40.525375 13453 raft_consensus.cc:2781] T 7b0d8d0e681946089ed9276808483f4f P 008f64c515254b4c969802783993c664 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:33:40.525560 13453 raft_consensus.cc:686] T 7b0d8d0e681946089ed9276808483f4f P 008f64c515254b4c969802783993c664 [term 1 LEADER]: Becoming Leader. State: Replica: 008f64c515254b4c969802783993c664, State: Running, Role: LEADER
I20260808 14:33:40.525911 13453 consensus_queue.cc:237] T 7b0d8d0e681946089ed9276808483f4f P 008f64c515254b4c969802783993c664 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fd759210e18428cb2aa7a719885f06c" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 34401 } } peers { permanent_uuid: "008f64c515254b4c969802783993c664" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 35685 } } peers { permanent_uuid: "f62f6d82fc5f480fa5cc5a97deb6e49a" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 46385 } }
I20260808 14:33:40.529050 12701 catalog_manager.cc:5495] T 7b0d8d0e681946089ed9276808483f4f P 008f64c515254b4c969802783993c664 reported cstate change: term changed from 0 to 1, leader changed from <none> to 008f64c515254b4c969802783993c664 (127.11.131.195). New cstate: current_term: 1 leader_uuid: "008f64c515254b4c969802783993c664" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fd759210e18428cb2aa7a719885f06c" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 34401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "008f64c515254b4c969802783993c664" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f62f6d82fc5f480fa5cc5a97deb6e49a" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 46385 } health_report { overall_health: UNKNOWN } } }
Aug 08 14:33:40 dist-test-slave-twwt krb5kdc[12636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199619, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.131.193@KRBTEST.COM
I20260808 14:33:40.544914 13440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:40.535385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41702 (local address 127.11.131.193:34401)
0808 14:33:40.535552 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:40.535557 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:40.535694 (+ 137us) server_negotiation.cc:407] Connection header received
0808 14:33:40.535864 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:40.535867 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:40.535919 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:40.536006 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:33:40.536707 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:40.537276 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:40.538151 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:40.538478 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:40.538590 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:40.541233 (+ 2643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:33:40.541249 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:33:40.541268 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:33:40.541303 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:33:40.543103 (+ 1800us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:40.543551 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:40.543558 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:40.543560 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:40.543648 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:40.543945 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:40.543949 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:40.543950 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:40.544207 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:33:40.544450 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:40.544605 (+ 155us) server_negotiation.cc:299] Negotiation successful
0808 14:33:40.544728 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
Aug 08 14:33:40 dist-test-slave-twwt krb5kdc[12636](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199620, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 14:33:40 dist-test-slave-twwt krb5kdc[12636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199620, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.131.193@KRBTEST.COM
I20260808 14:33:40.575045 13440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:40.566087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41718 (local address 127.11.131.193:34401)
0808 14:33:40.566240 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:40.566246 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:40.566451 (+ 205us) server_negotiation.cc:407] Connection header received
0808 14:33:40.566653 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:40.566656 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:40.566703 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:40.566804 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:33:40.567506 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:40.568044 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:40.568928 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:40.569167 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:40.569276 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:40.571696 (+ 2420us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:33:40.571700 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:33:40.571701 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:33:40.571726 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:33:40.572997 (+ 1271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:40.573447 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:40.573456 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:40.573457 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:40.573534 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:40.573814 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:40.573818 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:40.573819 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:40.574042 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:33:40.574184 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:40.574694 (+ 510us) server_negotiation.cc:299] Negotiation successful
0808 14:33:40.574861 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
Aug 08 14:33:40 dist-test-slave-twwt krb5kdc[12636](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199620, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 14:33:40 dist-test-slave-twwt krb5kdc[12636](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199620, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.131.193@KRBTEST.COM
I20260808 14:33:40.604827 13440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:40.595650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41730 (local address 127.11.131.193:34401)
0808 14:33:40.595856 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:40.595863 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:40.595998 (+ 135us) server_negotiation.cc:407] Connection header received
0808 14:33:40.596126 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:40.596129 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:40.596175 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:40.596252 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:33:40.596975 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:40.597480 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:40.598371 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:40.598594 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:40.598762 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:40.601642 (+ 2880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:33:40.601645 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:33:40.601647 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:33:40.601673 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:33:40.603137 (+ 1464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:40.603581 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:40.603585 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:40.603587 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:40.603671 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:40.603957 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:40.603961 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:40.603963 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:40.604140 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:33:40.604279 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:40.604536 (+ 257us) server_negotiation.cc:299] Negotiation successful
0808 14:33:40.604662 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
W20260808 14:33:40.606230 12863 tablet_service.cc:2908] Rejecting scan request for tablet 7b0d8d0e681946089ed9276808483f4f: Uninitialized: clean time has not yet been initialized
I20260808 14:33:40.608741 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 12794
I20260808 14:33:40.622222 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 13023
I20260808 14:33:40.631306 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 13221
I20260808 14:33:40.651566 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 12655
2026-08-08T14:33:40Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2608 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:33:40 dist-test-slave-twwt krb5kdc[13478](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:33:40 dist-test-slave-twwt krb5kdc[13478](info): set up 2 sockets
Aug 08 14:33:40 dist-test-slave-twwt krb5kdc[13478](info): commencing operation
krb5kdc: starting...
W20260808 14:33:41.912745 11791 mini_kdc.cc:121] Time spent starting KDC: real 1.229s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Aug 08 14:33:42 dist-test-slave-twwt krb5kdc[13478](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199622, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:33:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:33:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.131.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
I20260808 14:33:42.054440 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:46519
--webserver_interface=127.11.131.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:37881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:46519
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:33:42.171773 13499 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:33:42.172057 13499 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:33:42.172101 13499 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:33:42.176263 13499 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:33:42.176329 13499 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 14:33:42.176347 13499 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:33:42.176365 13499 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:33:42.176381 13499 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:33:42.176396 13499 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:33:42.182026 13499 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:37881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:46519
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:46519
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.131.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13499
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:33:42.183300 13499 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:33:42.184419 13499 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:33:42.194260 13507 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:33:42.194350 13499 server_base.cc:1034] running on GCE node
W20260808 14:33:42.194260 13506 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:33:42.194535 13509 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:33:42.195230 13499 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:33:42.196375 13499 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:33:42.197557 13499 hybrid_clock.cc:648] HybridClock initialized: now 1786199622197531 us; error 41 us; skew 500 ppm
Aug 08 14:33:42 dist-test-slave-twwt krb5kdc[13478](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199622, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:33:42.200696 13499 init.cc:377] Logged in from keytab as kudu/127.11.131.254@KRBTEST.COM (short username kudu)
I20260808 14:33:42.201731 13499 webserver.cc:460] Webserver started at http://127.11.131.254:36603/ using document root <none> and password file <none>
I20260808 14:33:42.202329 13499 fs_manager.cc:359] Metadata directory not provided
I20260808 14:33:42.202394 13499 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:33:42.202708 13499 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:33:42.204887 13499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/master-0/data/instance:
uuid: "5b7dee87e10f4dd68a92d6040a5b8428"
format_stamp: "Formatted at 2026-08-08 14:33:42 on dist-test-slave-twwt"
server_key: "766c96a56860f0387116261656a59de4"
server_key_iv: "3ae823388ddb43484e0524d4369bc36a"
server_key_version: "encryptionkey@0"
I20260808 14:33:42.205508 13499 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/master-0/wal/instance:
uuid: "5b7dee87e10f4dd68a92d6040a5b8428"
format_stamp: "Formatted at 2026-08-08 14:33:42 on dist-test-slave-twwt"
server_key: "766c96a56860f0387116261656a59de4"
server_key_iv: "3ae823388ddb43484e0524d4369bc36a"
server_key_version: "encryptionkey@0"
I20260808 14:33:42.209429 13499 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 14:33:42.212066 13521 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:42.213303 13499 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 14:33:42.213443 13499 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "5b7dee87e10f4dd68a92d6040a5b8428"
format_stamp: "Formatted at 2026-08-08 14:33:42 on dist-test-slave-twwt"
server_key: "766c96a56860f0387116261656a59de4"
server_key_iv: "3ae823388ddb43484e0524d4369bc36a"
server_key_version: "encryptionkey@0"
I20260808 14:33:42.213558 13499 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:33:42.232959 13499 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:33:42.236303 13499 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:33:42.236532 13499 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:33:42.245662 13499 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.254:46519
I20260808 14:33:42.245682 13620 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.254:46519 every 8 connection(s)
I20260808 14:33:42.246758 13499 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:33:42.249740 13621 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:33:42.252727 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 13499
I20260808 14:33:42.252835 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/master-0/wal/instance
I20260808 14:33:42.253105 11791 external_mini_cluster.cc:1428] Setting key 5c46bc8f424ada125b3c0c3c7c8fb7ce
I20260808 14:33:42.256204 13621 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b7dee87e10f4dd68a92d6040a5b8428: Bootstrap starting.
I20260808 14:33:42.259105 13621 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5b7dee87e10f4dd68a92d6040a5b8428: Neither blocks nor log segments found. Creating new log.
I20260808 14:33:42.259915 13621 log.cc:824] T 00000000000000000000000000000000 P 5b7dee87e10f4dd68a92d6040a5b8428: Log is configured to *not* fsync() on all Append() calls
I20260808 14:33:42.262143 13621 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b7dee87e10f4dd68a92d6040a5b8428: No bootstrap required, opened a new log
Aug 08 14:33:42 dist-test-slave-twwt krb5kdc[13478](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199622, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:33:42.266213 13621 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5b7dee87e10f4dd68a92d6040a5b8428 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b7dee87e10f4dd68a92d6040a5b8428" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46519 } }
I20260808 14:33:42.266498 13621 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5b7dee87e10f4dd68a92d6040a5b8428 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:33:42.266584 13621 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5b7dee87e10f4dd68a92d6040a5b8428 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b7dee87e10f4dd68a92d6040a5b8428, State: Initialized, Role: FOLLOWER
I20260808 14:33:42.267141 13621 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5b7dee87e10f4dd68a92d6040a5b8428 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b7dee87e10f4dd68a92d6040a5b8428" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46519 } }
I20260808 14:33:42.267328 13621 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5b7dee87e10f4dd68a92d6040a5b8428 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:33:42.267413 13621 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5b7dee87e10f4dd68a92d6040a5b8428 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:33:42.267524 13621 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5b7dee87e10f4dd68a92d6040a5b8428 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:33:42.268734 13621 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5b7dee87e10f4dd68a92d6040a5b8428 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b7dee87e10f4dd68a92d6040a5b8428" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46519 } }
I20260808 14:33:42.269104 13628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:42.254662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43158 (local address 127.11.131.254:46519)
0808 14:33:42.255168 (+ 506us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:42.255190 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:42.255248 (+ 58us) server_negotiation.cc:407] Connection header received
0808 14:33:42.256057 (+ 809us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:42.256081 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:42.256531 (+ 450us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:42.256917 (+ 386us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:33:42.257652 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:42.259159 (+ 1507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:42.260081 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:42.260805 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:42.260986 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:42.263916 (+ 2930us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:33:42.263922 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:33:42.263936 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:33:42.263965 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:33:42.265704 (+ 1739us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:42.266181 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:42.266186 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:42.266190 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:42.266358 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:42.266673 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:42.266677 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:42.266679 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:42.267200 (+ 521us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:33:42.267457 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:42.267756 (+ 299us) server_negotiation.cc:299] Negotiation successful
0808 14:33:42.268062 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":315,"thread_start_us":137,"threads_started":1}
I20260808 14:33:42.269114 13621 leader_election.cc:302] T 00000000000000000000000000000000 P 5b7dee87e10f4dd68a92d6040a5b8428 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5b7dee87e10f4dd68a92d6040a5b8428; no voters:
I20260808 14:33:42.269501 13621 leader_election.cc:288] T 00000000000000000000000000000000 P 5b7dee87e10f4dd68a92d6040a5b8428 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:33:42.269589 13631 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5b7dee87e10f4dd68a92d6040a5b8428 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:33:42.269814 13631 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5b7dee87e10f4dd68a92d6040a5b8428 [term 1 LEADER]: Becoming Leader. State: Replica: 5b7dee87e10f4dd68a92d6040a5b8428, State: Running, Role: LEADER
I20260808 14:33:42.270186 13631 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5b7dee87e10f4dd68a92d6040a5b8428 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b7dee87e10f4dd68a92d6040a5b8428" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46519 } }
I20260808 14:33:42.270879 13621 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5b7dee87e10f4dd68a92d6040a5b8428 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:33:42.271898 13632 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b7dee87e10f4dd68a92d6040a5b8428 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5b7dee87e10f4dd68a92d6040a5b8428" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b7dee87e10f4dd68a92d6040a5b8428" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46519 } } }
I20260808 14:33:42.272022 13632 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b7dee87e10f4dd68a92d6040a5b8428 [sys.catalog]: This master's current role is: LEADER
I20260808 14:33:42.272213 13634 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b7dee87e10f4dd68a92d6040a5b8428 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5b7dee87e10f4dd68a92d6040a5b8428. Latest consensus state: current_term: 1 leader_uuid: "5b7dee87e10f4dd68a92d6040a5b8428" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b7dee87e10f4dd68a92d6040a5b8428" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46519 } } }
I20260808 14:33:42.272323 13634 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b7dee87e10f4dd68a92d6040a5b8428 [sys.catalog]: This master's current role is: LEADER
I20260808 14:33:42.272598 13644 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:33:42.275995 13644 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:33:42.282078 13644 catalog_manager.cc:1347] Generated new cluster ID: 8a514130984b48cea3953ea2e68efb58
I20260808 14:33:42.282161 13644 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:33:42.321094 13644 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:33:42.322213 13644 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:33:42.329300 13644 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5b7dee87e10f4dd68a92d6040a5b8428: Generated new TSK 0
I20260808 14:33:42.330137 13644 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.131.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab.
Entry for principal kudu/127.11.131.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab.
I20260808 14:33:42.373528 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.193:0
--local_ip_for_outbound_sockets=127.11.131.193
--webserver_interface=127.11.131.193
--webserver_port=0
--tserver_master_addrs=127.11.131.254:46519
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab
--principal=kudu/127.11.131.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:37881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:33:42.492941 13669 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:33:42.493201 13669 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:33:42.493245 13669 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:33:42.497249 13669 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:33:42.497309 13669 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:33:42.497349 13669 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 14:33:42.497380 13669 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.193
I20260808 14:33:42.502751 13669 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:37881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab
--principal=kudu/127.11.131.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.131.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.131.254:46519
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13669
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.193
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:33:42.503871 13669 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:33:42.504961 13669 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:33:42.515158 13676 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:33:42.515151 13678 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:33:42.515290 13669 server_base.cc:1034] running on GCE node
W20260808 14:33:42.515168 13675 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:33:42.515857 13669 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:33:42.516566 13669 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:33:42.517758 13669 hybrid_clock.cc:648] HybridClock initialized: now 1786199622517740 us; error 31 us; skew 500 ppm
Aug 08 14:33:42 dist-test-slave-twwt krb5kdc[13478](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199622, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:33:42.521100 13669 init.cc:377] Logged in from keytab as kudu/127.11.131.193@KRBTEST.COM (short username kudu)
I20260808 14:33:42.522015 13669 webserver.cc:460] Webserver started at http://127.11.131.193:42319/ using document root <none> and password file <none>
I20260808 14:33:42.522567 13669 fs_manager.cc:359] Metadata directory not provided
I20260808 14:33:42.522684 13669 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:33:42.522891 13669 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:33:42.524971 13669 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-0/data/instance:
uuid: "b14c751392954bcab3c99a6835c1fce1"
format_stamp: "Formatted at 2026-08-08 14:33:42 on dist-test-slave-twwt"
server_key: "784694ef7cd73ad504b6a0914ed5a16d"
server_key_iv: "dbef9c208633ef4eb19fd265d8bcae7b"
server_key_version: "encryptionkey@0"
I20260808 14:33:42.525493 13669 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-0/wal/instance:
uuid: "b14c751392954bcab3c99a6835c1fce1"
format_stamp: "Formatted at 2026-08-08 14:33:42 on dist-test-slave-twwt"
server_key: "784694ef7cd73ad504b6a0914ed5a16d"
server_key_iv: "dbef9c208633ef4eb19fd265d8bcae7b"
server_key_version: "encryptionkey@0"
I20260808 14:33:42.529538 13669 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260808 14:33:42.532120 13691 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:42.533439 13669 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 14:33:42.533625 13669 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-0/wal
uuid: "b14c751392954bcab3c99a6835c1fce1"
format_stamp: "Formatted at 2026-08-08 14:33:42 on dist-test-slave-twwt"
server_key: "784694ef7cd73ad504b6a0914ed5a16d"
server_key_iv: "dbef9c208633ef4eb19fd265d8bcae7b"
server_key_version: "encryptionkey@0"
I20260808 14:33:42.533762 13669 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:33:42.552340 13669 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:33:42.555950 13669 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:33:42.556185 13669 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:33:42.557791 13669 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:33:42.557844 13669 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:42.557912 13669 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:33:42.557945 13669 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 14:33:42 dist-test-slave-twwt krb5kdc[13478](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199622, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.193@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:33:42.569763 13669 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.193:40849
I20260808 14:33:42.570659 13868 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.193:40849 every 8 connection(s)
I20260808 14:33:42.571007 13669 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
I20260808 14:33:42.573020 13628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:42.558981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:46175 (local address 127.11.131.254:46519)
0808 14:33:42.559155 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:42.559161 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:42.560142 (+ 981us) server_negotiation.cc:407] Connection header received
0808 14:33:42.561537 (+ 1395us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:42.561543 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:42.561613 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:42.561711 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:33:42.563143 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:42.563696 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:42.565017 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:42.565265 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:42.565401 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:42.568704 (+ 3303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:33:42.568707 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:33:42.568709 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:33:42.568736 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:33:42.570414 (+ 1678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:42.571083 (+ 669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:42.571087 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:42.571089 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:42.571187 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:42.571640 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:42.571644 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:42.571645 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:42.571950 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:33:42.572093 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:42.572680 (+ 587us) server_negotiation.cc:299] Negotiation successful
0808 14:33:42.572844 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 14:33:42.573788 13702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:42.559384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:46519 (local address 127.11.131.193:46175)
0808 14:33:42.559942 (+ 558us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:42.560008 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:42.561265 (+ 1257us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:42.561908 (+ 643us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:42.561918 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:42.562337 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:33:42.562985 (+ 648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:42.563000 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:42.563831 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:42.563835 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:42.564869 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:42.564879 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:42.565459 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:42.565467 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:42.565737 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:42.566470 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:33:42.566490 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:33:42.568508 (+ 2018us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:33:42.570532 (+ 2024us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:42.570537 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:42.570549 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:42.570971 (+ 422us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:42.571313 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:42.571315 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:42.571317 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:42.571505 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:42.572099 (+ 594us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:33:42.572108 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:33:42.572430 (+ 322us) client_negotiation.cc:769] Sending connection context
0808 14:33:42.572621 (+ 191us) client_negotiation.cc:240] Negotiation successful
0808 14:33:42.572969 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":126,"threads_started":1}
I20260808 14:33:42.575131 13871 heartbeater.cc:347] Connected to a master server at 127.11.131.254:46519
I20260808 14:33:42.575281 13871 heartbeater.cc:464] Registering TS with master...
I20260808 14:33:42.575911 13871 heartbeater.cc:511] Master 127.11.131.254:46519 requested a full tablet report, sending...
I20260808 14:33:42.577675 13541 ts_manager.cc:194] Registered new tserver with Master: b14c751392954bcab3c99a6835c1fce1 (127.11.131.193:40849)
I20260808 14:33:42.579209 13541 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.193@KRBTEST.COM'} at 127.11.131.193:46175
I20260808 14:33:42.581176 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 13669
I20260808 14:33:42.581307 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-0/wal/instance
I20260808 14:33:42.581619 11791 external_mini_cluster.cc:1428] Setting key 526cbec556fd10ff2e9c8abb64ff8b47
I20260808 14:33:42.587669 13628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:42.577646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:41711 (local address 127.11.131.254:46519)
0808 14:33:42.577792 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:42.577797 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:42.578079 (+ 282us) server_negotiation.cc:407] Connection header received
0808 14:33:42.578189 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:42.578191 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:42.578233 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:42.578299 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:33:42.578854 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:42.579403 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:42.580421 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:42.580742 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:42.580847 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:42.582176 (+ 1329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:33:42.582180 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:33:42.582183 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:33:42.582207 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:33:42.585871 (+ 3664us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:42.586343 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:42.586347 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:42.586349 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:42.586433 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:42.586807 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:42.586811 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:42.586813 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:42.587001 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:33:42.587113 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:42.587395 (+ 282us) server_negotiation.cc:299] Negotiation successful
0808 14:33:42.587509 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 14:33:42.587680 13878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:42.577502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:46519 (local address 127.11.131.193:41711)
0808 14:33:42.577983 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:42.577998 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:42.578101 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:42.578347 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:42.578350 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:42.578580 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:33:42.578731 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:42.578739 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:42.579516 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:42.579519 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:42.580301 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:42.580310 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:42.580882 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:42.580908 (+ 26us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:42.581019 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:42.581582 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:33:42.581596 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:33:42.582032 (+ 436us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:33:42.586002 (+ 3970us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:42.586006 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:42.586008 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:42.586225 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:42.586532 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:42.586536 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:42.586538 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:42.586704 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:42.587105 (+ 401us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:33:42.587109 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:33:42.587217 (+ 108us) client_negotiation.cc:769] Sending connection context
0808 14:33:42.587330 (+ 113us) client_negotiation.cc:240] Negotiation successful
0808 14:33:42.587494 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":131,"threads_started":1}
WARNING: no policy specified for kudu/127.11.131.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab.
Entry for principal kudu/127.11.131.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab.
I20260808 14:33:42.614557 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.194:0
--local_ip_for_outbound_sockets=127.11.131.194
--webserver_interface=127.11.131.194
--webserver_port=0
--tserver_master_addrs=127.11.131.254:46519
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab
--principal=kudu/127.11.131.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:37881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:33:42.734030 13883 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:33:42.734338 13883 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:33:42.734436 13883 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:33:42.738577 13883 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:33:42.738703 13883 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:33:42.738780 13883 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 14:33:42.738862 13883 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.194
I20260808 14:33:42.744557 13883 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:37881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab
--principal=kudu/127.11.131.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.131.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.131.254:46519
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13883
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.194
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:33:42.745750 13883 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:33:42.746872 13883 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:33:42.757128 13890 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:33:42.757143 13893 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:33:42.757277 13883 server_base.cc:1034] running on GCE node
W20260808 14:33:42.757453 13889 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:33:42.757937 13883 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:33:42.758579 13883 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:33:42.759862 13883 hybrid_clock.cc:648] HybridClock initialized: now 1786199622759841 us; error 34 us; skew 500 ppm
Aug 08 14:33:42 dist-test-slave-twwt krb5kdc[13478](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199622, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:33:42.762845 13883 init.cc:377] Logged in from keytab as kudu/127.11.131.194@KRBTEST.COM (short username kudu)
I20260808 14:33:42.763808 13883 webserver.cc:460] Webserver started at http://127.11.131.194:46471/ using document root <none> and password file <none>
I20260808 14:33:42.764408 13883 fs_manager.cc:359] Metadata directory not provided
I20260808 14:33:42.764503 13883 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:33:42.764750 13883 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:33:42.766983 13883 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-1/data/instance:
uuid: "efaada18707647cb97341022f4c66117"
format_stamp: "Formatted at 2026-08-08 14:33:42 on dist-test-slave-twwt"
server_key: "482d372b10311e3206ab9283ee24af38"
server_key_iv: "099e433907b92b75964909f806e6ab8a"
server_key_version: "encryptionkey@0"
I20260808 14:33:42.767603 13883 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-1/wal/instance:
uuid: "efaada18707647cb97341022f4c66117"
format_stamp: "Formatted at 2026-08-08 14:33:42 on dist-test-slave-twwt"
server_key: "482d372b10311e3206ab9283ee24af38"
server_key_iv: "099e433907b92b75964909f806e6ab8a"
server_key_version: "encryptionkey@0"
I20260808 14:33:42.771797 13883 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 14:33:42.774883 13906 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:42.776230 13883 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:33:42.776381 13883 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-1/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-1/wal
uuid: "efaada18707647cb97341022f4c66117"
format_stamp: "Formatted at 2026-08-08 14:33:42 on dist-test-slave-twwt"
server_key: "482d372b10311e3206ab9283ee24af38"
server_key_iv: "099e433907b92b75964909f806e6ab8a"
server_key_version: "encryptionkey@0"
I20260808 14:33:42.776511 13883 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:33:42.831383 13883 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:33:42.834985 13883 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:33:42.835213 13883 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:33:42.837137 13883 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:33:42.837212 13883 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:42.837299 13883 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:33:42.837352 13883 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:42.848714 13883 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.194:45617
I20260808 14:33:42.848892 14088 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.194:45617 every 8 connection(s)
Aug 08 14:33:42 dist-test-slave-twwt krb5kdc[13478](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199622, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.194@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:33:42.849912 13883 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
I20260808 14:33:42.853608 13628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:42.837936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:59665 (local address 127.11.131.254:46519)
0808 14:33:42.838125 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:42.838131 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:42.839847 (+ 1716us) server_negotiation.cc:407] Connection header received
0808 14:33:42.841331 (+ 1484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:42.841334 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:42.841384 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:42.841496 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:33:42.843334 (+ 1838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:42.844219 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:42.846143 (+ 1924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:42.846366 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:42.846533 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:42.849791 (+ 3258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:33:42.849794 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:33:42.849796 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:33:42.849823 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:33:42.851647 (+ 1824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:42.852152 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:42.852155 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:42.852156 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:42.852234 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:42.852537 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:42.852539 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:42.852540 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:42.852731 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:33:42.852808 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:42.853385 (+ 577us) server_negotiation.cc:299] Negotiation successful
0808 14:33:42.853490 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 14:33:42.854115 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 13883
I20260808 14:33:42.854204 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-1/wal/instance
I20260808 14:33:42.854497 11791 external_mini_cluster.cc:1428] Setting key 62071d013a1b34182c81b8a9c40e8512
I20260808 14:33:42.854718 13924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:42.838950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:46519 (local address 127.11.131.194:59665)
0808 14:33:42.839662 (+ 712us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:42.839724 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:42.841101 (+ 1377us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:42.841725 (+ 624us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:42.841738 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:42.842310 (+ 572us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:33:42.843127 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:42.843155 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:42.844382 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:42.844389 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:42.845981 (+ 1592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:42.845997 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:42.846599 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:42.846632 (+ 33us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:42.846884 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:42.847637 (+ 753us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:33:42.847657 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:33:42.849608 (+ 1951us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:33:42.851762 (+ 2154us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:42.851769 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:42.851781 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:42.852040 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:42.852314 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:42.852316 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:42.852317 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:42.852448 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:42.852917 (+ 469us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:33:42.852924 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:33:42.853162 (+ 238us) client_negotiation.cc:769] Sending connection context
0808 14:33:42.853323 (+ 161us) client_negotiation.cc:240] Negotiation successful
0808 14:33:42.853589 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":311,"thread_start_us":133,"threads_started":1}
I20260808 14:33:42.856158 14090 heartbeater.cc:347] Connected to a master server at 127.11.131.254:46519
I20260808 14:33:42.856374 14090 heartbeater.cc:464] Registering TS with master...
I20260808 14:33:42.857023 14090 heartbeater.cc:511] Master 127.11.131.254:46519 requested a full tablet report, sending...
I20260808 14:33:42.858230 13541 ts_manager.cc:194] Registered new tserver with Master: efaada18707647cb97341022f4c66117 (127.11.131.194:45617)
I20260808 14:33:42.858940 13541 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.194@KRBTEST.COM'} at 127.11.131.194:59665
I20260808 14:33:42.866725 13628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:42.859270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:57065 (local address 127.11.131.254:46519)
0808 14:33:42.859382 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:42.859385 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:42.859395 (+ 10us) server_negotiation.cc:407] Connection header received
0808 14:33:42.859424 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:42.859426 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:42.859457 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:42.859553 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:33:42.860085 (+ 532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:42.860683 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:42.861866 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:42.862077 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:42.862152 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:42.863519 (+ 1367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:33:42.863522 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:33:42.863524 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:33:42.863546 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:33:42.864951 (+ 1405us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:42.865453 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:42.865455 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:42.865456 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:42.865527 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:42.865849 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:42.865851 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:42.865852 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:42.866052 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:33:42.866129 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:42.866464 (+ 335us) server_negotiation.cc:299] Negotiation successful
0808 14:33:42.866555 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 14:33:42.866801 14104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:42.858234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:46519 (local address 127.11.131.194:57065)
0808 14:33:42.858575 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:42.858586 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:42.858729 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:42.859574 (+ 845us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:42.859577 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:42.859802 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:33:42.859944 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:42.859953 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:42.860832 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:42.860836 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:42.861734 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:42.861750 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:42.862195 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:42.862202 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:42.862332 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:42.862896 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:33:42.862917 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:33:42.863382 (+ 465us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:33:42.865067 (+ 1685us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:42.865074 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:42.865077 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:42.865346 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:42.865635 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:42.865640 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:42.865645 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:42.865751 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:42.866159 (+ 408us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:33:42.866163 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:33:42.866276 (+ 113us) client_negotiation.cc:769] Sending connection context
0808 14:33:42.866401 (+ 125us) client_negotiation.cc:240] Negotiation successful
0808 14:33:42.866562 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"mutex_wait_us":3,"thread_start_us":122,"threads_started":1}
WARNING: no policy specified for kudu/127.11.131.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab.
Entry for principal kudu/127.11.131.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab.
I20260808 14:33:42.889927 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.195:0
--local_ip_for_outbound_sockets=127.11.131.195
--webserver_interface=127.11.131.195
--webserver_port=0
--tserver_master_addrs=127.11.131.254:46519
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab
--principal=kudu/127.11.131.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:37881
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:33:43.009485 14107 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:33:43.009770 14107 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:33:43.009845 14107 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:33:43.014029 14107 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:33:43.014110 14107 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:33:43.014150 14107 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 14:33:43.014221 14107 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.195
I20260808 14:33:43.019938 14107 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:37881
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab
--principal=kudu/127.11.131.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.131.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.131.254:46519
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14107
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.195
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:33:43.021114 14107 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:33:43.022241 14107 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:33:43.032555 14115 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:33:43.032675 14107 server_base.cc:1034] running on GCE node
W20260808 14:33:43.032573 14114 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:33:43.032549 14120 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:33:43.033349 14107 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:33:43.034044 14107 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:33:43.035209 14107 hybrid_clock.cc:648] HybridClock initialized: now 1786199623035175 us; error 47 us; skew 500 ppm
Aug 08 14:33:43 dist-test-slave-twwt krb5kdc[13478](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199623, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:33:43.038127 14107 init.cc:377] Logged in from keytab as kudu/127.11.131.195@KRBTEST.COM (short username kudu)
I20260808 14:33:43.039214 14107 webserver.cc:460] Webserver started at http://127.11.131.195:34923/ using document root <none> and password file <none>
I20260808 14:33:43.039877 14107 fs_manager.cc:359] Metadata directory not provided
I20260808 14:33:43.039950 14107 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:33:43.040195 14107 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:33:43.042845 14107 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-2/data/instance:
uuid: "b3cf3b7012f54519b619bcdddcae37a8"
format_stamp: "Formatted at 2026-08-08 14:33:43 on dist-test-slave-twwt"
server_key: "1246ba830ce115aaca5a7fc12106b6f0"
server_key_iv: "15f5b6aa950a15a93460867ba4700a5b"
server_key_version: "encryptionkey@0"
I20260808 14:33:43.043439 14107 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-2/wal/instance:
uuid: "b3cf3b7012f54519b619bcdddcae37a8"
format_stamp: "Formatted at 2026-08-08 14:33:43 on dist-test-slave-twwt"
server_key: "1246ba830ce115aaca5a7fc12106b6f0"
server_key_iv: "15f5b6aa950a15a93460867ba4700a5b"
server_key_version: "encryptionkey@0"
I20260808 14:33:43.047349 14107 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 14:33:43.049991 14133 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:43.051411 14107 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 14:33:43.051568 14107 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-2/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-2/wal
uuid: "b3cf3b7012f54519b619bcdddcae37a8"
format_stamp: "Formatted at 2026-08-08 14:33:43 on dist-test-slave-twwt"
server_key: "1246ba830ce115aaca5a7fc12106b6f0"
server_key_iv: "15f5b6aa950a15a93460867ba4700a5b"
server_key_version: "encryptionkey@0"
I20260808 14:33:43.051697 14107 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:33:43.065966 14107 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:33:43.069161 14107 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:33:43.069375 14107 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:33:43.071110 14107 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:33:43.071182 14107 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:43.071244 14107 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:33:43.071296 14107 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 14:33:43 dist-test-slave-twwt krb5kdc[13478](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199623, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.195@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:33:43.083217 14107 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.195:43509
I20260808 14:33:43.083693 14300 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.195:43509 every 8 connection(s)
I20260808 14:33:43.084239 14107 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
I20260808 14:33:43.086541 13628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:43.071853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:49989 (local address 127.11.131.254:46519)
0808 14:33:43.072018 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:43.072024 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:43.073449 (+ 1425us) server_negotiation.cc:407] Connection header received
0808 14:33:43.074843 (+ 1394us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:43.074850 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:43.074923 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:43.075038 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:33:43.076534 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:43.077143 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:43.079088 (+ 1945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:43.079394 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:43.079535 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:43.082697 (+ 3162us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:33:43.082703 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:33:43.082706 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:33:43.082739 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:33:43.084357 (+ 1618us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:43.084910 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:43.084913 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:43.084915 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:43.085036 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:43.085419 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:43.085425 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:43.085430 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:43.085626 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:33:43.085742 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:43.086245 (+ 503us) server_negotiation.cc:299] Negotiation successful
0808 14:33:43.086373 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 14:33:43.087359 14146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:43.072813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:46519 (local address 127.11.131.195:49989)
0808 14:33:43.073275 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:43.073327 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:43.074535 (+ 1208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:43.075258 (+ 723us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:43.075265 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:43.075789 (+ 524us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:33:43.076315 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:43.076355 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:43.077268 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:43.077275 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:43.078942 (+ 1667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:43.078958 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:43.079581 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:43.079586 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:43.079796 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:43.080499 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:33:43.080522 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:33:43.082465 (+ 1943us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:33:43.084487 (+ 2022us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:43.084494 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:43.084510 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:43.084788 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:43.085156 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:43.085160 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:43.085162 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:43.085330 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:43.085742 (+ 412us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:33:43.085750 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:33:43.086003 (+ 253us) client_negotiation.cc:769] Sending connection context
0808 14:33:43.086199 (+ 196us) client_negotiation.cc:240] Negotiation successful
0808 14:33:43.086532 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":129,"threads_started":1}
I20260808 14:33:43.088303 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 14107
I20260808 14:33:43.088450 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-2/wal/instance
I20260808 14:33:43.088724 11791 external_mini_cluster.cc:1428] Setting key 386c90a926cb3f80e07055eb0b2c9cda
I20260808 14:33:43.088846 14302 heartbeater.cc:347] Connected to a master server at 127.11.131.254:46519
I20260808 14:33:43.089006 14302 heartbeater.cc:464] Registering TS with master...
I20260808 14:33:43.089834 14302 heartbeater.cc:511] Master 127.11.131.254:46519 requested a full tablet report, sending...
I20260808 14:33:43.091020 13542 ts_manager.cc:194] Registered new tserver with Master: b3cf3b7012f54519b619bcdddcae37a8 (127.11.131.195:43509)
I20260808 14:33:43.091746 13542 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.195@KRBTEST.COM'} at 127.11.131.195:49989
I20260808 14:33:43.098327 13628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:43.091384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:41191 (local address 127.11.131.254:46519)
0808 14:33:43.091512 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:43.091516 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:43.091760 (+ 244us) server_negotiation.cc:407] Connection header received
0808 14:33:43.091892 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:43.091894 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:43.091934 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:43.092024 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:33:43.092508 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:43.093020 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:43.093870 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:43.094095 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:43.094204 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:43.095385 (+ 1181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:33:43.095389 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:33:43.095391 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:33:43.095417 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:33:43.096656 (+ 1239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:43.097113 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:43.097117 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:43.097119 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:43.097202 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:43.097498 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:43.097501 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:43.097503 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:43.097681 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:33:43.097793 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:43.098066 (+ 273us) server_negotiation.cc:299] Negotiation successful
0808 14:33:43.098181 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 14:33:43.098342 14309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:43.091331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:46519 (local address 127.11.131.195:41191)
0808 14:33:43.091665 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:43.091680 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:43.091789 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:43.092072 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:43.092075 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:43.092271 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:33:43.092378 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:43.092384 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:43.093154 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:43.093158 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:43.093746 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:43.093754 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:43.094219 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:43.094223 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:43.094329 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:43.094917 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:33:43.094930 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:33:43.095244 (+ 314us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:33:43.096793 (+ 1549us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:43.096796 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:43.096798 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:43.097007 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:43.097300 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:43.097303 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:43.097305 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:43.097395 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:43.097783 (+ 388us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:33:43.097787 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:33:43.097890 (+ 103us) client_negotiation.cc:769] Sending connection context
0808 14:33:43.098003 (+ 113us) client_negotiation.cc:240] Negotiation successful
0808 14:33:43.098152 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"mutex_wait_us":1,"thread_start_us":130,"threads_started":1}
I20260808 14:33:43.102735 11791 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 14:33:43 dist-test-slave-twwt krb5kdc[13478](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199623, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 14:33:43 dist-test-slave-twwt krb5kdc[13478](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199623, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:33:43.131000 13628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:43.122820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38722 (local address 127.11.131.254:46519)
0808 14:33:43.122961 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:43.122964 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:43.122977 (+ 13us) server_negotiation.cc:407] Connection header received
0808 14:33:43.123021 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:43.123023 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:43.123064 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:43.123130 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:33:43.123873 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:43.124392 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:43.125216 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:43.125422 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:43.125498 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:43.127971 (+ 2473us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:33:43.127975 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:33:43.127977 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:33:43.128001 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:33:43.129278 (+ 1277us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:43.129710 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:43.129714 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:43.129715 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:43.129800 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:43.130089 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:43.130093 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:43.130095 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:43.130285 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:33:43.130445 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:43.130701 (+ 256us) server_negotiation.cc:299] Negotiation successful
0808 14:33:43.130819 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 14:33:43.134035 13542 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38722:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:33:43.137207 13542 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:33:43.152033 14323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:43.146025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.195:43509 (local address 127.0.0.1:44542)
0808 14:33:43.146952 (+ 927us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:43.147032 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:43.147169 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:43.147919 (+ 750us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:43.147926 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:43.147949 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:33:43.148155 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:43.148165 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:43.149236 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:43.149240 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:43.150469 (+ 1229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:43.150478 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:43.151442 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:43.151446 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:43.151567 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:43.151611 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 14:33:43.151733 (+ 122us) client_negotiation.cc:240] Negotiation successful
0808 14:33:43.151858 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":743,"mutex_wait_us":39,"thread_start_us":81,"threads_started":1}
I20260808 14:33:43.152081 14325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:43.146365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44542 (local address 127.11.131.195:43509)
0808 14:33:43.147477 (+ 1112us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:43.147491 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:43.147517 (+ 26us) server_negotiation.cc:407] Connection header received
0808 14:33:43.147595 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:43.147599 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:43.147759 (+ 160us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:43.147931 (+ 172us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:33:43.148298 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:43.149112 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:43.150596 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:43.151313 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:43.151463 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:43.151604 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:43.151781 (+ 177us) server_negotiation.cc:299] Negotiation successful
0808 14:33:43.151894 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":992,"thread_start_us":137,"threads_started":1}
I20260808 14:33:43.152896 14324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:43.146813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:40849 (local address 127.0.0.1:54740)
0808 14:33:43.147466 (+ 653us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:43.147479 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:43.147558 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:43.148063 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:43.148066 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:43.148084 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:33:43.148270 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:43.148278 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:43.149712 (+ 1434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:43.149716 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:43.150976 (+ 1260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:43.150987 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:43.152241 (+ 1254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:43.152245 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:43.152508 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:43.152549 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 14:33:43.152629 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 14:33:43.152759 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":593,"mutex_wait_us":168,"thread_start_us":105,"threads_started":1}
I20260808 14:33:43.152954 14333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:43.147095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54740 (local address 127.11.131.193:40849)
0808 14:33:43.147571 (+ 476us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:43.147580 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:43.147607 (+ 27us) server_negotiation.cc:407] Connection header received
0808 14:33:43.147690 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:43.147697 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:43.147908 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:43.148161 (+ 253us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:33:43.148395 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:43.149575 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:43.151112 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:43.151908 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:43.152028 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:43.152167 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:43.152700 (+ 533us) server_negotiation.cc:299] Negotiation successful
0808 14:33:43.152813 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":357,"thread_start_us":98,"threads_started":1}
I20260808 14:33:43.153448 14329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:43.146103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.194:45617 (local address 127.0.0.1:47796)
0808 14:33:43.147172 (+ 1069us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:43.147187 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:43.147277 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:43.148264 (+ 987us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:43.148267 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:43.148287 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:33:43.148417 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:43.148423 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:43.149950 (+ 1527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:43.149954 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:43.151130 (+ 1176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:43.151140 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:43.152237 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:43.152244 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:43.152504 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:43.152552 (+ 48us) client_negotiation.cc:769] Sending connection context
0808 14:33:43.152622 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 14:33:43.153300 (+ 678us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1004,"mutex_wait_us":152,"thread_start_us":89,"threads_started":1}
I20260808 14:33:43.153604 14328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:43.146756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47796 (local address 127.11.131.194:45617)
0808 14:33:43.147817 (+ 1061us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:43.147829 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:43.147850 (+ 21us) server_negotiation.cc:407] Connection header received
0808 14:33:43.147940 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:43.147946 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:43.148120 (+ 174us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:43.148577 (+ 457us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:33:43.148720 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:43.149818 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:43.151252 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:43.152077 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:43.152397 (+ 320us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:43.153270 (+ 873us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:43.153327 (+ 57us) server_negotiation.cc:299] Negotiation successful
0808 14:33:43.153416 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":948,"thread_start_us":131,"threads_started":1}
I20260808 14:33:43.156212 14201 tablet_service.cc:1467] Processing CreateTablet for tablet f5fe1ad088f5425f9275d30bb9bd8ee3 (DEFAULT_TABLE table=test-table [id=80829b2ca4a84037a9a742f7bdd15b2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:33:43.156193 13776 tablet_service.cc:1467] Processing CreateTablet for tablet f5fe1ad088f5425f9275d30bb9bd8ee3 (DEFAULT_TABLE table=test-table [id=80829b2ca4a84037a9a742f7bdd15b2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:33:43.156371 13966 tablet_service.cc:1467] Processing CreateTablet for tablet f5fe1ad088f5425f9275d30bb9bd8ee3 (DEFAULT_TABLE table=test-table [id=80829b2ca4a84037a9a742f7bdd15b2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:33:43.157378 14201 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5fe1ad088f5425f9275d30bb9bd8ee3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:33:43.157377 13776 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5fe1ad088f5425f9275d30bb9bd8ee3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:33:43.157377 13966 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f5fe1ad088f5425f9275d30bb9bd8ee3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:33:43.164736 14334 tablet_bootstrap.cc:492] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b3cf3b7012f54519b619bcdddcae37a8: Bootstrap starting.
I20260808 14:33:43.165436 14335 tablet_bootstrap.cc:492] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b14c751392954bcab3c99a6835c1fce1: Bootstrap starting.
I20260808 14:33:43.167984 14335 tablet_bootstrap.cc:654] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b14c751392954bcab3c99a6835c1fce1: Neither blocks nor log segments found. Creating new log.
I20260808 14:33:43.167984 14334 tablet_bootstrap.cc:654] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b3cf3b7012f54519b619bcdddcae37a8: Neither blocks nor log segments found. Creating new log.
I20260808 14:33:43.168452 14336 tablet_bootstrap.cc:492] T f5fe1ad088f5425f9275d30bb9bd8ee3 P efaada18707647cb97341022f4c66117: Bootstrap starting.
I20260808 14:33:43.169262 14334 log.cc:824] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b3cf3b7012f54519b619bcdddcae37a8: Log is configured to *not* fsync() on all Append() calls
I20260808 14:33:43.169261 14335 log.cc:824] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b14c751392954bcab3c99a6835c1fce1: Log is configured to *not* fsync() on all Append() calls
I20260808 14:33:43.171023 14336 tablet_bootstrap.cc:654] T f5fe1ad088f5425f9275d30bb9bd8ee3 P efaada18707647cb97341022f4c66117: Neither blocks nor log segments found. Creating new log.
I20260808 14:33:43.171679 14335 tablet_bootstrap.cc:492] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b14c751392954bcab3c99a6835c1fce1: No bootstrap required, opened a new log
I20260808 14:33:43.171701 14334 tablet_bootstrap.cc:492] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b3cf3b7012f54519b619bcdddcae37a8: No bootstrap required, opened a new log
I20260808 14:33:43.171912 14334 ts_tablet_manager.cc:1397] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b3cf3b7012f54519b619bcdddcae37a8: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260808 14:33:43.171917 14335 ts_tablet_manager.cc:1397] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b14c751392954bcab3c99a6835c1fce1: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260808 14:33:43.171953 14336 log.cc:824] T f5fe1ad088f5425f9275d30bb9bd8ee3 P efaada18707647cb97341022f4c66117: Log is configured to *not* fsync() on all Append() calls
I20260808 14:33:43.174443 14336 tablet_bootstrap.cc:492] T f5fe1ad088f5425f9275d30bb9bd8ee3 P efaada18707647cb97341022f4c66117: No bootstrap required, opened a new log
I20260808 14:33:43.174679 14336 ts_tablet_manager.cc:1397] T f5fe1ad088f5425f9275d30bb9bd8ee3 P efaada18707647cb97341022f4c66117: Time spent bootstrapping tablet: real 0.006s user 0.006s sys 0.000s
I20260808 14:33:43.175242 14334 raft_consensus.cc:348] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b3cf3b7012f54519b619bcdddcae37a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3cf3b7012f54519b619bcdddcae37a8" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 43509 } } peers { permanent_uuid: "efaada18707647cb97341022f4c66117" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 45617 } } peers { permanent_uuid: "b14c751392954bcab3c99a6835c1fce1" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 40849 } }
I20260808 14:33:43.175530 14334 raft_consensus.cc:374] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b3cf3b7012f54519b619bcdddcae37a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:33:43.175603 14334 raft_consensus.cc:729] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b3cf3b7012f54519b619bcdddcae37a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3cf3b7012f54519b619bcdddcae37a8, State: Initialized, Role: FOLLOWER
I20260808 14:33:43.176205 14334 consensus_queue.cc:260] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b3cf3b7012f54519b619bcdddcae37a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3cf3b7012f54519b619bcdddcae37a8" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 43509 } } peers { permanent_uuid: "efaada18707647cb97341022f4c66117" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 45617 } } peers { permanent_uuid: "b14c751392954bcab3c99a6835c1fce1" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 40849 } }
I20260808 14:33:43.176721 14335 raft_consensus.cc:348] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b14c751392954bcab3c99a6835c1fce1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3cf3b7012f54519b619bcdddcae37a8" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 43509 } } peers { permanent_uuid: "efaada18707647cb97341022f4c66117" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 45617 } } peers { permanent_uuid: "b14c751392954bcab3c99a6835c1fce1" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 40849 } }
I20260808 14:33:43.177055 14335 raft_consensus.cc:374] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b14c751392954bcab3c99a6835c1fce1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:33:43.177143 14335 raft_consensus.cc:729] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b14c751392954bcab3c99a6835c1fce1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b14c751392954bcab3c99a6835c1fce1, State: Initialized, Role: FOLLOWER
I20260808 14:33:43.177536 14302 heartbeater.cc:503] Master 127.11.131.254:46519 was elected leader, sending a full tablet report...
I20260808 14:33:43.177570 14334 ts_tablet_manager.cc:1428] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b3cf3b7012f54519b619bcdddcae37a8: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 14:33:43.177664 14335 consensus_queue.cc:260] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b14c751392954bcab3c99a6835c1fce1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3cf3b7012f54519b619bcdddcae37a8" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 43509 } } peers { permanent_uuid: "efaada18707647cb97341022f4c66117" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 45617 } } peers { permanent_uuid: "b14c751392954bcab3c99a6835c1fce1" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 40849 } }
I20260808 14:33:43.178339 13871 heartbeater.cc:503] Master 127.11.131.254:46519 was elected leader, sending a full tablet report...
I20260808 14:33:43.178678 14335 ts_tablet_manager.cc:1428] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b14c751392954bcab3c99a6835c1fce1: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260808 14:33:43.180028 14336 raft_consensus.cc:348] T f5fe1ad088f5425f9275d30bb9bd8ee3 P efaada18707647cb97341022f4c66117 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3cf3b7012f54519b619bcdddcae37a8" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 43509 } } peers { permanent_uuid: "efaada18707647cb97341022f4c66117" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 45617 } } peers { permanent_uuid: "b14c751392954bcab3c99a6835c1fce1" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 40849 } }
I20260808 14:33:43.180365 14336 raft_consensus.cc:374] T f5fe1ad088f5425f9275d30bb9bd8ee3 P efaada18707647cb97341022f4c66117 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:33:43.180435 14336 raft_consensus.cc:729] T f5fe1ad088f5425f9275d30bb9bd8ee3 P efaada18707647cb97341022f4c66117 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efaada18707647cb97341022f4c66117, State: Initialized, Role: FOLLOWER
I20260808 14:33:43.181010 14336 consensus_queue.cc:260] T f5fe1ad088f5425f9275d30bb9bd8ee3 P efaada18707647cb97341022f4c66117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3cf3b7012f54519b619bcdddcae37a8" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 43509 } } peers { permanent_uuid: "efaada18707647cb97341022f4c66117" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 45617 } } peers { permanent_uuid: "b14c751392954bcab3c99a6835c1fce1" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 40849 } }
I20260808 14:33:43.182677 14336 ts_tablet_manager.cc:1428] T f5fe1ad088f5425f9275d30bb9bd8ee3 P efaada18707647cb97341022f4c66117: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260808 14:33:43.183095 14090 heartbeater.cc:503] Master 127.11.131.254:46519 was elected leader, sending a full tablet report...
I20260808 14:33:43.311287 14342 raft_consensus.cc:482] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b14c751392954bcab3c99a6835c1fce1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:33:43.311565 14342 raft_consensus.cc:504] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b14c751392954bcab3c99a6835c1fce1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3cf3b7012f54519b619bcdddcae37a8" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 43509 } } peers { permanent_uuid: "efaada18707647cb97341022f4c66117" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 45617 } } peers { permanent_uuid: "b14c751392954bcab3c99a6835c1fce1" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 40849 } }
I20260808 14:33:43.312968 14342 leader_election.cc:288] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b14c751392954bcab3c99a6835c1fce1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3cf3b7012f54519b619bcdddcae37a8 (127.11.131.195:43509), efaada18707647cb97341022f4c66117 (127.11.131.194:45617)
I20260808 14:33:43.317116 14325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:43.313358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:52595 (local address 127.11.131.195:43509)
0808 14:33:43.313520 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:43.313526 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:43.313729 (+ 203us) server_negotiation.cc:407] Connection header received
0808 14:33:43.313888 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:43.313894 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:43.313945 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:43.314003 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:33:43.314365 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:43.314964 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:43.316077 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:43.316501 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:43.316631 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:43.316688 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:43.316893 (+ 205us) server_negotiation.cc:299] Negotiation successful
0808 14:33:43.316981 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 14:33:43.317137 14348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:43.313199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.195:43509 (local address 127.11.131.193:52595)
0808 14:33:43.313619 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:43.313632 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:43.313763 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:43.314050 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:43.314056 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:43.314073 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:33:43.314238 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:43.314245 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:43.315108 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:43.315110 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:43.315944 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:43.315954 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:43.316628 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:43.316631 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:43.316732 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:43.316756 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 14:33:43.316862 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 14:33:43.316950 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":346,"mutex_wait_us":23,"thread_start_us":138,"threads_started":1}
I20260808 14:33:43.317209 14328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:43.313418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:49727 (local address 127.11.131.194:45617)
0808 14:33:43.313553 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:43.313558 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:43.313765 (+ 207us) server_negotiation.cc:407] Connection header received
0808 14:33:43.313922 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:43.313925 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:43.313967 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:43.314064 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:33:43.314395 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:43.314929 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:43.316121 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:43.316515 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:43.316649 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:43.316704 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:43.316966 (+ 262us) server_negotiation.cc:299] Negotiation successful
0808 14:33:43.317066 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 14:33:43.317157 14346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:43.313246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.194:45617 (local address 127.11.131.193:49727)
0808 14:33:43.313635 (+ 389us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:43.313646 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:43.313778 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:43.314098 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:43.314101 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:43.314122 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:33:43.314247 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:43.314252 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:43.315041 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:43.315046 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:43.315966 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:43.315977 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:43.316657 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:43.316661 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:43.316774 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:43.316792 (+ 18us) client_negotiation.cc:769] Sending connection context
0808 14:33:43.316939 (+ 147us) client_negotiation.cc:240] Negotiation successful
0808 14:33:43.317005 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":334,"mutex_wait_us":54,"thread_start_us":127,"threads_started":1}
I20260808 14:33:43.317881 14232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5fe1ad088f5425f9275d30bb9bd8ee3" candidate_uuid: "b14c751392954bcab3c99a6835c1fce1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3cf3b7012f54519b619bcdddcae37a8" is_pre_election: true
I20260808 14:33:43.318056 14018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5fe1ad088f5425f9275d30bb9bd8ee3" candidate_uuid: "b14c751392954bcab3c99a6835c1fce1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efaada18707647cb97341022f4c66117" is_pre_election: true
I20260808 14:33:43.318269 14232 raft_consensus.cc:2454] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b3cf3b7012f54519b619bcdddcae37a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b14c751392954bcab3c99a6835c1fce1 in term 0.
I20260808 14:33:43.318380 14018 raft_consensus.cc:2454] T f5fe1ad088f5425f9275d30bb9bd8ee3 P efaada18707647cb97341022f4c66117 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b14c751392954bcab3c99a6835c1fce1 in term 0.
I20260808 14:33:43.318858 13696 leader_election.cc:302] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b14c751392954bcab3c99a6835c1fce1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b14c751392954bcab3c99a6835c1fce1, b3cf3b7012f54519b619bcdddcae37a8; no voters:
I20260808 14:33:43.319147 14342 raft_consensus.cc:2781] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b14c751392954bcab3c99a6835c1fce1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:33:43.319226 14342 raft_consensus.cc:482] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b14c751392954bcab3c99a6835c1fce1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:33:43.319276 14342 raft_consensus.cc:3037] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b14c751392954bcab3c99a6835c1fce1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:33:43.320429 14342 raft_consensus.cc:504] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b14c751392954bcab3c99a6835c1fce1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3cf3b7012f54519b619bcdddcae37a8" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 43509 } } peers { permanent_uuid: "efaada18707647cb97341022f4c66117" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 45617 } } peers { permanent_uuid: "b14c751392954bcab3c99a6835c1fce1" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 40849 } }
I20260808 14:33:43.320835 14342 leader_election.cc:288] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b14c751392954bcab3c99a6835c1fce1 [CANDIDATE]: Term 1 election: Requested vote from peers b3cf3b7012f54519b619bcdddcae37a8 (127.11.131.195:43509), efaada18707647cb97341022f4c66117 (127.11.131.194:45617)
I20260808 14:33:43.321234 14018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5fe1ad088f5425f9275d30bb9bd8ee3" candidate_uuid: "b14c751392954bcab3c99a6835c1fce1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efaada18707647cb97341022f4c66117"
I20260808 14:33:43.321275 14232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f5fe1ad088f5425f9275d30bb9bd8ee3" candidate_uuid: "b14c751392954bcab3c99a6835c1fce1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3cf3b7012f54519b619bcdddcae37a8"
I20260808 14:33:43.321364 14018 raft_consensus.cc:3037] T f5fe1ad088f5425f9275d30bb9bd8ee3 P efaada18707647cb97341022f4c66117 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:33:43.321390 14232 raft_consensus.cc:3037] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b3cf3b7012f54519b619bcdddcae37a8 [term 0 FOLLOWER]: Advancing to term 1
W20260808 14:33:43.322796 13872 tablet.cc:2369] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b14c751392954bcab3c99a6835c1fce1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:33:43.322816 14018 raft_consensus.cc:2454] T f5fe1ad088f5425f9275d30bb9bd8ee3 P efaada18707647cb97341022f4c66117 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b14c751392954bcab3c99a6835c1fce1 in term 1.
I20260808 14:33:43.323117 14232 raft_consensus.cc:2454] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b3cf3b7012f54519b619bcdddcae37a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b14c751392954bcab3c99a6835c1fce1 in term 1.
I20260808 14:33:43.323159 13694 leader_election.cc:302] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b14c751392954bcab3c99a6835c1fce1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b14c751392954bcab3c99a6835c1fce1, efaada18707647cb97341022f4c66117; no voters:
I20260808 14:33:43.323318 14342 raft_consensus.cc:2781] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b14c751392954bcab3c99a6835c1fce1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:33:43.323554 14342 raft_consensus.cc:686] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b14c751392954bcab3c99a6835c1fce1 [term 1 LEADER]: Becoming Leader. State: Replica: b14c751392954bcab3c99a6835c1fce1, State: Running, Role: LEADER
I20260808 14:33:43.323894 14342 consensus_queue.cc:237] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b14c751392954bcab3c99a6835c1fce1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3cf3b7012f54519b619bcdddcae37a8" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 43509 } } peers { permanent_uuid: "efaada18707647cb97341022f4c66117" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 45617 } } peers { permanent_uuid: "b14c751392954bcab3c99a6835c1fce1" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 40849 } }
I20260808 14:33:43.327217 13542 catalog_manager.cc:5495] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b14c751392954bcab3c99a6835c1fce1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b14c751392954bcab3c99a6835c1fce1 (127.11.131.193). New cstate: current_term: 1 leader_uuid: "b14c751392954bcab3c99a6835c1fce1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3cf3b7012f54519b619bcdddcae37a8" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 43509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efaada18707647cb97341022f4c66117" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 45617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b14c751392954bcab3c99a6835c1fce1" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 40849 } health_report { overall_health: HEALTHY } } }
W20260808 14:33:43.335602 14303 tablet.cc:2369] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b3cf3b7012f54519b619bcdddcae37a8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:33:43.349082 14333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:43.345584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54754 (local address 127.11.131.193:40849)
0808 14:33:43.345737 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:43.345741 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:43.345755 (+ 14us) server_negotiation.cc:407] Connection header received
0808 14:33:43.345955 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:43.345958 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:43.346014 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:43.346100 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:33:43.346363 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:43.346918 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:43.347741 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:43.347948 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:43.348023 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:43.348309 (+ 286us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:33:43.348700 (+ 391us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:33:43.348784 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:43.348859 (+ 75us) server_negotiation.cc:299] Negotiation successful
0808 14:33:43.348908 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
W20260808 14:33:43.351497 14093 tablet.cc:2369] T f5fe1ad088f5425f9275d30bb9bd8ee3 P efaada18707647cb97341022f4c66117: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:33:43.355378 14232 raft_consensus.cc:1261] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b3cf3b7012f54519b619bcdddcae37a8 [term 1 FOLLOWER]: Refusing update from remote peer b14c751392954bcab3c99a6835c1fce1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:33:43.355711 14018 raft_consensus.cc:1261] T f5fe1ad088f5425f9275d30bb9bd8ee3 P efaada18707647cb97341022f4c66117 [term 1 FOLLOWER]: Refusing update from remote peer b14c751392954bcab3c99a6835c1fce1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:33:43.356216 14349 consensus_queue.cc:1035] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b14c751392954bcab3c99a6835c1fce1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3cf3b7012f54519b619bcdddcae37a8" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 43509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:33:43.356369 14342 consensus_queue.cc:1035] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b14c751392954bcab3c99a6835c1fce1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efaada18707647cb97341022f4c66117" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 45617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:33:43.365610 14354 mvcc.cc:205] Tried to move back new op lower bound from 7316273657255690240 to 7316273657137106944. Current Snapshot: MvccSnapshot[applied={T|T < 7316273657255690240}]
I20260808 14:33:43.366789 14357 mvcc.cc:205] Tried to move back new op lower bound from 7316273657255690240 to 7316273657137106944. Current Snapshot: MvccSnapshot[applied={T|T < 7316273657255690240}]
I20260808 14:33:43.377097 13541 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38722:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:33:43.377321 13541 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38722:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:33:43.380069 13541 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5b7dee87e10f4dd68a92d6040a5b8428: Sending DeleteTablet for 3 replicas of tablet f5fe1ad088f5425f9275d30bb9bd8ee3
I20260808 14:33:43.381023 13776 tablet_service.cc:1514] Processing DeleteTablet for tablet f5fe1ad088f5425f9275d30bb9bd8ee3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:33:43 UTC) from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:54740
I20260808 14:33:43.381090 14201 tablet_service.cc:1514] Processing DeleteTablet for tablet f5fe1ad088f5425f9275d30bb9bd8ee3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:33:43 UTC) from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:44542
I20260808 14:33:43.381567 14366 tablet_replica.cc:330] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b14c751392954bcab3c99a6835c1fce1: stopping tablet replica
I20260808 14:33:43.381636 13966 tablet_service.cc:1514] Processing DeleteTablet for tablet f5fe1ad088f5425f9275d30bb9bd8ee3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:33:43 UTC) from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:47796
I20260808 14:33:43.381927 14366 raft_consensus.cc:2229] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b14c751392954bcab3c99a6835c1fce1 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:33:43.382171 14369 tablet_replica.cc:330] T f5fe1ad088f5425f9275d30bb9bd8ee3 P efaada18707647cb97341022f4c66117: stopping tablet replica
I20260808 14:33:43.382351 14366 raft_consensus.cc:2258] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b14c751392954bcab3c99a6835c1fce1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:33:43.382663 14369 raft_consensus.cc:2229] T f5fe1ad088f5425f9275d30bb9bd8ee3 P efaada18707647cb97341022f4c66117 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:33:43.383080 14369 raft_consensus.cc:2258] T f5fe1ad088f5425f9275d30bb9bd8ee3 P efaada18707647cb97341022f4c66117 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:33:43.383149 13541 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38722:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:33:43.383630 13541 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:33:43.384719 14369 ts_tablet_manager.cc:1905] T f5fe1ad088f5425f9275d30bb9bd8ee3 P efaada18707647cb97341022f4c66117: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:33:43.385322 14366 ts_tablet_manager.cc:1905] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b14c751392954bcab3c99a6835c1fce1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:33:43.389462 13776 tablet_service.cc:1467] Processing CreateTablet for tablet 101b42a834ce443aa755145ad1263520 (DEFAULT_TABLE table=test-table [id=c60b0b0ec6804319be9bafaea5f804ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:33:43.389539 14201 tablet_service.cc:1467] Processing CreateTablet for tablet 101b42a834ce443aa755145ad1263520 (DEFAULT_TABLE table=test-table [id=c60b0b0ec6804319be9bafaea5f804ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:33:43.389763 13776 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 101b42a834ce443aa755145ad1263520. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:33:43.389816 14201 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 101b42a834ce443aa755145ad1263520. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:33:43.391646 14335 tablet_bootstrap.cc:492] T 101b42a834ce443aa755145ad1263520 P b14c751392954bcab3c99a6835c1fce1: Bootstrap starting.
I20260808 14:33:43.392247 14334 tablet_bootstrap.cc:492] T 101b42a834ce443aa755145ad1263520 P b3cf3b7012f54519b619bcdddcae37a8: Bootstrap starting.
I20260808 14:33:43.392485 14369 ts_tablet_manager.cc:1918] T f5fe1ad088f5425f9275d30bb9bd8ee3 P efaada18707647cb97341022f4c66117: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:33:43.392585 14369 log.cc:1196] T f5fe1ad088f5425f9275d30bb9bd8ee3 P efaada18707647cb97341022f4c66117: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-1/wal/wals/f5fe1ad088f5425f9275d30bb9bd8ee3
I20260808 14:33:43.392786 14335 tablet_bootstrap.cc:654] T 101b42a834ce443aa755145ad1263520 P b14c751392954bcab3c99a6835c1fce1: Neither blocks nor log segments found. Creating new log.
I20260808 14:33:43.392843 13966 tablet_service.cc:1467] Processing CreateTablet for tablet 101b42a834ce443aa755145ad1263520 (DEFAULT_TABLE table=test-table [id=c60b0b0ec6804319be9bafaea5f804ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:33:43.392988 14369 ts_tablet_manager.cc:1939] T f5fe1ad088f5425f9275d30bb9bd8ee3 P efaada18707647cb97341022f4c66117: Deleting consensus metadata
I20260808 14:33:43.393119 13966 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 101b42a834ce443aa755145ad1263520. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:33:43.393298 14334 tablet_bootstrap.cc:654] T 101b42a834ce443aa755145ad1263520 P b3cf3b7012f54519b619bcdddcae37a8: Neither blocks nor log segments found. Creating new log.
I20260808 14:33:43.394902 13523 catalog_manager.cc:4841] TS efaada18707647cb97341022f4c66117 (127.11.131.194:45617): tablet f5fe1ad088f5425f9275d30bb9bd8ee3 (table test-table [id=80829b2ca4a84037a9a742f7bdd15b2d]) successfully deleted
I20260808 14:33:43.395629 14336 tablet_bootstrap.cc:492] T 101b42a834ce443aa755145ad1263520 P efaada18707647cb97341022f4c66117: Bootstrap starting.
I20260808 14:33:43.395730 14368 tablet_replica.cc:330] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b3cf3b7012f54519b619bcdddcae37a8: stopping tablet replica
I20260808 14:33:43.396078 14368 raft_consensus.cc:2229] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b3cf3b7012f54519b619bcdddcae37a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:33:43.396404 14368 raft_consensus.cc:2258] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b3cf3b7012f54519b619bcdddcae37a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:33:43.396659 14336 tablet_bootstrap.cc:654] T 101b42a834ce443aa755145ad1263520 P efaada18707647cb97341022f4c66117: Neither blocks nor log segments found. Creating new log.
I20260808 14:33:43.396657 14366 ts_tablet_manager.cc:1918] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b14c751392954bcab3c99a6835c1fce1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:33:43.396759 14366 log.cc:1196] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b14c751392954bcab3c99a6835c1fce1: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-0/wal/wals/f5fe1ad088f5425f9275d30bb9bd8ee3
I20260808 14:33:43.397109 14366 ts_tablet_manager.cc:1939] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b14c751392954bcab3c99a6835c1fce1: Deleting consensus metadata
I20260808 14:33:43.398002 14336 tablet_bootstrap.cc:492] T 101b42a834ce443aa755145ad1263520 P efaada18707647cb97341022f4c66117: No bootstrap required, opened a new log
I20260808 14:33:43.398109 14336 ts_tablet_manager.cc:1397] T 101b42a834ce443aa755145ad1263520 P efaada18707647cb97341022f4c66117: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 14:33:43.398277 13524 catalog_manager.cc:4841] TS b14c751392954bcab3c99a6835c1fce1 (127.11.131.193:40849): tablet f5fe1ad088f5425f9275d30bb9bd8ee3 (table test-table [id=80829b2ca4a84037a9a742f7bdd15b2d]) successfully deleted
I20260808 14:33:43.398595 14336 raft_consensus.cc:348] T 101b42a834ce443aa755145ad1263520 P efaada18707647cb97341022f4c66117 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14c751392954bcab3c99a6835c1fce1" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 40849 } } peers { permanent_uuid: "efaada18707647cb97341022f4c66117" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 45617 } } peers { permanent_uuid: "b3cf3b7012f54519b619bcdddcae37a8" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 43509 } }
I20260808 14:33:43.398736 14336 raft_consensus.cc:374] T 101b42a834ce443aa755145ad1263520 P efaada18707647cb97341022f4c66117 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:33:43.398769 14336 raft_consensus.cc:729] T 101b42a834ce443aa755145ad1263520 P efaada18707647cb97341022f4c66117 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efaada18707647cb97341022f4c66117, State: Initialized, Role: FOLLOWER
I20260808 14:33:43.398906 14336 consensus_queue.cc:260] T 101b42a834ce443aa755145ad1263520 P efaada18707647cb97341022f4c66117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14c751392954bcab3c99a6835c1fce1" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 40849 } } peers { permanent_uuid: "efaada18707647cb97341022f4c66117" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 45617 } } peers { permanent_uuid: "b3cf3b7012f54519b619bcdddcae37a8" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 43509 } }
I20260808 14:33:43.399240 14336 ts_tablet_manager.cc:1428] T 101b42a834ce443aa755145ad1263520 P efaada18707647cb97341022f4c66117: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:33:43.399667 14368 ts_tablet_manager.cc:1905] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b3cf3b7012f54519b619bcdddcae37a8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:33:43.402279 14368 ts_tablet_manager.cc:1918] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b3cf3b7012f54519b619bcdddcae37a8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:33:43.402390 14368 log.cc:1196] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b3cf3b7012f54519b619bcdddcae37a8: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-2/wal/wals/f5fe1ad088f5425f9275d30bb9bd8ee3
I20260808 14:33:43.402737 14368 ts_tablet_manager.cc:1939] T f5fe1ad088f5425f9275d30bb9bd8ee3 P b3cf3b7012f54519b619bcdddcae37a8: Deleting consensus metadata
I20260808 14:33:43.403627 14335 tablet_bootstrap.cc:492] T 101b42a834ce443aa755145ad1263520 P b14c751392954bcab3c99a6835c1fce1: No bootstrap required, opened a new log
I20260808 14:33:43.403728 14335 ts_tablet_manager.cc:1397] T 101b42a834ce443aa755145ad1263520 P b14c751392954bcab3c99a6835c1fce1: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20260808 14:33:43.403743 14334 tablet_bootstrap.cc:492] T 101b42a834ce443aa755145ad1263520 P b3cf3b7012f54519b619bcdddcae37a8: No bootstrap required, opened a new log
I20260808 14:33:43.403836 14334 ts_tablet_manager.cc:1397] T 101b42a834ce443aa755145ad1263520 P b3cf3b7012f54519b619bcdddcae37a8: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20260808 14:33:43.404014 13525 catalog_manager.cc:4841] TS b3cf3b7012f54519b619bcdddcae37a8 (127.11.131.195:43509): tablet f5fe1ad088f5425f9275d30bb9bd8ee3 (table test-table [id=80829b2ca4a84037a9a742f7bdd15b2d]) successfully deleted
I20260808 14:33:43.404261 14334 raft_consensus.cc:348] T 101b42a834ce443aa755145ad1263520 P b3cf3b7012f54519b619bcdddcae37a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14c751392954bcab3c99a6835c1fce1" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 40849 } } peers { permanent_uuid: "efaada18707647cb97341022f4c66117" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 45617 } } peers { permanent_uuid: "b3cf3b7012f54519b619bcdddcae37a8" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 43509 } }
I20260808 14:33:43.404268 14335 raft_consensus.cc:348] T 101b42a834ce443aa755145ad1263520 P b14c751392954bcab3c99a6835c1fce1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14c751392954bcab3c99a6835c1fce1" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 40849 } } peers { permanent_uuid: "efaada18707647cb97341022f4c66117" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 45617 } } peers { permanent_uuid: "b3cf3b7012f54519b619bcdddcae37a8" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 43509 } }
I20260808 14:33:43.404378 14335 raft_consensus.cc:374] T 101b42a834ce443aa755145ad1263520 P b14c751392954bcab3c99a6835c1fce1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:33:43.404378 14334 raft_consensus.cc:374] T 101b42a834ce443aa755145ad1263520 P b3cf3b7012f54519b619bcdddcae37a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:33:43.404413 14334 raft_consensus.cc:729] T 101b42a834ce443aa755145ad1263520 P b3cf3b7012f54519b619bcdddcae37a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3cf3b7012f54519b619bcdddcae37a8, State: Initialized, Role: FOLLOWER
I20260808 14:33:43.404413 14335 raft_consensus.cc:729] T 101b42a834ce443aa755145ad1263520 P b14c751392954bcab3c99a6835c1fce1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b14c751392954bcab3c99a6835c1fce1, State: Initialized, Role: FOLLOWER
I20260808 14:33:43.404547 14334 consensus_queue.cc:260] T 101b42a834ce443aa755145ad1263520 P b3cf3b7012f54519b619bcdddcae37a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14c751392954bcab3c99a6835c1fce1" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 40849 } } peers { permanent_uuid: "efaada18707647cb97341022f4c66117" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 45617 } } peers { permanent_uuid: "b3cf3b7012f54519b619bcdddcae37a8" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 43509 } }
I20260808 14:33:43.404546 14335 consensus_queue.cc:260] T 101b42a834ce443aa755145ad1263520 P b14c751392954bcab3c99a6835c1fce1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14c751392954bcab3c99a6835c1fce1" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 40849 } } peers { permanent_uuid: "efaada18707647cb97341022f4c66117" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 45617 } } peers { permanent_uuid: "b3cf3b7012f54519b619bcdddcae37a8" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 43509 } }
I20260808 14:33:43.404812 14334 ts_tablet_manager.cc:1428] T 101b42a834ce443aa755145ad1263520 P b3cf3b7012f54519b619bcdddcae37a8: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260808 14:33:43.404805 14335 ts_tablet_manager.cc:1428] T 101b42a834ce443aa755145ad1263520 P b14c751392954bcab3c99a6835c1fce1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:33:43.452050 14342 raft_consensus.cc:482] T 101b42a834ce443aa755145ad1263520 P b14c751392954bcab3c99a6835c1fce1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:33:43.452219 14342 raft_consensus.cc:504] T 101b42a834ce443aa755145ad1263520 P b14c751392954bcab3c99a6835c1fce1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14c751392954bcab3c99a6835c1fce1" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 40849 } } peers { permanent_uuid: "efaada18707647cb97341022f4c66117" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 45617 } } peers { permanent_uuid: "b3cf3b7012f54519b619bcdddcae37a8" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 43509 } }
I20260808 14:33:43.452751 14342 leader_election.cc:288] T 101b42a834ce443aa755145ad1263520 P b14c751392954bcab3c99a6835c1fce1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efaada18707647cb97341022f4c66117 (127.11.131.194:45617), b3cf3b7012f54519b619bcdddcae37a8 (127.11.131.195:43509)
I20260808 14:33:43.453230 14018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "101b42a834ce443aa755145ad1263520" candidate_uuid: "b14c751392954bcab3c99a6835c1fce1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efaada18707647cb97341022f4c66117" is_pre_election: true
I20260808 14:33:43.453264 14232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "101b42a834ce443aa755145ad1263520" candidate_uuid: "b14c751392954bcab3c99a6835c1fce1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3cf3b7012f54519b619bcdddcae37a8" is_pre_election: true
I20260808 14:33:43.453418 14018 raft_consensus.cc:2454] T 101b42a834ce443aa755145ad1263520 P efaada18707647cb97341022f4c66117 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b14c751392954bcab3c99a6835c1fce1 in term 0.
I20260808 14:33:43.453435 14232 raft_consensus.cc:2454] T 101b42a834ce443aa755145ad1263520 P b3cf3b7012f54519b619bcdddcae37a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b14c751392954bcab3c99a6835c1fce1 in term 0.
I20260808 14:33:43.453794 13694 leader_election.cc:302] T 101b42a834ce443aa755145ad1263520 P b14c751392954bcab3c99a6835c1fce1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b14c751392954bcab3c99a6835c1fce1, efaada18707647cb97341022f4c66117; no voters:
I20260808 14:33:43.454022 14342 raft_consensus.cc:2781] T 101b42a834ce443aa755145ad1263520 P b14c751392954bcab3c99a6835c1fce1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:33:43.454082 14342 raft_consensus.cc:482] T 101b42a834ce443aa755145ad1263520 P b14c751392954bcab3c99a6835c1fce1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:33:43.454108 14342 raft_consensus.cc:3037] T 101b42a834ce443aa755145ad1263520 P b14c751392954bcab3c99a6835c1fce1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:33:43.455456 14342 raft_consensus.cc:504] T 101b42a834ce443aa755145ad1263520 P b14c751392954bcab3c99a6835c1fce1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14c751392954bcab3c99a6835c1fce1" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 40849 } } peers { permanent_uuid: "efaada18707647cb97341022f4c66117" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 45617 } } peers { permanent_uuid: "b3cf3b7012f54519b619bcdddcae37a8" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 43509 } }
I20260808 14:33:43.455897 14342 leader_election.cc:288] T 101b42a834ce443aa755145ad1263520 P b14c751392954bcab3c99a6835c1fce1 [CANDIDATE]: Term 1 election: Requested vote from peers efaada18707647cb97341022f4c66117 (127.11.131.194:45617), b3cf3b7012f54519b619bcdddcae37a8 (127.11.131.195:43509)
I20260808 14:33:43.456355 14018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "101b42a834ce443aa755145ad1263520" candidate_uuid: "b14c751392954bcab3c99a6835c1fce1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efaada18707647cb97341022f4c66117"
I20260808 14:33:43.456354 14232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "101b42a834ce443aa755145ad1263520" candidate_uuid: "b14c751392954bcab3c99a6835c1fce1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3cf3b7012f54519b619bcdddcae37a8"
I20260808 14:33:43.456487 14018 raft_consensus.cc:3037] T 101b42a834ce443aa755145ad1263520 P efaada18707647cb97341022f4c66117 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:33:43.456488 14232 raft_consensus.cc:3037] T 101b42a834ce443aa755145ad1263520 P b3cf3b7012f54519b619bcdddcae37a8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:33:43.457574 14018 raft_consensus.cc:2454] T 101b42a834ce443aa755145ad1263520 P efaada18707647cb97341022f4c66117 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b14c751392954bcab3c99a6835c1fce1 in term 1.
I20260808 14:33:43.457762 14232 raft_consensus.cc:2454] T 101b42a834ce443aa755145ad1263520 P b3cf3b7012f54519b619bcdddcae37a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b14c751392954bcab3c99a6835c1fce1 in term 1.
I20260808 14:33:43.457880 13694 leader_election.cc:302] T 101b42a834ce443aa755145ad1263520 P b14c751392954bcab3c99a6835c1fce1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b14c751392954bcab3c99a6835c1fce1, efaada18707647cb97341022f4c66117; no voters:
I20260808 14:33:43.458037 14342 raft_consensus.cc:2781] T 101b42a834ce443aa755145ad1263520 P b14c751392954bcab3c99a6835c1fce1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:33:43.458216 14342 raft_consensus.cc:686] T 101b42a834ce443aa755145ad1263520 P b14c751392954bcab3c99a6835c1fce1 [term 1 LEADER]: Becoming Leader. State: Replica: b14c751392954bcab3c99a6835c1fce1, State: Running, Role: LEADER
I20260808 14:33:43.458375 14342 consensus_queue.cc:237] T 101b42a834ce443aa755145ad1263520 P b14c751392954bcab3c99a6835c1fce1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14c751392954bcab3c99a6835c1fce1" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 40849 } } peers { permanent_uuid: "efaada18707647cb97341022f4c66117" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 45617 } } peers { permanent_uuid: "b3cf3b7012f54519b619bcdddcae37a8" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 43509 } }
I20260808 14:33:43.460170 13542 catalog_manager.cc:5495] T 101b42a834ce443aa755145ad1263520 P b14c751392954bcab3c99a6835c1fce1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b14c751392954bcab3c99a6835c1fce1 (127.11.131.193). New cstate: current_term: 1 leader_uuid: "b14c751392954bcab3c99a6835c1fce1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14c751392954bcab3c99a6835c1fce1" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 40849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efaada18707647cb97341022f4c66117" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 45617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3cf3b7012f54519b619bcdddcae37a8" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 43509 } health_report { overall_health: UNKNOWN } } }
Aug 08 14:33:43 dist-test-slave-twwt krb5kdc[13478](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199622, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:33:43.509322 13628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:43.500559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38726 (local address 127.11.131.254:46519)
0808 14:33:43.500699 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:43.500704 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:43.500870 (+ 166us) server_negotiation.cc:407] Connection header received
0808 14:33:43.501034 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:43.501038 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:43.501084 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:43.501173 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:33:43.501880 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:43.502402 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:43.503244 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:43.503458 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:43.503567 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:43.506056 (+ 2489us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:33:43.506060 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:33:43.506062 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:33:43.506082 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:33:43.507566 (+ 1484us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:43.508048 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:43.508052 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:43.508054 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:43.508134 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:43.508413 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:43.508417 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:43.508419 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:43.508598 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:33:43.508707 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:43.509004 (+ 297us) server_negotiation.cc:299] Negotiation successful
0808 14:33:43.509193 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":110,"server-negotiator.queue_time_us":44}
I20260808 14:33:43.509332 14385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:43.500492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:46519 (local address 127.0.0.1:38726)
0808 14:33:43.500778 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:43.500790 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:43.500938 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:43.501203 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:43.501206 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:43.501628 (+ 422us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:33:43.501756 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:43.501762 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:43.502512 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:43.502517 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:43.503126 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:43.503134 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:43.503575 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:43.503578 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:43.503684 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:43.504415 (+ 731us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:33:43.504427 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:33:43.505911 (+ 1484us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:33:43.507675 (+ 1764us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:43.507687 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:43.507695 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:43.507947 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:43.508227 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:43.508231 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:43.508233 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:43.508318 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:43.508707 (+ 389us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:33:43.508715 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:33:43.508836 (+ 121us) client_negotiation.cc:769] Sending connection context
0808 14:33:43.508955 (+ 119us) client_negotiation.cc:240] Negotiation successful
0808 14:33:43.509124 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"mutex_wait_us":3,"thread_start_us":108,"threads_started":1}
I20260808 14:33:43.514256 13542 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:38726:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 14:33:43.515159 13542 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:33:43.520530 13776 tablet_service.cc:1467] Processing CreateTablet for tablet 721ab2fbf922465f8f502ce2e6ac6ea8 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f4bef5fd2fa34c14b2dbe7eea09b95ca]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 14:33:43.520736 13966 tablet_service.cc:1467] Processing CreateTablet for tablet 721ab2fbf922465f8f502ce2e6ac6ea8 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f4bef5fd2fa34c14b2dbe7eea09b95ca]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 14:33:43.521080 13776 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 721ab2fbf922465f8f502ce2e6ac6ea8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:33:43.521193 13966 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 721ab2fbf922465f8f502ce2e6ac6ea8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:33:43.523105 14201 tablet_service.cc:1467] Processing CreateTablet for tablet 721ab2fbf922465f8f502ce2e6ac6ea8 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=f4bef5fd2fa34c14b2dbe7eea09b95ca]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 14:33:43.523525 14201 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 721ab2fbf922465f8f502ce2e6ac6ea8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:33:43.524107 14335 tablet_bootstrap.cc:492] T 721ab2fbf922465f8f502ce2e6ac6ea8 P b14c751392954bcab3c99a6835c1fce1: Bootstrap starting.
I20260808 14:33:43.524276 14336 tablet_bootstrap.cc:492] T 721ab2fbf922465f8f502ce2e6ac6ea8 P efaada18707647cb97341022f4c66117: Bootstrap starting.
I20260808 14:33:43.525367 14336 tablet_bootstrap.cc:654] T 721ab2fbf922465f8f502ce2e6ac6ea8 P efaada18707647cb97341022f4c66117: Neither blocks nor log segments found. Creating new log.
I20260808 14:33:43.525441 14335 tablet_bootstrap.cc:654] T 721ab2fbf922465f8f502ce2e6ac6ea8 P b14c751392954bcab3c99a6835c1fce1: Neither blocks nor log segments found. Creating new log.
I20260808 14:33:43.527096 14336 tablet_bootstrap.cc:492] T 721ab2fbf922465f8f502ce2e6ac6ea8 P efaada18707647cb97341022f4c66117: No bootstrap required, opened a new log
I20260808 14:33:43.527135 14335 tablet_bootstrap.cc:492] T 721ab2fbf922465f8f502ce2e6ac6ea8 P b14c751392954bcab3c99a6835c1fce1: No bootstrap required, opened a new log
I20260808 14:33:43.527184 14336 ts_tablet_manager.cc:1397] T 721ab2fbf922465f8f502ce2e6ac6ea8 P efaada18707647cb97341022f4c66117: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 14:33:43.527241 14335 ts_tablet_manager.cc:1397] T 721ab2fbf922465f8f502ce2e6ac6ea8 P b14c751392954bcab3c99a6835c1fce1: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 14:33:43.527634 14336 raft_consensus.cc:348] T 721ab2fbf922465f8f502ce2e6ac6ea8 P efaada18707647cb97341022f4c66117 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14c751392954bcab3c99a6835c1fce1" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 40849 } } peers { permanent_uuid: "efaada18707647cb97341022f4c66117" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 45617 } } peers { permanent_uuid: "b3cf3b7012f54519b619bcdddcae37a8" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 43509 } }
I20260808 14:33:43.527752 14336 raft_consensus.cc:374] T 721ab2fbf922465f8f502ce2e6ac6ea8 P efaada18707647cb97341022f4c66117 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:33:43.527789 14336 raft_consensus.cc:729] T 721ab2fbf922465f8f502ce2e6ac6ea8 P efaada18707647cb97341022f4c66117 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efaada18707647cb97341022f4c66117, State: Initialized, Role: FOLLOWER
I20260808 14:33:43.527740 14335 raft_consensus.cc:348] T 721ab2fbf922465f8f502ce2e6ac6ea8 P b14c751392954bcab3c99a6835c1fce1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14c751392954bcab3c99a6835c1fce1" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 40849 } } peers { permanent_uuid: "efaada18707647cb97341022f4c66117" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 45617 } } peers { permanent_uuid: "b3cf3b7012f54519b619bcdddcae37a8" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 43509 } }
I20260808 14:33:43.527872 14335 raft_consensus.cc:374] T 721ab2fbf922465f8f502ce2e6ac6ea8 P b14c751392954bcab3c99a6835c1fce1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:33:43.527910 14335 raft_consensus.cc:729] T 721ab2fbf922465f8f502ce2e6ac6ea8 P b14c751392954bcab3c99a6835c1fce1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b14c751392954bcab3c99a6835c1fce1, State: Initialized, Role: FOLLOWER
I20260808 14:33:43.527908 14336 consensus_queue.cc:260] T 721ab2fbf922465f8f502ce2e6ac6ea8 P efaada18707647cb97341022f4c66117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14c751392954bcab3c99a6835c1fce1" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 40849 } } peers { permanent_uuid: "efaada18707647cb97341022f4c66117" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 45617 } } peers { permanent_uuid: "b3cf3b7012f54519b619bcdddcae37a8" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 43509 } }
I20260808 14:33:43.528043 14335 consensus_queue.cc:260] T 721ab2fbf922465f8f502ce2e6ac6ea8 P b14c751392954bcab3c99a6835c1fce1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14c751392954bcab3c99a6835c1fce1" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 40849 } } peers { permanent_uuid: "efaada18707647cb97341022f4c66117" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 45617 } } peers { permanent_uuid: "b3cf3b7012f54519b619bcdddcae37a8" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 43509 } }
I20260808 14:33:43.528149 14336 ts_tablet_manager.cc:1428] T 721ab2fbf922465f8f502ce2e6ac6ea8 P efaada18707647cb97341022f4c66117: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:33:43.528190 14334 tablet_bootstrap.cc:492] T 721ab2fbf922465f8f502ce2e6ac6ea8 P b3cf3b7012f54519b619bcdddcae37a8: Bootstrap starting.
I20260808 14:33:43.528321 14335 ts_tablet_manager.cc:1428] T 721ab2fbf922465f8f502ce2e6ac6ea8 P b14c751392954bcab3c99a6835c1fce1: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260808 14:33:43.528673 14344 tablet_replica.cc:439] T 721ab2fbf922465f8f502ce2e6ac6ea8 P efaada18707647cb97341022f4c66117: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14c751392954bcab3c99a6835c1fce1" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 40849 } } peers { permanent_uuid: "efaada18707647cb97341022f4c66117" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 45617 } } peers { permanent_uuid: "b3cf3b7012f54519b619bcdddcae37a8" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 43509 } } }
I20260808 14:33:43.528862 14344 tablet_replica.cc:442] T 721ab2fbf922465f8f502ce2e6ac6ea8 P efaada18707647cb97341022f4c66117: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:33:43.529068 14342 tablet_replica.cc:439] T 721ab2fbf922465f8f502ce2e6ac6ea8 P b14c751392954bcab3c99a6835c1fce1: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14c751392954bcab3c99a6835c1fce1" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 40849 } } peers { permanent_uuid: "efaada18707647cb97341022f4c66117" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 45617 } } peers { permanent_uuid: "b3cf3b7012f54519b619bcdddcae37a8" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 43509 } } }
I20260808 14:33:43.529214 14342 tablet_replica.cc:442] T 721ab2fbf922465f8f502ce2e6ac6ea8 P b14c751392954bcab3c99a6835c1fce1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:33:43.529289 14334 tablet_bootstrap.cc:654] T 721ab2fbf922465f8f502ce2e6ac6ea8 P b3cf3b7012f54519b619bcdddcae37a8: Neither blocks nor log segments found. Creating new log.
I20260808 14:33:43.530889 14334 tablet_bootstrap.cc:492] T 721ab2fbf922465f8f502ce2e6ac6ea8 P b3cf3b7012f54519b619bcdddcae37a8: No bootstrap required, opened a new log
I20260808 14:33:43.530989 14334 ts_tablet_manager.cc:1397] T 721ab2fbf922465f8f502ce2e6ac6ea8 P b3cf3b7012f54519b619bcdddcae37a8: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 14:33:43.531505 14334 raft_consensus.cc:348] T 721ab2fbf922465f8f502ce2e6ac6ea8 P b3cf3b7012f54519b619bcdddcae37a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14c751392954bcab3c99a6835c1fce1" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 40849 } } peers { permanent_uuid: "efaada18707647cb97341022f4c66117" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 45617 } } peers { permanent_uuid: "b3cf3b7012f54519b619bcdddcae37a8" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 43509 } }
I20260808 14:33:43.531627 14334 raft_consensus.cc:374] T 721ab2fbf922465f8f502ce2e6ac6ea8 P b3cf3b7012f54519b619bcdddcae37a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:33:43.531674 14334 raft_consensus.cc:729] T 721ab2fbf922465f8f502ce2e6ac6ea8 P b3cf3b7012f54519b619bcdddcae37a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3cf3b7012f54519b619bcdddcae37a8, State: Initialized, Role: FOLLOWER
I20260808 14:33:43.531844 14334 consensus_queue.cc:260] T 721ab2fbf922465f8f502ce2e6ac6ea8 P b3cf3b7012f54519b619bcdddcae37a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14c751392954bcab3c99a6835c1fce1" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 40849 } } peers { permanent_uuid: "efaada18707647cb97341022f4c66117" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 45617 } } peers { permanent_uuid: "b3cf3b7012f54519b619bcdddcae37a8" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 43509 } }
I20260808 14:33:43.532145 14334 ts_tablet_manager.cc:1428] T 721ab2fbf922465f8f502ce2e6ac6ea8 P b3cf3b7012f54519b619bcdddcae37a8: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260808 14:33:43.532095 14341 tablet_replica.cc:439] T 721ab2fbf922465f8f502ce2e6ac6ea8 P b3cf3b7012f54519b619bcdddcae37a8: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14c751392954bcab3c99a6835c1fce1" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 40849 } } peers { permanent_uuid: "efaada18707647cb97341022f4c66117" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 45617 } } peers { permanent_uuid: "b3cf3b7012f54519b619bcdddcae37a8" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 43509 } } }
I20260808 14:33:43.532276 14341 tablet_replica.cc:442] T 721ab2fbf922465f8f502ce2e6ac6ea8 P b3cf3b7012f54519b619bcdddcae37a8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:33:43.618055 14342 raft_consensus.cc:482] T 721ab2fbf922465f8f502ce2e6ac6ea8 P b14c751392954bcab3c99a6835c1fce1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:33:43.618230 14342 raft_consensus.cc:504] T 721ab2fbf922465f8f502ce2e6ac6ea8 P b14c751392954bcab3c99a6835c1fce1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14c751392954bcab3c99a6835c1fce1" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 40849 } } peers { permanent_uuid: "efaada18707647cb97341022f4c66117" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 45617 } } peers { permanent_uuid: "b3cf3b7012f54519b619bcdddcae37a8" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 43509 } }
I20260808 14:33:43.618752 14342 leader_election.cc:288] T 721ab2fbf922465f8f502ce2e6ac6ea8 P b14c751392954bcab3c99a6835c1fce1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efaada18707647cb97341022f4c66117 (127.11.131.194:45617), b3cf3b7012f54519b619bcdddcae37a8 (127.11.131.195:43509)
I20260808 14:33:43.619244 14018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "721ab2fbf922465f8f502ce2e6ac6ea8" candidate_uuid: "b14c751392954bcab3c99a6835c1fce1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efaada18707647cb97341022f4c66117" is_pre_election: true
I20260808 14:33:43.619263 14232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "721ab2fbf922465f8f502ce2e6ac6ea8" candidate_uuid: "b14c751392954bcab3c99a6835c1fce1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3cf3b7012f54519b619bcdddcae37a8" is_pre_election: true
I20260808 14:33:43.619436 14232 raft_consensus.cc:2454] T 721ab2fbf922465f8f502ce2e6ac6ea8 P b3cf3b7012f54519b619bcdddcae37a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b14c751392954bcab3c99a6835c1fce1 in term 0.
I20260808 14:33:43.619445 14018 raft_consensus.cc:2454] T 721ab2fbf922465f8f502ce2e6ac6ea8 P efaada18707647cb97341022f4c66117 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b14c751392954bcab3c99a6835c1fce1 in term 0.
I20260808 14:33:43.619793 13696 leader_election.cc:302] T 721ab2fbf922465f8f502ce2e6ac6ea8 P b14c751392954bcab3c99a6835c1fce1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: b14c751392954bcab3c99a6835c1fce1, b3cf3b7012f54519b619bcdddcae37a8, efaada18707647cb97341022f4c66117; no voters:
I20260808 14:33:43.620026 14342 raft_consensus.cc:2781] T 721ab2fbf922465f8f502ce2e6ac6ea8 P b14c751392954bcab3c99a6835c1fce1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:33:43.620090 14342 raft_consensus.cc:482] T 721ab2fbf922465f8f502ce2e6ac6ea8 P b14c751392954bcab3c99a6835c1fce1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:33:43.620127 14342 raft_consensus.cc:3037] T 721ab2fbf922465f8f502ce2e6ac6ea8 P b14c751392954bcab3c99a6835c1fce1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:33:43.621255 14342 raft_consensus.cc:504] T 721ab2fbf922465f8f502ce2e6ac6ea8 P b14c751392954bcab3c99a6835c1fce1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14c751392954bcab3c99a6835c1fce1" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 40849 } } peers { permanent_uuid: "efaada18707647cb97341022f4c66117" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 45617 } } peers { permanent_uuid: "b3cf3b7012f54519b619bcdddcae37a8" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 43509 } }
I20260808 14:33:43.621573 14342 leader_election.cc:288] T 721ab2fbf922465f8f502ce2e6ac6ea8 P b14c751392954bcab3c99a6835c1fce1 [CANDIDATE]: Term 1 election: Requested vote from peers efaada18707647cb97341022f4c66117 (127.11.131.194:45617), b3cf3b7012f54519b619bcdddcae37a8 (127.11.131.195:43509)
I20260808 14:33:43.621978 14232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "721ab2fbf922465f8f502ce2e6ac6ea8" candidate_uuid: "b14c751392954bcab3c99a6835c1fce1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3cf3b7012f54519b619bcdddcae37a8"
I20260808 14:33:43.622020 14018 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "721ab2fbf922465f8f502ce2e6ac6ea8" candidate_uuid: "b14c751392954bcab3c99a6835c1fce1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efaada18707647cb97341022f4c66117"
I20260808 14:33:43.622120 14018 raft_consensus.cc:3037] T 721ab2fbf922465f8f502ce2e6ac6ea8 P efaada18707647cb97341022f4c66117 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:33:43.622120 14232 raft_consensus.cc:3037] T 721ab2fbf922465f8f502ce2e6ac6ea8 P b3cf3b7012f54519b619bcdddcae37a8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:33:43.623253 14018 raft_consensus.cc:2454] T 721ab2fbf922465f8f502ce2e6ac6ea8 P efaada18707647cb97341022f4c66117 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b14c751392954bcab3c99a6835c1fce1 in term 1.
I20260808 14:33:43.623255 14232 raft_consensus.cc:2454] T 721ab2fbf922465f8f502ce2e6ac6ea8 P b3cf3b7012f54519b619bcdddcae37a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b14c751392954bcab3c99a6835c1fce1 in term 1.
I20260808 14:33:43.623581 13694 leader_election.cc:302] T 721ab2fbf922465f8f502ce2e6ac6ea8 P b14c751392954bcab3c99a6835c1fce1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b14c751392954bcab3c99a6835c1fce1, efaada18707647cb97341022f4c66117; no voters:
I20260808 14:33:43.623749 14342 raft_consensus.cc:2781] T 721ab2fbf922465f8f502ce2e6ac6ea8 P b14c751392954bcab3c99a6835c1fce1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:33:43.623849 14342 raft_consensus.cc:686] T 721ab2fbf922465f8f502ce2e6ac6ea8 P b14c751392954bcab3c99a6835c1fce1 [term 1 LEADER]: Becoming Leader. State: Replica: b14c751392954bcab3c99a6835c1fce1, State: Running, Role: LEADER
I20260808 14:33:43.623991 14342 consensus_queue.cc:237] T 721ab2fbf922465f8f502ce2e6ac6ea8 P b14c751392954bcab3c99a6835c1fce1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14c751392954bcab3c99a6835c1fce1" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 40849 } } peers { permanent_uuid: "efaada18707647cb97341022f4c66117" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 45617 } } peers { permanent_uuid: "b3cf3b7012f54519b619bcdddcae37a8" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 43509 } }
I20260808 14:33:43.624662 14342 tablet_replica.cc:439] T 721ab2fbf922465f8f502ce2e6ac6ea8 P b14c751392954bcab3c99a6835c1fce1: TxnStatusTablet state changed. Reason: New leader b14c751392954bcab3c99a6835c1fce1. Latest consensus state: current_term: 1 leader_uuid: "b14c751392954bcab3c99a6835c1fce1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14c751392954bcab3c99a6835c1fce1" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 40849 } } peers { permanent_uuid: "efaada18707647cb97341022f4c66117" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 45617 } } peers { permanent_uuid: "b3cf3b7012f54519b619bcdddcae37a8" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 43509 } } }
I20260808 14:33:43.624768 14342 tablet_replica.cc:442] T 721ab2fbf922465f8f502ce2e6ac6ea8 P b14c751392954bcab3c99a6835c1fce1: This TxnStatusTablet replica's current role is: LEADER
I20260808 14:33:43.625147 14390 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 14:33:43.625396 14390 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 14:33:43.625970 13542 catalog_manager.cc:5495] T 721ab2fbf922465f8f502ce2e6ac6ea8 P b14c751392954bcab3c99a6835c1fce1 reported cstate change: term changed from 0 to 1, leader changed from <none> to b14c751392954bcab3c99a6835c1fce1 (127.11.131.193). New cstate: current_term: 1 leader_uuid: "b14c751392954bcab3c99a6835c1fce1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14c751392954bcab3c99a6835c1fce1" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 40849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efaada18707647cb97341022f4c66117" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 45617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3cf3b7012f54519b619bcdddcae37a8" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 43509 } health_report { overall_health: UNKNOWN } } }
I20260808 14:33:43.662569 14385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:43.658480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:40849 (local address 127.0.0.1:54758)
0808 14:33:43.658709 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:43.658725 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:43.658839 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:43.659238 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:43.659242 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:43.659251 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:33:43.659373 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:43.659379 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:43.660101 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:43.660104 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:43.661062 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:43.661072 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:43.661557 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:43.661561 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:43.661655 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:43.661716 (+ 61us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:33:43.662131 (+ 415us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:33:43.662154 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 14:33:43.662233 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 14:33:43.662358 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":80}
I20260808 14:33:43.662585 14333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:43.658632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54758 (local address 127.11.131.193:40849)
0808 14:33:43.659015 (+ 383us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:43.659018 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:43.659030 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:33:43.659077 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:43.659079 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:43.659121 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:43.659179 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:33:43.659493 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:43.659997 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:43.661206 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:43.661437 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:43.661527 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:43.661893 (+ 366us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:33:43.661997 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:33:43.662081 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:43.662282 (+ 201us) server_negotiation.cc:299] Negotiation successful
0808 14:33:43.662370 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":294}
I20260808 14:33:43.665614 14018 raft_consensus.cc:1261] T 721ab2fbf922465f8f502ce2e6ac6ea8 P efaada18707647cb97341022f4c66117 [term 1 FOLLOWER]: Refusing update from remote peer b14c751392954bcab3c99a6835c1fce1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:33:43.665614 14232 raft_consensus.cc:1261] T 721ab2fbf922465f8f502ce2e6ac6ea8 P b3cf3b7012f54519b619bcdddcae37a8 [term 1 FOLLOWER]: Refusing update from remote peer b14c751392954bcab3c99a6835c1fce1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:33:43.666097 14349 consensus_queue.cc:1035] T 721ab2fbf922465f8f502ce2e6ac6ea8 P b14c751392954bcab3c99a6835c1fce1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3cf3b7012f54519b619bcdddcae37a8" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 43509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:33:43.666323 14342 consensus_queue.cc:1035] T 721ab2fbf922465f8f502ce2e6ac6ea8 P b14c751392954bcab3c99a6835c1fce1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efaada18707647cb97341022f4c66117" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 45617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:33:43.669068 14344 tablet_replica.cc:439] T 721ab2fbf922465f8f502ce2e6ac6ea8 P efaada18707647cb97341022f4c66117: TxnStatusTablet state changed. Reason: New leader b14c751392954bcab3c99a6835c1fce1. Latest consensus state: current_term: 1 leader_uuid: "b14c751392954bcab3c99a6835c1fce1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14c751392954bcab3c99a6835c1fce1" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 40849 } } peers { permanent_uuid: "efaada18707647cb97341022f4c66117" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 45617 } } peers { permanent_uuid: "b3cf3b7012f54519b619bcdddcae37a8" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 43509 } } }
I20260808 14:33:43.669203 14344 tablet_replica.cc:442] T 721ab2fbf922465f8f502ce2e6ac6ea8 P efaada18707647cb97341022f4c66117: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:33:43.669150 14341 tablet_replica.cc:439] T 721ab2fbf922465f8f502ce2e6ac6ea8 P b3cf3b7012f54519b619bcdddcae37a8: TxnStatusTablet state changed. Reason: New leader b14c751392954bcab3c99a6835c1fce1. Latest consensus state: current_term: 1 leader_uuid: "b14c751392954bcab3c99a6835c1fce1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14c751392954bcab3c99a6835c1fce1" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 40849 } } peers { permanent_uuid: "efaada18707647cb97341022f4c66117" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 45617 } } peers { permanent_uuid: "b3cf3b7012f54519b619bcdddcae37a8" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 43509 } } }
I20260808 14:33:43.669255 14341 tablet_replica.cc:442] T 721ab2fbf922465f8f502ce2e6ac6ea8 P b3cf3b7012f54519b619bcdddcae37a8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:33:43.669682 14341 tablet_replica.cc:439] T 721ab2fbf922465f8f502ce2e6ac6ea8 P b3cf3b7012f54519b619bcdddcae37a8: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b14c751392954bcab3c99a6835c1fce1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14c751392954bcab3c99a6835c1fce1" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 40849 } } peers { permanent_uuid: "efaada18707647cb97341022f4c66117" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 45617 } } peers { permanent_uuid: "b3cf3b7012f54519b619bcdddcae37a8" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 43509 } } }
I20260808 14:33:43.669793 14341 tablet_replica.cc:442] T 721ab2fbf922465f8f502ce2e6ac6ea8 P b3cf3b7012f54519b619bcdddcae37a8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:33:43.671936 14342 tablet_replica.cc:439] T 721ab2fbf922465f8f502ce2e6ac6ea8 P b14c751392954bcab3c99a6835c1fce1: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b14c751392954bcab3c99a6835c1fce1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14c751392954bcab3c99a6835c1fce1" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 40849 } } peers { permanent_uuid: "efaada18707647cb97341022f4c66117" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 45617 } } peers { permanent_uuid: "b3cf3b7012f54519b619bcdddcae37a8" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 43509 } } }
I20260808 14:33:43.672111 14342 tablet_replica.cc:442] T 721ab2fbf922465f8f502ce2e6ac6ea8 P b14c751392954bcab3c99a6835c1fce1: This TxnStatusTablet replica's current role is: LEADER
I20260808 14:33:43.672271 14342 tablet_replica.cc:439] T 721ab2fbf922465f8f502ce2e6ac6ea8 P b14c751392954bcab3c99a6835c1fce1: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b14c751392954bcab3c99a6835c1fce1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14c751392954bcab3c99a6835c1fce1" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 40849 } } peers { permanent_uuid: "efaada18707647cb97341022f4c66117" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 45617 } } peers { permanent_uuid: "b3cf3b7012f54519b619bcdddcae37a8" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 43509 } } }
I20260808 14:33:43.672439 14342 tablet_replica.cc:442] T 721ab2fbf922465f8f502ce2e6ac6ea8 P b14c751392954bcab3c99a6835c1fce1: This TxnStatusTablet replica's current role is: LEADER
I20260808 14:33:43.672940 14344 tablet_replica.cc:439] T 721ab2fbf922465f8f502ce2e6ac6ea8 P efaada18707647cb97341022f4c66117: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b14c751392954bcab3c99a6835c1fce1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b14c751392954bcab3c99a6835c1fce1" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 40849 } } peers { permanent_uuid: "efaada18707647cb97341022f4c66117" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 45617 } } peers { permanent_uuid: "b3cf3b7012f54519b619bcdddcae37a8" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 43509 } } }
I20260808 14:33:43.673079 14344 tablet_replica.cc:442] T 721ab2fbf922465f8f502ce2e6ac6ea8 P efaada18707647cb97341022f4c66117: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:33:43.687027 14405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:43.683551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:40849 (local address 127.11.131.193:44327)
0808 14:33:43.683855 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:43.683875 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:43.684005 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:43.684290 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:43.684293 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:43.684300 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:33:43.684435 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:43.684442 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:43.685159 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:43.685165 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:43.685790 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:43.685798 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:43.686248 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:43.686251 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:43.686343 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:43.686394 (+ 51us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:33:43.686753 (+ 359us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:33:43.686761 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 14:33:43.686822 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 14:33:43.686907 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":212,"mutex_wait_us":6,"thread_start_us":102,"threads_started":1}
I20260808 14:33:43.687027 14333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:43.683636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:44327 (local address 127.11.131.193:40849)
0808 14:33:43.683772 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:43.683776 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:43.683956 (+ 180us) server_negotiation.cc:407] Connection header received
0808 14:33:43.684120 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:43.684124 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:43.684179 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:43.684281 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:33:43.684555 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:43.685050 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:43.685919 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:43.686129 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:43.686246 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:43.686536 (+ 290us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:33:43.686647 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:33:43.686739 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:43.686831 (+ 92us) server_negotiation.cc:299] Negotiation successful
0808 14:33:43.686879 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":41,"server-negotiator.queue_time_us":50}
I20260808 14:33:43.694311 14018 raft_consensus.cc:1261] T 101b42a834ce443aa755145ad1263520 P efaada18707647cb97341022f4c66117 [term 1 FOLLOWER]: Refusing update from remote peer b14c751392954bcab3c99a6835c1fce1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:33:43.694306 14232 raft_consensus.cc:1261] T 101b42a834ce443aa755145ad1263520 P b3cf3b7012f54519b619bcdddcae37a8 [term 1 FOLLOWER]: Refusing update from remote peer b14c751392954bcab3c99a6835c1fce1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:33:43.694808 14398 consensus_queue.cc:1035] T 101b42a834ce443aa755145ad1263520 P b14c751392954bcab3c99a6835c1fce1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3cf3b7012f54519b619bcdddcae37a8" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 43509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:33:43.695070 14399 consensus_queue.cc:1035] T 101b42a834ce443aa755145ad1263520 P b14c751392954bcab3c99a6835c1fce1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efaada18707647cb97341022f4c66117" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 45617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:33:43.736176 13540 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38722:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:33:43.736356 13540 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38722:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:33:43.738509 13540 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5b7dee87e10f4dd68a92d6040a5b8428: Sending DeleteTablet for 3 replicas of tablet 101b42a834ce443aa755145ad1263520
I20260808 14:33:43.739205 13966 tablet_service.cc:1514] Processing DeleteTablet for tablet 101b42a834ce443aa755145ad1263520 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:33:43 UTC) from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:47796
I20260808 14:33:43.739262 14201 tablet_service.cc:1514] Processing DeleteTablet for tablet 101b42a834ce443aa755145ad1263520 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:33:43 UTC) from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:44542
I20260808 14:33:43.739261 13773 tablet_service.cc:1514] Processing DeleteTablet for tablet 101b42a834ce443aa755145ad1263520 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:33:43 UTC) from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:54740
I20260808 14:33:43.739403 14369 tablet_replica.cc:330] T 101b42a834ce443aa755145ad1263520 P efaada18707647cb97341022f4c66117: stopping tablet replica
I20260808 14:33:43.739468 14368 tablet_replica.cc:330] T 101b42a834ce443aa755145ad1263520 P b3cf3b7012f54519b619bcdddcae37a8: stopping tablet replica
I20260808 14:33:43.739513 14369 raft_consensus.cc:2229] T 101b42a834ce443aa755145ad1263520 P efaada18707647cb97341022f4c66117 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:33:43.739594 14368 raft_consensus.cc:2229] T 101b42a834ce443aa755145ad1263520 P b3cf3b7012f54519b619bcdddcae37a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:33:43.739645 14369 raft_consensus.cc:2258] T 101b42a834ce443aa755145ad1263520 P efaada18707647cb97341022f4c66117 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:33:43.739718 14368 raft_consensus.cc:2258] T 101b42a834ce443aa755145ad1263520 P b3cf3b7012f54519b619bcdddcae37a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:33:43.739907 14366 tablet_replica.cc:330] T 101b42a834ce443aa755145ad1263520 P b14c751392954bcab3c99a6835c1fce1: stopping tablet replica
I20260808 14:33:43.740027 14366 raft_consensus.cc:2229] T 101b42a834ce443aa755145ad1263520 P b14c751392954bcab3c99a6835c1fce1 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:33:43.740211 14366 raft_consensus.cc:2258] T 101b42a834ce443aa755145ad1263520 P b14c751392954bcab3c99a6835c1fce1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:33:43.740496 14369 ts_tablet_manager.cc:1905] T 101b42a834ce443aa755145ad1263520 P efaada18707647cb97341022f4c66117: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:33:43.741137 14368 ts_tablet_manager.cc:1905] T 101b42a834ce443aa755145ad1263520 P b3cf3b7012f54519b619bcdddcae37a8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:33:43.743106 14366 ts_tablet_manager.cc:1905] T 101b42a834ce443aa755145ad1263520 P b14c751392954bcab3c99a6835c1fce1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:33:43.743352 14369 ts_tablet_manager.cc:1918] T 101b42a834ce443aa755145ad1263520 P efaada18707647cb97341022f4c66117: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:33:43.743433 14369 log.cc:1196] T 101b42a834ce443aa755145ad1263520 P efaada18707647cb97341022f4c66117: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-1/wal/wals/101b42a834ce443aa755145ad1263520
I20260808 14:33:43.743683 14368 ts_tablet_manager.cc:1918] T 101b42a834ce443aa755145ad1263520 P b3cf3b7012f54519b619bcdddcae37a8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:33:43.743707 14369 ts_tablet_manager.cc:1939] T 101b42a834ce443aa755145ad1263520 P efaada18707647cb97341022f4c66117: Deleting consensus metadata
I20260808 14:33:43.743767 14368 log.cc:1196] T 101b42a834ce443aa755145ad1263520 P b3cf3b7012f54519b619bcdddcae37a8: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-2/wal/wals/101b42a834ce443aa755145ad1263520
I20260808 14:33:43.744030 14368 ts_tablet_manager.cc:1939] T 101b42a834ce443aa755145ad1263520 P b3cf3b7012f54519b619bcdddcae37a8: Deleting consensus metadata
I20260808 14:33:43.744457 13523 catalog_manager.cc:4841] TS efaada18707647cb97341022f4c66117 (127.11.131.194:45617): tablet 101b42a834ce443aa755145ad1263520 (table test-table [id=c60b0b0ec6804319be9bafaea5f804ac]) successfully deleted
I20260808 14:33:43.744719 13525 catalog_manager.cc:4841] TS b3cf3b7012f54519b619bcdddcae37a8 (127.11.131.195:43509): tablet 101b42a834ce443aa755145ad1263520 (table test-table [id=c60b0b0ec6804319be9bafaea5f804ac]) successfully deleted
I20260808 14:33:43.745781 14366 ts_tablet_manager.cc:1918] T 101b42a834ce443aa755145ad1263520 P b14c751392954bcab3c99a6835c1fce1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:33:43.745847 14366 log.cc:1196] T 101b42a834ce443aa755145ad1263520 P b14c751392954bcab3c99a6835c1fce1: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786199615258783-11791-0/minicluster-data/ts-0/wal/wals/101b42a834ce443aa755145ad1263520
I20260808 14:33:43.746110 14366 ts_tablet_manager.cc:1939] T 101b42a834ce443aa755145ad1263520 P b14c751392954bcab3c99a6835c1fce1: Deleting consensus metadata
I20260808 14:33:43.746760 13524 catalog_manager.cc:4841] TS b14c751392954bcab3c99a6835c1fce1 (127.11.131.193:40849): tablet 101b42a834ce443aa755145ad1263520 (table test-table [id=c60b0b0ec6804319be9bafaea5f804ac]) successfully deleted
Aug 08 14:33:43 dist-test-slave-twwt krb5kdc[13478](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199623, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.131.193@KRBTEST.COM
I20260808 14:33:43.755733 14333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:43.743363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54772 (local address 127.11.131.193:40849)
0808 14:33:43.743500 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:43.743507 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:43.744598 (+ 1091us) server_negotiation.cc:407] Connection header received
0808 14:33:43.744856 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:43.744861 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:43.744916 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:43.745013 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:33:43.745741 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:43.746391 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:43.747549 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:43.747774 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:43.747859 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:43.751748 (+ 3889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:33:43.751759 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:33:43.751774 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:33:43.751799 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:33:43.753627 (+ 1828us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:43.754151 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:43.754157 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:43.754158 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:43.754272 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:43.754587 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:43.754591 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:43.754592 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:43.754928 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:33:43.755176 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:43.755340 (+ 164us) server_negotiation.cc:299] Negotiation successful
0808 14:33:43.755496 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
W20260808 14:33:43.756282 13859 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54772
I20260808 14:33:43.766216 13628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:43.758249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38736 (local address 127.11.131.254:46519)
0808 14:33:43.758419 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:43.758424 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:43.758507 (+ 83us) server_negotiation.cc:407] Connection header received
0808 14:33:43.758589 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:43.758593 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:43.758676 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:43.758781 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:33:43.759381 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:43.760194 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:43.760966 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:43.761314 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:43.761467 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:43.762848 (+ 1381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:33:43.762852 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:33:43.762855 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:33:43.762884 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:33:43.764520 (+ 1636us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:43.764957 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:43.764961 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:43.764963 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:43.765057 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:43.765342 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:43.765346 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:43.765347 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:43.765579 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:33:43.765725 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:43.765927 (+ 202us) server_negotiation.cc:299] Negotiation successful
0808 14:33:43.766053 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
W20260808 14:33:43.766733 13540 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38736
I20260808 14:33:43.768210 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 13669
I20260808 14:33:43.782991 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 13883
I20260808 14:33:43.795080 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 14107
I20260808 14:33:43.809072 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 13499
2026-08-08T14:33:43Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (3159 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:33:43 dist-test-slave-twwt krb5kdc[14424](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:33:43 dist-test-slave-twwt krb5kdc[14424](info): set up 2 sockets
Aug 08 14:33:43 dist-test-slave-twwt krb5kdc[14424](info): commencing operation
krb5kdc: starting...
W20260808 14:33:45.081350 11791 mini_kdc.cc:121] Time spent starting KDC: real 1.238s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Aug 08 14:33:45 dist-test-slave-twwt krb5kdc[14424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199625, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:33:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:33:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.131.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
I20260808 14:33:45.221629 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:34113
--webserver_interface=127.11.131.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:42553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:34113
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:33:45.338716 14442 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:33:45.339004 14442 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:33:45.339046 14442 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:33:45.343077 14442 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:33:45.343138 14442 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 14:33:45.343154 14442 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:33:45.343173 14442 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:33:45.343189 14442 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:33:45.343204 14442 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:33:45.348623 14442 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:42553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:34113
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:34113
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.131.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14442
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:33:45.349713 14442 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:33:45.350756 14442 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:33:45.359299 14456 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:33:45.359299 14451 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:33:45.359297 14454 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:33:45.359594 14442 server_base.cc:1034] running on GCE node
I20260808 14:33:45.360333 14442 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:33:45.361464 14442 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:33:45.362800 14442 hybrid_clock.cc:648] HybridClock initialized: now 1786199625362771 us; error 30 us; skew 500 ppm
Aug 08 14:33:45 dist-test-slave-twwt krb5kdc[14424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199625, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:33:45.370838 14442 init.cc:377] Logged in from keytab as kudu/127.11.131.254@KRBTEST.COM (short username kudu)
I20260808 14:33:45.371786 14442 webserver.cc:460] Webserver started at http://127.11.131.254:42839/ using document root <none> and password file <none>
I20260808 14:33:45.372346 14442 fs_manager.cc:359] Metadata directory not provided
I20260808 14:33:45.372406 14442 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:33:45.372581 14442 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:33:45.374792 14442 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/master-0/data/instance:
uuid: "786c26e1617949c4b9eb62f3e31153d5"
format_stamp: "Formatted at 2026-08-08 14:33:45 on dist-test-slave-twwt"
server_key: "b7b86ec148cd136c8ad153e576d22088"
server_key_iv: "af96afb8d97d59d39d25bb085fe093ca"
server_key_version: "encryptionkey@0"
I20260808 14:33:45.375357 14442 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/master-0/wal/instance:
uuid: "786c26e1617949c4b9eb62f3e31153d5"
format_stamp: "Formatted at 2026-08-08 14:33:45 on dist-test-slave-twwt"
server_key: "b7b86ec148cd136c8ad153e576d22088"
server_key_iv: "af96afb8d97d59d39d25bb085fe093ca"
server_key_version: "encryptionkey@0"
I20260808 14:33:45.379274 14442 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 14:33:45.381759 14464 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:45.383200 14442 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:33:45.383347 14442 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "786c26e1617949c4b9eb62f3e31153d5"
format_stamp: "Formatted at 2026-08-08 14:33:45 on dist-test-slave-twwt"
server_key: "b7b86ec148cd136c8ad153e576d22088"
server_key_iv: "af96afb8d97d59d39d25bb085fe093ca"
server_key_version: "encryptionkey@0"
I20260808 14:33:45.383466 14442 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:33:45.410094 14442 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:33:45.413426 14442 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:33:45.413643 14442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:33:45.421999 14442 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.254:34113
I20260808 14:33:45.422026 14571 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.254:34113 every 8 connection(s)
I20260808 14:33:45.423027 14442 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:33:45.425891 14573 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:33:45.429699 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 14442
I20260808 14:33:45.429797 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/master-0/wal/instance
I20260808 14:33:45.430058 11791 external_mini_cluster.cc:1428] Setting key 9d9244eb62e73946a0fb79cf5cf80aa2
I20260808 14:33:45.431821 14573 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 786c26e1617949c4b9eb62f3e31153d5: Bootstrap starting.
I20260808 14:33:45.434113 14573 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 786c26e1617949c4b9eb62f3e31153d5: Neither blocks nor log segments found. Creating new log.
I20260808 14:33:45.434933 14573 log.cc:824] T 00000000000000000000000000000000 P 786c26e1617949c4b9eb62f3e31153d5: Log is configured to *not* fsync() on all Append() calls
I20260808 14:33:45.437146 14573 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 786c26e1617949c4b9eb62f3e31153d5: No bootstrap required, opened a new log
Aug 08 14:33:45 dist-test-slave-twwt krb5kdc[14424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199625, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:33:45.441599 14573 raft_consensus.cc:348] T 00000000000000000000000000000000 P 786c26e1617949c4b9eb62f3e31153d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "786c26e1617949c4b9eb62f3e31153d5" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 34113 } }
I20260808 14:33:45.441901 14573 raft_consensus.cc:374] T 00000000000000000000000000000000 P 786c26e1617949c4b9eb62f3e31153d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:33:45.441973 14573 raft_consensus.cc:729] T 00000000000000000000000000000000 P 786c26e1617949c4b9eb62f3e31153d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 786c26e1617949c4b9eb62f3e31153d5, State: Initialized, Role: FOLLOWER
I20260808 14:33:45.442514 14573 consensus_queue.cc:260] T 00000000000000000000000000000000 P 786c26e1617949c4b9eb62f3e31153d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "786c26e1617949c4b9eb62f3e31153d5" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 34113 } }
I20260808 14:33:45.442710 14573 raft_consensus.cc:388] T 00000000000000000000000000000000 P 786c26e1617949c4b9eb62f3e31153d5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:33:45.442796 14573 raft_consensus.cc:482] T 00000000000000000000000000000000 P 786c26e1617949c4b9eb62f3e31153d5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:33:45.442914 14573 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 786c26e1617949c4b9eb62f3e31153d5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:33:45.443869 14573 raft_consensus.cc:504] T 00000000000000000000000000000000 P 786c26e1617949c4b9eb62f3e31153d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "786c26e1617949c4b9eb62f3e31153d5" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 34113 } }
I20260808 14:33:45.444260 14573 leader_election.cc:302] T 00000000000000000000000000000000 P 786c26e1617949c4b9eb62f3e31153d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 786c26e1617949c4b9eb62f3e31153d5; no voters:
I20260808 14:33:45.444718 14573 leader_election.cc:288] T 00000000000000000000000000000000 P 786c26e1617949c4b9eb62f3e31153d5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:33:45.444823 14579 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 786c26e1617949c4b9eb62f3e31153d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:33:45.445042 14579 raft_consensus.cc:686] T 00000000000000000000000000000000 P 786c26e1617949c4b9eb62f3e31153d5 [term 1 LEADER]: Becoming Leader. State: Replica: 786c26e1617949c4b9eb62f3e31153d5, State: Running, Role: LEADER
I20260808 14:33:45.445364 14577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:45.431518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52330 (local address 127.11.131.254:34113)
0808 14:33:45.431997 (+ 479us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:45.432013 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:45.432051 (+ 38us) server_negotiation.cc:407] Connection header received
0808 14:33:45.432723 (+ 672us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:45.432742 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:45.433071 (+ 329us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:45.433414 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:33:45.434235 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:45.435417 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:45.436609 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:45.437076 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:45.437349 (+ 273us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:45.439946 (+ 2597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:33:45.439952 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:33:45.439969 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:33:45.440000 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:33:45.441975 (+ 1975us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:45.442484 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:45.442490 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:45.442495 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:45.442710 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:45.443062 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:45.443066 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:45.443067 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:45.443480 (+ 413us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:33:45.443701 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:45.444019 (+ 318us) server_negotiation.cc:299] Negotiation successful
0808 14:33:45.444315 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":290,"thread_start_us":123,"threads_started":1}
I20260808 14:33:45.445364 14579 consensus_queue.cc:237] T 00000000000000000000000000000000 P 786c26e1617949c4b9eb62f3e31153d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "786c26e1617949c4b9eb62f3e31153d5" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 34113 } }
I20260808 14:33:45.446048 14573 sys_catalog.cc:564] T 00000000000000000000000000000000 P 786c26e1617949c4b9eb62f3e31153d5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:33:45.446622 14579 sys_catalog.cc:455] T 00000000000000000000000000000000 P 786c26e1617949c4b9eb62f3e31153d5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 786c26e1617949c4b9eb62f3e31153d5. Latest consensus state: current_term: 1 leader_uuid: "786c26e1617949c4b9eb62f3e31153d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "786c26e1617949c4b9eb62f3e31153d5" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 34113 } } }
I20260808 14:33:45.446741 14579 sys_catalog.cc:458] T 00000000000000000000000000000000 P 786c26e1617949c4b9eb62f3e31153d5 [sys.catalog]: This master's current role is: LEADER
I20260808 14:33:45.448750 14587 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:33:45.448959 14580 sys_catalog.cc:455] T 00000000000000000000000000000000 P 786c26e1617949c4b9eb62f3e31153d5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "786c26e1617949c4b9eb62f3e31153d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "786c26e1617949c4b9eb62f3e31153d5" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 34113 } } }
I20260808 14:33:45.449249 14580 sys_catalog.cc:458] T 00000000000000000000000000000000 P 786c26e1617949c4b9eb62f3e31153d5 [sys.catalog]: This master's current role is: LEADER
I20260808 14:33:45.451519 14587 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:33:45.456758 14587 catalog_manager.cc:1347] Generated new cluster ID: 65e12261e19f4951beb5a902849ea986
I20260808 14:33:45.456835 14587 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:33:45.476114 14587 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:33:45.477505 14587 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:33:45.486865 14587 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 786c26e1617949c4b9eb62f3e31153d5: Generated new TSK 0
I20260808 14:33:45.487823 14587 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.131.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab.
Entry for principal kudu/127.11.131.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab.
I20260808 14:33:45.530058 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.193:0
--local_ip_for_outbound_sockets=127.11.131.193
--webserver_interface=127.11.131.193
--webserver_port=0
--tserver_master_addrs=127.11.131.254:34113
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab
--principal=kudu/127.11.131.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:42553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:33:45.650475 14614 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:33:45.650779 14614 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:33:45.650828 14614 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:33:45.654760 14614 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:33:45.654824 14614 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:33:45.654861 14614 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 14:33:45.654875 14614 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 14:33:45.654906 14614 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.193
I20260808 14:33:45.660107 14614 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:42553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab
--principal=kudu/127.11.131.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.131.193
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.131.254:34113
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14614
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.193
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:33:45.661123 14614 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:33:45.662159 14614 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:33:45.672173 14621 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:33:45.672166 14622 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:33:45.672259 14626 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:33:45.672433 14614 server_base.cc:1034] running on GCE node
I20260808 14:33:45.673002 14614 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:33:45.673725 14614 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:33:45.674940 14614 hybrid_clock.cc:648] HybridClock initialized: now 1786199625674920 us; error 29 us; skew 500 ppm
Aug 08 14:33:45 dist-test-slave-twwt krb5kdc[14424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199625, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:33:45.678174 14614 init.cc:377] Logged in from keytab as kudu/127.11.131.193@KRBTEST.COM (short username kudu)
I20260808 14:33:45.679158 14614 webserver.cc:460] Webserver started at http://127.11.131.193:35787/ using document root <none> and password file <none>
I20260808 14:33:45.679693 14614 fs_manager.cc:359] Metadata directory not provided
I20260808 14:33:45.679752 14614 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:33:45.679919 14614 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:33:45.681941 14614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-0/data/instance:
uuid: "bc8e24f303a54de5b4264d4953b28c91"
format_stamp: "Formatted at 2026-08-08 14:33:45 on dist-test-slave-twwt"
server_key: "54cd0a5539ef366bff9158ac48b94d73"
server_key_iv: "e3e31c01c72ae3fd474945590f03fe51"
server_key_version: "encryptionkey@0"
I20260808 14:33:45.682482 14614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-0/wal/instance:
uuid: "bc8e24f303a54de5b4264d4953b28c91"
format_stamp: "Formatted at 2026-08-08 14:33:45 on dist-test-slave-twwt"
server_key: "54cd0a5539ef366bff9158ac48b94d73"
server_key_iv: "e3e31c01c72ae3fd474945590f03fe51"
server_key_version: "encryptionkey@0"
I20260808 14:33:45.686232 14614 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:33:45.689064 14640 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:45.690414 14614 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 14:33:45.690555 14614 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-0/wal
uuid: "bc8e24f303a54de5b4264d4953b28c91"
format_stamp: "Formatted at 2026-08-08 14:33:45 on dist-test-slave-twwt"
server_key: "54cd0a5539ef366bff9158ac48b94d73"
server_key_iv: "e3e31c01c72ae3fd474945590f03fe51"
server_key_version: "encryptionkey@0"
I20260808 14:33:45.690729 14614 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:33:45.709661 14614 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:33:45.713239 14614 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:33:45.713475 14614 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:33:45.715274 14614 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:33:45.715332 14614 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:45.715373 14614 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:33:45.715410 14614 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 14:33:45 dist-test-slave-twwt krb5kdc[14424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199625, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.193@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:33:45.727599 14614 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.193:35779
I20260808 14:33:45.727721 14823 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.193:35779 every 8 connection(s)
I20260808 14:33:45.728778 14614 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
I20260808 14:33:45.730444 14577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:45.716182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:42781 (local address 127.11.131.254:34113)
0808 14:33:45.716377 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:45.716383 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:45.717235 (+ 852us) server_negotiation.cc:407] Connection header received
0808 14:33:45.718372 (+ 1137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:45.718376 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:45.718464 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:45.718527 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:33:45.720127 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:45.721053 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:45.722551 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:45.723020 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:45.723158 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:45.726369 (+ 3211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:33:45.726374 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:33:45.726376 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:33:45.726407 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:33:45.728177 (+ 1770us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:45.728681 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:45.728688 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:45.728692 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:45.728806 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:45.729268 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:45.729272 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:45.729274 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:45.729516 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:33:45.729618 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:45.730204 (+ 586us) server_negotiation.cc:299] Negotiation successful
0808 14:33:45.730319 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 14:33:45.731276 14651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:45.716597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:34113 (local address 127.11.131.193:42781)
0808 14:33:45.717077 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:45.717132 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:45.718087 (+ 955us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:45.719014 (+ 927us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:45.719021 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:45.719364 (+ 343us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:33:45.719923 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:45.719946 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:45.721207 (+ 1261us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:45.721211 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:45.722435 (+ 1224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:45.722447 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:45.723252 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:45.723265 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:45.723489 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:45.724144 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:33:45.724167 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:33:45.726215 (+ 2048us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:33:45.728295 (+ 2080us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:45.728300 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:45.728312 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:45.728570 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:45.728934 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:45.728937 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:45.728939 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:45.729122 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:45.729637 (+ 515us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:33:45.729649 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:33:45.729961 (+ 312us) client_negotiation.cc:769] Sending connection context
0808 14:33:45.730136 (+ 175us) client_negotiation.cc:240] Negotiation successful
0808 14:33:45.730399 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":129,"threads_started":1}
I20260808 14:33:45.732560 14825 heartbeater.cc:347] Connected to a master server at 127.11.131.254:34113
I20260808 14:33:45.732718 14825 heartbeater.cc:464] Registering TS with master...
I20260808 14:33:45.733281 14825 heartbeater.cc:511] Master 127.11.131.254:34113 requested a full tablet report, sending...
I20260808 14:33:45.735047 14493 ts_manager.cc:194] Registered new tserver with Master: bc8e24f303a54de5b4264d4953b28c91 (127.11.131.193:35779)
I20260808 14:33:45.736342 14493 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.193@KRBTEST.COM'} at 127.11.131.193:42781
I20260808 14:33:45.737699 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 14614
I20260808 14:33:45.737816 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-0/wal/instance
I20260808 14:33:45.738094 11791 external_mini_cluster.cc:1428] Setting key 7ee7207f13c51c41d5bb728662936759
I20260808 14:33:45.743484 14577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:45.735100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:48695 (local address 127.11.131.254:34113)
0808 14:33:45.735222 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:45.735226 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:45.735400 (+ 174us) server_negotiation.cc:407] Connection header received
0808 14:33:45.735516 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:45.735520 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:45.735566 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:45.735650 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:33:45.736086 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:45.736634 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:45.737469 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:45.737689 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:45.737794 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:45.739791 (+ 1997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:33:45.739796 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:33:45.739799 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:33:45.739824 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:33:45.741514 (+ 1690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:45.742089 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:45.742095 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:45.742100 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:45.742193 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:45.742493 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:45.742497 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:45.742499 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:45.742752 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:33:45.742878 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:45.743194 (+ 316us) server_negotiation.cc:299] Negotiation successful
0808 14:33:45.743319 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 14:33:45.743507 14836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:45.735022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:34113 (local address 127.11.131.193:48695)
0808 14:33:45.735312 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:45.735331 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:45.735440 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:45.735667 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:45.735670 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:45.735875 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:33:45.735972 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:45.735977 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:45.736762 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:45.736765 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:45.737345 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:45.737354 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:45.737811 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:45.737814 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:45.738739 (+ 925us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:45.739239 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:33:45.739251 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:33:45.739652 (+ 401us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:33:45.741646 (+ 1994us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:45.741649 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:45.741650 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:45.741977 (+ 327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:45.742304 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:45.742307 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:45.742310 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:45.742396 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:45.742876 (+ 480us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:33:45.742879 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:33:45.743021 (+ 142us) client_negotiation.cc:769] Sending connection context
0808 14:33:45.743135 (+ 114us) client_negotiation.cc:240] Negotiation successful
0808 14:33:45.743306 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204,"mutex_wait_us":4,"thread_start_us":91,"threads_started":1}
WARNING: no policy specified for kudu/127.11.131.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab.
Entry for principal kudu/127.11.131.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab.
I20260808 14:33:45.769984 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.194:0
--local_ip_for_outbound_sockets=127.11.131.194
--webserver_interface=127.11.131.194
--webserver_port=0
--tserver_master_addrs=127.11.131.254:34113
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab
--principal=kudu/127.11.131.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:42553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:33:45.892501 14840 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:33:45.892788 14840 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:33:45.892879 14840 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:33:45.897306 14840 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:33:45.897374 14840 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:33:45.897416 14840 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 14:33:45.897464 14840 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 14:33:45.897521 14840 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.194
I20260808 14:33:45.903019 14840 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:42553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab
--principal=kudu/127.11.131.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.131.194
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.131.254:34113
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14840
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.194
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:33:45.904124 14840 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:33:45.905174 14840 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:33:45.915496 14847 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:33:45.915450 14848 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:33:45.915467 14851 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:33:45.915717 14840 server_base.cc:1034] running on GCE node
I20260808 14:33:45.916181 14840 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:33:45.916886 14840 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:33:45.918081 14840 hybrid_clock.cc:648] HybridClock initialized: now 1786199625918045 us; error 50 us; skew 500 ppm
Aug 08 14:33:45 dist-test-slave-twwt krb5kdc[14424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199625, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:33:45.921051 14840 init.cc:377] Logged in from keytab as kudu/127.11.131.194@KRBTEST.COM (short username kudu)
I20260808 14:33:45.922017 14840 webserver.cc:460] Webserver started at http://127.11.131.194:39845/ using document root <none> and password file <none>
I20260808 14:33:45.922700 14840 fs_manager.cc:359] Metadata directory not provided
I20260808 14:33:45.922796 14840 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:33:45.923048 14840 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:33:45.925261 14840 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-1/data/instance:
uuid: "c223f4b86e4d493a909f933d2e30eea9"
format_stamp: "Formatted at 2026-08-08 14:33:45 on dist-test-slave-twwt"
server_key: "93b90a0319ea27b7cfb32b6a48a13cee"
server_key_iv: "e79319dfefa18775d6469c2cb404e3d4"
server_key_version: "encryptionkey@0"
I20260808 14:33:45.925863 14840 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-1/wal/instance:
uuid: "c223f4b86e4d493a909f933d2e30eea9"
format_stamp: "Formatted at 2026-08-08 14:33:45 on dist-test-slave-twwt"
server_key: "93b90a0319ea27b7cfb32b6a48a13cee"
server_key_iv: "e79319dfefa18775d6469c2cb404e3d4"
server_key_version: "encryptionkey@0"
I20260808 14:33:45.929838 14840 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 14:33:45.932504 14865 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:45.933853 14840 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 14:33:45.934000 14840 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-1/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-1/wal
uuid: "c223f4b86e4d493a909f933d2e30eea9"
format_stamp: "Formatted at 2026-08-08 14:33:45 on dist-test-slave-twwt"
server_key: "93b90a0319ea27b7cfb32b6a48a13cee"
server_key_iv: "e79319dfefa18775d6469c2cb404e3d4"
server_key_version: "encryptionkey@0"
I20260808 14:33:45.934099 14840 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:33:45.944671 14840 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:33:45.948197 14840 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:33:45.948406 14840 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:33:45.949882 14840 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:33:45.949955 14840 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:45.950022 14840 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:33:45.950057 14840 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:45.961174 14840 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.194:36771
I20260808 14:33:45.961288 15049 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.194:36771 every 8 connection(s)
Aug 08 14:33:45 dist-test-slave-twwt krb5kdc[14424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199625, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.194@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:33:45.962160 14840 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
I20260808 14:33:45.966058 14577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:45.950937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:41095 (local address 127.11.131.254:34113)
0808 14:33:45.951194 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:45.951201 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:45.952325 (+ 1124us) server_negotiation.cc:407] Connection header received
0808 14:33:45.954566 (+ 2241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:45.954570 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:45.954675 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:45.954735 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:33:45.956720 (+ 1985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:45.957643 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:45.959052 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:45.959431 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:45.959544 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:45.962409 (+ 2865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:33:45.962413 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:33:45.962416 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:33:45.962446 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:33:45.964096 (+ 1650us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:45.964589 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:45.964591 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:45.964593 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:45.964675 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:45.965008 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:45.965011 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:45.965012 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:45.965178 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:33:45.965253 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:45.965698 (+ 445us) server_negotiation.cc:299] Negotiation successful
0808 14:33:45.965854 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260808 14:33:45.967168 14880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:45.951410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:34113 (local address 127.11.131.194:41095)
0808 14:33:45.952103 (+ 693us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:45.952194 (+ 91us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:45.954149 (+ 1955us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:45.955251 (+ 1102us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:45.955260 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:45.955771 (+ 511us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:33:45.956536 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:45.956558 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:45.957811 (+ 1253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:45.957813 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:45.958905 (+ 1092us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:45.958919 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:45.959583 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:45.959587 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:45.959815 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:45.960517 (+ 702us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:33:45.960534 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:33:45.962204 (+ 1670us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:33:45.964210 (+ 2006us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:45.964215 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:45.964226 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:45.964494 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:45.964759 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:45.964761 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:45.964763 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:45.964926 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:45.965266 (+ 340us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:33:45.965272 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:33:45.965492 (+ 220us) client_negotiation.cc:769] Sending connection context
0808 14:33:45.965646 (+ 154us) client_negotiation.cc:240] Negotiation successful
0808 14:33:45.966086 (+ 440us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":120,"threads_started":1}
I20260808 14:33:45.968284 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 14840
I20260808 14:33:45.968408 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-1/wal/instance
I20260808 14:33:45.968575 15050 heartbeater.cc:347] Connected to a master server at 127.11.131.254:34113
I20260808 14:33:45.968747 11791 external_mini_cluster.cc:1428] Setting key b993202933c00d9de5990140628b16c4
I20260808 14:33:45.968784 15050 heartbeater.cc:464] Registering TS with master...
I20260808 14:33:45.969471 15050 heartbeater.cc:511] Master 127.11.131.254:34113 requested a full tablet report, sending...
I20260808 14:33:45.970534 14493 ts_manager.cc:194] Registered new tserver with Master: c223f4b86e4d493a909f933d2e30eea9 (127.11.131.194:36771)
I20260808 14:33:45.971150 14493 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.194@KRBTEST.COM'} at 127.11.131.194:41095
I20260808 14:33:45.980556 14577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:45.971329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:53055 (local address 127.11.131.254:34113)
0808 14:33:45.971490 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:45.971497 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:45.972895 (+ 1398us) server_negotiation.cc:407] Connection header received
0808 14:33:45.973086 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:45.973089 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:45.973129 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:45.973197 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:33:45.973774 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:45.974261 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:45.975577 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:45.975786 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:45.975874 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:45.977321 (+ 1447us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:33:45.977324 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:33:45.977326 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:33:45.977349 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:33:45.978869 (+ 1520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:45.979384 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:45.979386 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:45.979387 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:45.979459 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:45.979751 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:45.979753 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:45.979755 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:45.979951 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:33:45.980028 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:45.980346 (+ 318us) server_negotiation.cc:299] Negotiation successful
0808 14:33:45.980441 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 14:33:45.980839 15062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:45.970994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:34113 (local address 127.11.131.194:53055)
0808 14:33:45.972802 (+ 1808us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:45.972820 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:45.972977 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:45.973243 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:45.973247 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:45.973502 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:33:45.973653 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:45.973661 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:45.974400 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:45.974406 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:45.975452 (+ 1046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:45.975468 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:45.975924 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:45.975932 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:45.976077 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:45.976627 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:33:45.976643 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:33:45.977155 (+ 512us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:33:45.978984 (+ 1829us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:45.978989 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:45.978993 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:45.979273 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:45.979553 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:45.979556 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:45.979558 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:45.979657 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:45.980059 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:33:45.980063 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:33:45.980163 (+ 100us) client_negotiation.cc:769] Sending connection context
0808 14:33:45.980294 (+ 131us) client_negotiation.cc:240] Negotiation successful
0808 14:33:45.980458 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1695,"thread_start_us":87,"threads_started":1}
WARNING: no policy specified for kudu/127.11.131.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab.
Entry for principal kudu/127.11.131.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab.
I20260808 14:33:46.001832 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.195:0
--local_ip_for_outbound_sockets=127.11.131.195
--webserver_interface=127.11.131.195
--webserver_port=0
--tserver_master_addrs=127.11.131.254:34113
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab
--principal=kudu/127.11.131.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:42553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:33:46.119277 15067 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:33:46.119567 15067 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:33:46.119648 15067 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:33:46.123657 15067 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:33:46.123740 15067 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:33:46.123812 15067 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 14:33:46.123857 15067 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 14:33:46.123924 15067 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.195
I20260808 14:33:46.129206 15067 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:42553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab
--principal=kudu/127.11.131.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.131.195
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.131.254:34113
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15067
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.195
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:33:46.130287 15067 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:33:46.131397 15067 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:33:46.141592 15076 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:33:46.141731 15067 server_base.cc:1034] running on GCE node
W20260808 14:33:46.141683 15074 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:33:46.141655 15078 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:33:46.142225 15067 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:33:46.142997 15067 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:33:46.144196 15067 hybrid_clock.cc:648] HybridClock initialized: now 1786199626144164 us; error 41 us; skew 500 ppm
Aug 08 14:33:46 dist-test-slave-twwt krb5kdc[14424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199626, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:33:46.147271 15067 init.cc:377] Logged in from keytab as kudu/127.11.131.195@KRBTEST.COM (short username kudu)
I20260808 14:33:46.148259 15067 webserver.cc:460] Webserver started at http://127.11.131.195:33915/ using document root <none> and password file <none>
I20260808 14:33:46.148849 15067 fs_manager.cc:359] Metadata directory not provided
I20260808 14:33:46.148943 15067 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:33:46.149163 15067 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:33:46.151374 15067 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-2/data/instance:
uuid: "b9d0b1d9589041b4983a7b331fe163ce"
format_stamp: "Formatted at 2026-08-08 14:33:46 on dist-test-slave-twwt"
server_key: "1621a3a481e1f703c124038a7375042a"
server_key_iv: "d38b46c779f8f6d71a8a1b9246386b7f"
server_key_version: "encryptionkey@0"
I20260808 14:33:46.151953 15067 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-2/wal/instance:
uuid: "b9d0b1d9589041b4983a7b331fe163ce"
format_stamp: "Formatted at 2026-08-08 14:33:46 on dist-test-slave-twwt"
server_key: "1621a3a481e1f703c124038a7375042a"
server_key_iv: "d38b46c779f8f6d71a8a1b9246386b7f"
server_key_version: "encryptionkey@0"
I20260808 14:33:46.155900 15067 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260808 14:33:46.158515 15089 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:46.159835 15067 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 14:33:46.159988 15067 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-2/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-2/wal
uuid: "b9d0b1d9589041b4983a7b331fe163ce"
format_stamp: "Formatted at 2026-08-08 14:33:46 on dist-test-slave-twwt"
server_key: "1621a3a481e1f703c124038a7375042a"
server_key_iv: "d38b46c779f8f6d71a8a1b9246386b7f"
server_key_version: "encryptionkey@0"
I20260808 14:33:46.160115 15067 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:33:46.179332 15067 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:33:46.182832 15067 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:33:46.183044 15067 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:33:46.184654 15067 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:33:46.184729 15067 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:46.184804 15067 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:33:46.184846 15067 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 14:33:46 dist-test-slave-twwt krb5kdc[14424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199626, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.195@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:33:46.196282 15067 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.195:41581
I20260808 14:33:46.196323 15263 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.195:41581 every 8 connection(s)
I20260808 14:33:46.197228 15067 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
I20260808 14:33:46.199586 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 15067
I20260808 14:33:46.199726 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-2/wal/instance
I20260808 14:33:46.200058 11791 external_mini_cluster.cc:1428] Setting key 3c0b898eabcbdd29eb0e29a0595f2e00
I20260808 14:33:46.200418 14577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:46.185418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:40379 (local address 127.11.131.254:34113)
0808 14:33:46.185592 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:46.185597 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:46.187019 (+ 1422us) server_negotiation.cc:407] Connection header received
0808 14:33:46.188449 (+ 1430us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:46.188453 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:46.188514 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:46.188612 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:33:46.190422 (+ 1810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.191142 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.192986 (+ 1844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.193201 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.193288 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:46.196407 (+ 3119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:33:46.196412 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:33:46.196414 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:33:46.196446 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:33:46.198241 (+ 1795us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:46.198773 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:46.198777 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:46.198780 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:46.198866 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:46.199143 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:46.199145 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:46.199146 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:46.199393 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:33:46.199510 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:46.200112 (+ 602us) server_negotiation.cc:299] Negotiation successful
0808 14:33:46.200248 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 14:33:46.201408 15100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:46.186289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:34113 (local address 127.11.131.195:40379)
0808 14:33:46.186810 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:46.186892 (+ 82us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:46.188198 (+ 1306us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:46.188799 (+ 601us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:46.188812 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:46.189422 (+ 610us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:33:46.190214 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:46.190239 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.191284 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.191291 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:46.192853 (+ 1562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:46.192865 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.193380 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.193386 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:46.193597 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:46.194370 (+ 773us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:33:46.194394 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:33:46.196161 (+ 1767us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:33:46.198355 (+ 2194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:46.198359 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:46.198369 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:46.198674 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:46.198928 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:46.198930 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:46.198932 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:46.199058 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:46.199508 (+ 450us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:33:46.199513 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:33:46.199830 (+ 317us) client_negotiation.cc:769] Sending connection context
0808 14:33:46.200001 (+ 171us) client_negotiation.cc:240] Negotiation successful
0808 14:33:46.200340 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":105,"threads_started":1}
I20260808 14:33:46.202644 15264 heartbeater.cc:347] Connected to a master server at 127.11.131.254:34113
I20260808 14:33:46.202795 15264 heartbeater.cc:464] Registering TS with master...
I20260808 14:33:46.203398 15264 heartbeater.cc:511] Master 127.11.131.254:34113 requested a full tablet report, sending...
I20260808 14:33:46.204535 14493 ts_manager.cc:194] Registered new tserver with Master: b9d0b1d9589041b4983a7b331fe163ce (127.11.131.195:41581)
I20260808 14:33:46.205312 14493 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.195@KRBTEST.COM'} at 127.11.131.195:40379
I20260808 14:33:46.211874 14577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:46.205158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:58793 (local address 127.11.131.254:34113)
0808 14:33:46.205284 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:46.205296 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:46.205545 (+ 249us) server_negotiation.cc:407] Connection header received
0808 14:33:46.205656 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:46.205659 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:46.205703 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:46.205833 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:33:46.206294 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.206878 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.207719 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.207939 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.208042 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:46.209054 (+ 1012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:33:46.209058 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:33:46.209061 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:33:46.209089 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:33:46.210250 (+ 1161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:46.210706 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:46.210710 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:46.210712 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:46.210797 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:46.211080 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:46.211084 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:46.211085 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:46.211252 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:33:46.211358 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:46.211617 (+ 259us) server_negotiation.cc:299] Negotiation successful
0808 14:33:46.211724 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 14:33:46.211886 15273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:46.205079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:34113 (local address 127.11.131.195:58793)
0808 14:33:46.205452 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:46.205468 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:46.205575 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:46.205854 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:46.205857 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:46.206072 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:33:46.206173 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:46.206179 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.207000 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.207003 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:46.207595 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:46.207604 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.208058 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.208062 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:46.208162 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:46.208604 (+ 442us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:33:46.208616 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:33:46.208919 (+ 303us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:33:46.210362 (+ 1443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:46.210366 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:46.210368 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:46.210568 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:46.210892 (+ 324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:46.210896 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:46.210898 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:46.210985 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:46.211349 (+ 364us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:33:46.211352 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:33:46.211451 (+ 99us) client_negotiation.cc:769] Sending connection context
0808 14:33:46.211560 (+ 109us) client_negotiation.cc:240] Negotiation successful
0808 14:33:46.211706 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":87,"threads_started":1}
I20260808 14:33:46.214154 11791 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 14:33:46 dist-test-slave-twwt krb5kdc[14424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199626, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 14:33:46 dist-test-slave-twwt krb5kdc[14424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199626, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:33:46.243297 14577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:46.234357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52346 (local address 127.11.131.254:34113)
0808 14:33:46.234498 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:46.234502 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:46.234514 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:33:46.234559 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:46.234562 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:46.234640 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:46.234764 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:33:46.235522 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.236089 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.236953 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.237168 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.237257 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:46.240006 (+ 2749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:33:46.240010 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:33:46.240012 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:33:46.240038 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:33:46.241373 (+ 1335us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:46.241788 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:46.241791 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:46.241792 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:46.241867 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:46.242130 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:46.242133 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:46.242134 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:46.242379 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:33:46.242493 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:46.242902 (+ 409us) server_negotiation.cc:299] Negotiation successful
0808 14:33:46.243015 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 14:33:46.246990 14493 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52346:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:33:46.250213 14493 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:33:46.265393 15299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:46.259467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.195:41581 (local address 127.0.0.1:34102)
0808 14:33:46.260225 (+ 758us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:46.260283 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:46.260416 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:46.260995 (+ 579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:46.261005 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:46.261028 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:33:46.261177 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:46.261184 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.262324 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.262329 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:46.263629 (+ 1300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:46.263640 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.264808 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.264811 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:46.264923 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:46.264975 (+ 52us) client_negotiation.cc:769] Sending connection context
0808 14:33:46.265097 (+ 122us) client_negotiation.cc:240] Negotiation successful
0808 14:33:46.265245 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":311,"spinlock_wait_cycles":700672,"thread_start_us":120,"threads_started":1}
I20260808 14:33:46.265411 15304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:46.259829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34102 (local address 127.11.131.195:41581)
0808 14:33:46.260470 (+ 641us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:46.260488 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:46.260513 (+ 25us) server_negotiation.cc:407] Connection header received
0808 14:33:46.260596 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:46.260604 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:46.260825 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:46.261013 (+ 188us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:33:46.261306 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.262185 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.263759 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.264672 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.264831 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:46.264972 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:46.265132 (+ 160us) server_negotiation.cc:299] Negotiation successful
0808 14:33:46.265232 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":534,"thread_start_us":123,"threads_started":1}
I20260808 14:33:46.265866 15301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:46.259812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.194:36771 (local address 127.0.0.1:44008)
0808 14:33:46.260717 (+ 905us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:46.260730 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:46.260815 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:46.261396 (+ 581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:46.261399 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:46.261418 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:33:46.261501 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:46.261507 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.262994 (+ 1487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.262997 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:46.264215 (+ 1218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:46.264230 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.265456 (+ 1226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.265462 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:46.265553 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:46.265575 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 14:33:46.265648 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 14:33:46.265730 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":838,"thread_start_us":100,"threads_started":1}
I20260808 14:33:46.266331 15305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:46.260174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44008 (local address 127.11.131.194:36771)
0808 14:33:46.260632 (+ 458us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:46.260644 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:46.260821 (+ 177us) server_negotiation.cc:407] Connection header received
0808 14:33:46.260907 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:46.260912 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:46.261078 (+ 166us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:46.261225 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:33:46.261640 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.262871 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.264340 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.265131 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.265263 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:46.265387 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:46.266092 (+ 705us) server_negotiation.cc:299] Negotiation successful
0808 14:33:46.266195 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":131,"threads_started":1}
I20260808 14:33:46.266860 15298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:46.259274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39224 (local address 127.11.131.193:35779)
0808 14:33:46.259684 (+ 410us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:46.259694 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:46.260377 (+ 683us) server_negotiation.cc:407] Connection header received
0808 14:33:46.260644 (+ 267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:46.260651 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:46.260900 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:46.261043 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:33:46.261451 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.262598 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.264226 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.265056 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.265178 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:46.265308 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:46.266610 (+ 1302us) server_negotiation.cc:299] Negotiation successful
0808 14:33:46.266732 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":82,"threads_started":1}
I20260808 14:33:46.267068 15296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:46.259086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:35779 (local address 127.0.0.1:39224)
0808 14:33:46.260227 (+ 1141us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:46.260281 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:46.260458 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:46.261176 (+ 718us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:46.261180 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:46.261211 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:33:46.261333 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:46.261338 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.262797 (+ 1459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.262800 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:46.264083 (+ 1283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:46.264095 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.265378 (+ 1283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.265382 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:46.265850 (+ 468us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:46.265877 (+ 27us) client_negotiation.cc:769] Sending connection context
0808 14:33:46.266207 (+ 330us) client_negotiation.cc:240] Negotiation successful
0808 14:33:46.266306 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"mutex_wait_us":4,"thread_start_us":77,"threads_started":1}
I20260808 14:33:46.268836 15162 tablet_service.cc:1467] Processing CreateTablet for tablet f88ad251f71e403ebfea00d1558ae7af (DEFAULT_TABLE table=test-table [id=a3f4c5aaf472476a8ff0a177b34626da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:33:46.269220 14941 tablet_service.cc:1467] Processing CreateTablet for tablet f88ad251f71e403ebfea00d1558ae7af (DEFAULT_TABLE table=test-table [id=a3f4c5aaf472476a8ff0a177b34626da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:33:46.269730 14712 tablet_service.cc:1467] Processing CreateTablet for tablet f88ad251f71e403ebfea00d1558ae7af (DEFAULT_TABLE table=test-table [id=a3f4c5aaf472476a8ff0a177b34626da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:33:46.270212 15162 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f88ad251f71e403ebfea00d1558ae7af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:33:46.270269 14941 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f88ad251f71e403ebfea00d1558ae7af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:33:46.270733 14712 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f88ad251f71e403ebfea00d1558ae7af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:33:46.277004 15306 tablet_bootstrap.cc:492] T f88ad251f71e403ebfea00d1558ae7af P b9d0b1d9589041b4983a7b331fe163ce: Bootstrap starting.
I20260808 14:33:46.278556 15307 tablet_bootstrap.cc:492] T f88ad251f71e403ebfea00d1558ae7af P bc8e24f303a54de5b4264d4953b28c91: Bootstrap starting.
I20260808 14:33:46.279371 15306 tablet_bootstrap.cc:654] T f88ad251f71e403ebfea00d1558ae7af P b9d0b1d9589041b4983a7b331fe163ce: Neither blocks nor log segments found. Creating new log.
I20260808 14:33:46.280172 15306 log.cc:824] T f88ad251f71e403ebfea00d1558ae7af P b9d0b1d9589041b4983a7b331fe163ce: Log is configured to *not* fsync() on all Append() calls
I20260808 14:33:46.280395 15307 tablet_bootstrap.cc:654] T f88ad251f71e403ebfea00d1558ae7af P bc8e24f303a54de5b4264d4953b28c91: Neither blocks nor log segments found. Creating new log.
I20260808 14:33:46.280980 15310 tablet_bootstrap.cc:492] T f88ad251f71e403ebfea00d1558ae7af P c223f4b86e4d493a909f933d2e30eea9: Bootstrap starting.
I20260808 14:33:46.281296 15307 log.cc:824] T f88ad251f71e403ebfea00d1558ae7af P bc8e24f303a54de5b4264d4953b28c91: Log is configured to *not* fsync() on all Append() calls
I20260808 14:33:46.282428 15306 tablet_bootstrap.cc:492] T f88ad251f71e403ebfea00d1558ae7af P b9d0b1d9589041b4983a7b331fe163ce: No bootstrap required, opened a new log
I20260808 14:33:46.282656 15306 ts_tablet_manager.cc:1397] T f88ad251f71e403ebfea00d1558ae7af P b9d0b1d9589041b4983a7b331fe163ce: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 14:33:46.283077 15310 tablet_bootstrap.cc:654] T f88ad251f71e403ebfea00d1558ae7af P c223f4b86e4d493a909f933d2e30eea9: Neither blocks nor log segments found. Creating new log.
I20260808 14:33:46.283360 15307 tablet_bootstrap.cc:492] T f88ad251f71e403ebfea00d1558ae7af P bc8e24f303a54de5b4264d4953b28c91: No bootstrap required, opened a new log
I20260808 14:33:46.283550 15307 ts_tablet_manager.cc:1397] T f88ad251f71e403ebfea00d1558ae7af P bc8e24f303a54de5b4264d4953b28c91: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.003s
I20260808 14:33:46.283861 15310 log.cc:824] T f88ad251f71e403ebfea00d1558ae7af P c223f4b86e4d493a909f933d2e30eea9: Log is configured to *not* fsync() on all Append() calls
I20260808 14:33:46.285429 15310 tablet_bootstrap.cc:492] T f88ad251f71e403ebfea00d1558ae7af P c223f4b86e4d493a909f933d2e30eea9: No bootstrap required, opened a new log
I20260808 14:33:46.285630 15310 ts_tablet_manager.cc:1397] T f88ad251f71e403ebfea00d1558ae7af P c223f4b86e4d493a909f933d2e30eea9: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260808 14:33:46.286926 15306 raft_consensus.cc:348] T f88ad251f71e403ebfea00d1558ae7af P b9d0b1d9589041b4983a7b331fe163ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } }
I20260808 14:33:46.287226 15306 raft_consensus.cc:374] T f88ad251f71e403ebfea00d1558ae7af P b9d0b1d9589041b4983a7b331fe163ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:33:46.287293 15306 raft_consensus.cc:729] T f88ad251f71e403ebfea00d1558ae7af P b9d0b1d9589041b4983a7b331fe163ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d0b1d9589041b4983a7b331fe163ce, State: Initialized, Role: FOLLOWER
I20260808 14:33:46.287774 15306 consensus_queue.cc:260] T f88ad251f71e403ebfea00d1558ae7af P b9d0b1d9589041b4983a7b331fe163ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } }
I20260808 14:33:46.288163 15307 raft_consensus.cc:348] T f88ad251f71e403ebfea00d1558ae7af P bc8e24f303a54de5b4264d4953b28c91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } }
I20260808 14:33:46.288414 15307 raft_consensus.cc:374] T f88ad251f71e403ebfea00d1558ae7af P bc8e24f303a54de5b4264d4953b28c91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:33:46.288471 15307 raft_consensus.cc:729] T f88ad251f71e403ebfea00d1558ae7af P bc8e24f303a54de5b4264d4953b28c91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc8e24f303a54de5b4264d4953b28c91, State: Initialized, Role: FOLLOWER
I20260808 14:33:46.288848 15306 ts_tablet_manager.cc:1428] T f88ad251f71e403ebfea00d1558ae7af P b9d0b1d9589041b4983a7b331fe163ce: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260808 14:33:46.288888 15307 consensus_queue.cc:260] T f88ad251f71e403ebfea00d1558ae7af P bc8e24f303a54de5b4264d4953b28c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } }
I20260808 14:33:46.289229 15264 heartbeater.cc:503] Master 127.11.131.254:34113 was elected leader, sending a full tablet report...
I20260808 14:33:46.289251 15310 raft_consensus.cc:348] T f88ad251f71e403ebfea00d1558ae7af P c223f4b86e4d493a909f933d2e30eea9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } }
I20260808 14:33:46.289522 15310 raft_consensus.cc:374] T f88ad251f71e403ebfea00d1558ae7af P c223f4b86e4d493a909f933d2e30eea9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:33:46.289582 15310 raft_consensus.cc:729] T f88ad251f71e403ebfea00d1558ae7af P c223f4b86e4d493a909f933d2e30eea9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c223f4b86e4d493a909f933d2e30eea9, State: Initialized, Role: FOLLOWER
I20260808 14:33:46.289855 15307 ts_tablet_manager.cc:1428] T f88ad251f71e403ebfea00d1558ae7af P bc8e24f303a54de5b4264d4953b28c91: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 14:33:46.289983 15310 consensus_queue.cc:260] T f88ad251f71e403ebfea00d1558ae7af P c223f4b86e4d493a909f933d2e30eea9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } }
I20260808 14:33:46.290221 14825 heartbeater.cc:503] Master 127.11.131.254:34113 was elected leader, sending a full tablet report...
I20260808 14:33:46.290900 15310 ts_tablet_manager.cc:1428] T f88ad251f71e403ebfea00d1558ae7af P c223f4b86e4d493a909f933d2e30eea9: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260808 14:33:46.291302 15050 heartbeater.cc:503] Master 127.11.131.254:34113 was elected leader, sending a full tablet report...
I20260808 14:33:46.345099 15314 raft_consensus.cc:482] T f88ad251f71e403ebfea00d1558ae7af P b9d0b1d9589041b4983a7b331fe163ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:33:46.345359 15314 raft_consensus.cc:504] T f88ad251f71e403ebfea00d1558ae7af P b9d0b1d9589041b4983a7b331fe163ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } }
I20260808 14:33:46.346902 15314 leader_election.cc:288] T f88ad251f71e403ebfea00d1558ae7af P b9d0b1d9589041b4983a7b331fe163ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc8e24f303a54de5b4264d4953b28c91 (127.11.131.193:35779), c223f4b86e4d493a909f933d2e30eea9 (127.11.131.194:36771)
I20260808 14:33:46.351341 15305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:46.347661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:48049 (local address 127.11.131.194:36771)
0808 14:33:46.347840 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:46.347845 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:46.347977 (+ 132us) server_negotiation.cc:407] Connection header received
0808 14:33:46.348058 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:46.348062 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:46.348125 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:46.348207 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:33:46.348541 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.349130 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.350224 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.350800 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.350901 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:46.351006 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:46.351175 (+ 169us) server_negotiation.cc:299] Negotiation successful
0808 14:33:46.351236 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260808 14:33:46.351403 15319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:46.347494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.194:36771 (local address 127.11.131.195:48049)
0808 14:33:46.347881 (+ 387us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:46.347893 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:46.347982 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:46.348231 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:46.348233 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:46.348251 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:33:46.348395 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:46.348402 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.349268 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.349271 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:46.350085 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:46.350094 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.350920 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.350924 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:46.351041 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:46.351069 (+ 28us) client_negotiation.cc:769] Sending connection context
0808 14:33:46.351152 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 14:33:46.351226 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":141,"threads_started":1}
I20260808 14:33:46.352011 15100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:46.347159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:35779 (local address 127.11.131.195:43277)
0808 14:33:46.347301 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:46.347318 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:46.347426 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:46.347844 (+ 418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:46.347848 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:46.347875 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:33:46.348035 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:46.348042 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.349034 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.349037 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:46.350516 (+ 1479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:46.350527 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.351603 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.351605 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:46.351717 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:46.351740 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 14:33:46.351827 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 14:33:46.351901 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260808 14:33:46.352083 15298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:46.347257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:43277 (local address 127.11.131.193:35779)
0808 14:33:46.347397 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:46.347400 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:46.347436 (+ 36us) server_negotiation.cc:407] Connection header received
0808 14:33:46.347532 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:46.347538 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:46.347597 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:46.347713 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:33:46.348199 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.348900 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.350699 (+ 1799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.351350 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.351473 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:46.351541 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:46.351886 (+ 345us) server_negotiation.cc:299] Negotiation successful
0808 14:33:46.351972 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 14:33:46.352203 14988 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f88ad251f71e403ebfea00d1558ae7af" candidate_uuid: "b9d0b1d9589041b4983a7b331fe163ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c223f4b86e4d493a909f933d2e30eea9" is_pre_election: true
I20260808 14:33:46.352563 14988 raft_consensus.cc:2454] T f88ad251f71e403ebfea00d1558ae7af P c223f4b86e4d493a909f933d2e30eea9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d0b1d9589041b4983a7b331fe163ce in term 0.
I20260808 14:33:46.352866 14750 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f88ad251f71e403ebfea00d1558ae7af" candidate_uuid: "b9d0b1d9589041b4983a7b331fe163ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc8e24f303a54de5b4264d4953b28c91" is_pre_election: true
I20260808 14:33:46.353099 15095 leader_election.cc:302] T f88ad251f71e403ebfea00d1558ae7af P b9d0b1d9589041b4983a7b331fe163ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d0b1d9589041b4983a7b331fe163ce, c223f4b86e4d493a909f933d2e30eea9; no voters:
I20260808 14:33:46.353168 14750 raft_consensus.cc:2454] T f88ad251f71e403ebfea00d1558ae7af P bc8e24f303a54de5b4264d4953b28c91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d0b1d9589041b4983a7b331fe163ce in term 0.
I20260808 14:33:46.353384 15314 raft_consensus.cc:2781] T f88ad251f71e403ebfea00d1558ae7af P b9d0b1d9589041b4983a7b331fe163ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:33:46.353495 15314 raft_consensus.cc:482] T f88ad251f71e403ebfea00d1558ae7af P b9d0b1d9589041b4983a7b331fe163ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:33:46.353569 15314 raft_consensus.cc:3037] T f88ad251f71e403ebfea00d1558ae7af P b9d0b1d9589041b4983a7b331fe163ce [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:33:46.354888 15314 raft_consensus.cc:504] T f88ad251f71e403ebfea00d1558ae7af P b9d0b1d9589041b4983a7b331fe163ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } }
I20260808 14:33:46.355278 15314 leader_election.cc:288] T f88ad251f71e403ebfea00d1558ae7af P b9d0b1d9589041b4983a7b331fe163ce [CANDIDATE]: Term 1 election: Requested vote from peers bc8e24f303a54de5b4264d4953b28c91 (127.11.131.193:35779), c223f4b86e4d493a909f933d2e30eea9 (127.11.131.194:36771)
I20260808 14:33:46.355674 14988 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f88ad251f71e403ebfea00d1558ae7af" candidate_uuid: "b9d0b1d9589041b4983a7b331fe163ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c223f4b86e4d493a909f933d2e30eea9"
I20260808 14:33:46.355741 14750 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f88ad251f71e403ebfea00d1558ae7af" candidate_uuid: "b9d0b1d9589041b4983a7b331fe163ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc8e24f303a54de5b4264d4953b28c91"
I20260808 14:33:46.355818 14988 raft_consensus.cc:3037] T f88ad251f71e403ebfea00d1558ae7af P c223f4b86e4d493a909f933d2e30eea9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:33:46.355881 14750 raft_consensus.cc:3037] T f88ad251f71e403ebfea00d1558ae7af P bc8e24f303a54de5b4264d4953b28c91 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:33:46.356947 14750 raft_consensus.cc:2454] T f88ad251f71e403ebfea00d1558ae7af P bc8e24f303a54de5b4264d4953b28c91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d0b1d9589041b4983a7b331fe163ce in term 1.
I20260808 14:33:46.356941 14988 raft_consensus.cc:2454] T f88ad251f71e403ebfea00d1558ae7af P c223f4b86e4d493a909f933d2e30eea9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d0b1d9589041b4983a7b331fe163ce in term 1.
I20260808 14:33:46.357264 15095 leader_election.cc:302] T f88ad251f71e403ebfea00d1558ae7af P b9d0b1d9589041b4983a7b331fe163ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d0b1d9589041b4983a7b331fe163ce, bc8e24f303a54de5b4264d4953b28c91; no voters:
I20260808 14:33:46.357430 15314 raft_consensus.cc:2781] T f88ad251f71e403ebfea00d1558ae7af P b9d0b1d9589041b4983a7b331fe163ce [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:33:46.357663 15314 raft_consensus.cc:686] T f88ad251f71e403ebfea00d1558ae7af P b9d0b1d9589041b4983a7b331fe163ce [term 1 LEADER]: Becoming Leader. State: Replica: b9d0b1d9589041b4983a7b331fe163ce, State: Running, Role: LEADER
I20260808 14:33:46.358047 15314 consensus_queue.cc:237] T f88ad251f71e403ebfea00d1558ae7af P b9d0b1d9589041b4983a7b331fe163ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } }
I20260808 14:33:46.361333 14492 catalog_manager.cc:5495] T f88ad251f71e403ebfea00d1558ae7af P b9d0b1d9589041b4983a7b331fe163ce reported cstate change: term changed from 0 to 1, leader changed from <none> to b9d0b1d9589041b4983a7b331fe163ce (127.11.131.195). New cstate: current_term: 1 leader_uuid: "b9d0b1d9589041b4983a7b331fe163ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } health_report { overall_health: HEALTHY } } }
Aug 08 14:33:46 dist-test-slave-twwt krb5kdc[14424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199625, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:33:46.433992 15335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:46.424625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:34113 (local address 127.0.0.1:52354)
0808 14:33:46.424953 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:46.424971 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:46.425091 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:46.425377 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:46.425380 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:46.425766 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:33:46.425881 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:46.425888 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.426959 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.426962 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:46.427509 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:46.427517 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.428090 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.428093 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:46.428195 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:46.428813 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:33:46.428826 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:33:46.430258 (+ 1432us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:33:46.432331 (+ 2073us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:46.432345 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:46.432376 (+ 31us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:46.432704 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:46.432990 (+ 286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:46.432992 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:46.432994 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:46.433074 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:46.433523 (+ 449us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:33:46.433529 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:33:46.433636 (+ 107us) client_negotiation.cc:769] Sending connection context
0808 14:33:46.433733 (+ 97us) client_negotiation.cc:240] Negotiation successful
0808 14:33:46.433855 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243,"mutex_wait_us":29,"thread_start_us":115,"threads_started":1}
I20260808 14:33:46.434113 14577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:46.424734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52354 (local address 127.11.131.254:34113)
0808 14:33:46.424884 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:46.424889 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:46.425062 (+ 173us) server_negotiation.cc:407] Connection header received
0808 14:33:46.425188 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:46.425192 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:46.425242 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:46.425327 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:33:46.425999 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.426860 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.427630 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.427975 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.428075 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:46.430395 (+ 2320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:33:46.430399 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:33:46.430402 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:33:46.430428 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:33:46.432193 (+ 1765us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:46.432801 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:46.432805 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:46.432807 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:46.432897 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:46.433171 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:46.433175 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:46.433177 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:46.433421 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:33:46.433511 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:46.433813 (+ 302us) server_negotiation.cc:299] Negotiation successful
0808 14:33:46.433933 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":52}
I20260808 14:33:46.438503 14492 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:52354:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 14:33:46.439298 14492 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:33:46.444453 14712 tablet_service.cc:1467] Processing CreateTablet for tablet 02cf4295e93f4c769830f65b3101a670 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a68abbb9a49f4210aebe61944eddb742]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 14:33:46.444545 15162 tablet_service.cc:1467] Processing CreateTablet for tablet 02cf4295e93f4c769830f65b3101a670 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a68abbb9a49f4210aebe61944eddb742]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 14:33:46.445262 14712 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02cf4295e93f4c769830f65b3101a670. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:33:46.445325 15162 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02cf4295e93f4c769830f65b3101a670. 1 dirs total, 0 dirs full, 0 dirs failed
W20260808 14:33:46.448379 15266 tablet.cc:2369] T f88ad251f71e403ebfea00d1558ae7af P b9d0b1d9589041b4983a7b331fe163ce: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:33:46.448454 15306 tablet_bootstrap.cc:492] T 02cf4295e93f4c769830f65b3101a670 P b9d0b1d9589041b4983a7b331fe163ce: Bootstrap starting.
I20260808 14:33:46.448446 15307 tablet_bootstrap.cc:492] T 02cf4295e93f4c769830f65b3101a670 P bc8e24f303a54de5b4264d4953b28c91: Bootstrap starting.
I20260808 14:33:46.449355 15306 tablet_bootstrap.cc:654] T 02cf4295e93f4c769830f65b3101a670 P b9d0b1d9589041b4983a7b331fe163ce: Neither blocks nor log segments found. Creating new log.
I20260808 14:33:46.448921 14941 tablet_service.cc:1467] Processing CreateTablet for tablet 02cf4295e93f4c769830f65b3101a670 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=a68abbb9a49f4210aebe61944eddb742]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 14:33:46.449481 15307 tablet_bootstrap.cc:654] T 02cf4295e93f4c769830f65b3101a670 P bc8e24f303a54de5b4264d4953b28c91: Neither blocks nor log segments found. Creating new log.
I20260808 14:33:46.449663 14941 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02cf4295e93f4c769830f65b3101a670. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:33:46.451424 15307 tablet_bootstrap.cc:492] T 02cf4295e93f4c769830f65b3101a670 P bc8e24f303a54de5b4264d4953b28c91: No bootstrap required, opened a new log
I20260808 14:33:46.451522 15307 ts_tablet_manager.cc:1397] T 02cf4295e93f4c769830f65b3101a670 P bc8e24f303a54de5b4264d4953b28c91: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260808 14:33:46.451612 15306 tablet_bootstrap.cc:492] T 02cf4295e93f4c769830f65b3101a670 P b9d0b1d9589041b4983a7b331fe163ce: No bootstrap required, opened a new log
I20260808 14:33:46.451706 15306 ts_tablet_manager.cc:1397] T 02cf4295e93f4c769830f65b3101a670 P b9d0b1d9589041b4983a7b331fe163ce: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 14:33:46.452020 15307 raft_consensus.cc:348] T 02cf4295e93f4c769830f65b3101a670 P bc8e24f303a54de5b4264d4953b28c91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } }
I20260808 14:33:46.452162 15307 raft_consensus.cc:374] T 02cf4295e93f4c769830f65b3101a670 P bc8e24f303a54de5b4264d4953b28c91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:33:46.452106 15306 raft_consensus.cc:348] T 02cf4295e93f4c769830f65b3101a670 P b9d0b1d9589041b4983a7b331fe163ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } }
I20260808 14:33:46.452198 15307 raft_consensus.cc:729] T 02cf4295e93f4c769830f65b3101a670 P bc8e24f303a54de5b4264d4953b28c91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc8e24f303a54de5b4264d4953b28c91, State: Initialized, Role: FOLLOWER
I20260808 14:33:46.452239 15306 raft_consensus.cc:374] T 02cf4295e93f4c769830f65b3101a670 P b9d0b1d9589041b4983a7b331fe163ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:33:46.452282 15306 raft_consensus.cc:729] T 02cf4295e93f4c769830f65b3101a670 P b9d0b1d9589041b4983a7b331fe163ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d0b1d9589041b4983a7b331fe163ce, State: Initialized, Role: FOLLOWER
I20260808 14:33:46.452356 15307 consensus_queue.cc:260] T 02cf4295e93f4c769830f65b3101a670 P bc8e24f303a54de5b4264d4953b28c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } }
I20260808 14:33:46.452425 15306 consensus_queue.cc:260] T 02cf4295e93f4c769830f65b3101a670 P b9d0b1d9589041b4983a7b331fe163ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } }
I20260808 14:33:46.452725 15306 ts_tablet_manager.cc:1428] T 02cf4295e93f4c769830f65b3101a670 P b9d0b1d9589041b4983a7b331fe163ce: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:33:46.452656 15315 tablet_replica.cc:439] T 02cf4295e93f4c769830f65b3101a670 P bc8e24f303a54de5b4264d4953b28c91: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } } }
I20260808 14:33:46.452844 15315 tablet_replica.cc:442] T 02cf4295e93f4c769830f65b3101a670 P bc8e24f303a54de5b4264d4953b28c91: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:33:46.452639 15307 ts_tablet_manager.cc:1428] T 02cf4295e93f4c769830f65b3101a670 P bc8e24f303a54de5b4264d4953b28c91: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:33:46.452940 15314 tablet_replica.cc:439] T 02cf4295e93f4c769830f65b3101a670 P b9d0b1d9589041b4983a7b331fe163ce: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } } }
I20260808 14:33:46.453055 15314 tablet_replica.cc:442] T 02cf4295e93f4c769830f65b3101a670 P b9d0b1d9589041b4983a7b331fe163ce: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:33:46.453476 15310 tablet_bootstrap.cc:492] T 02cf4295e93f4c769830f65b3101a670 P c223f4b86e4d493a909f933d2e30eea9: Bootstrap starting.
I20260808 14:33:46.454873 15310 tablet_bootstrap.cc:654] T 02cf4295e93f4c769830f65b3101a670 P c223f4b86e4d493a909f933d2e30eea9: Neither blocks nor log segments found. Creating new log.
I20260808 14:33:46.456197 15310 tablet_bootstrap.cc:492] T 02cf4295e93f4c769830f65b3101a670 P c223f4b86e4d493a909f933d2e30eea9: No bootstrap required, opened a new log
I20260808 14:33:46.456302 15310 ts_tablet_manager.cc:1397] T 02cf4295e93f4c769830f65b3101a670 P c223f4b86e4d493a909f933d2e30eea9: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 14:33:46.456782 15310 raft_consensus.cc:348] T 02cf4295e93f4c769830f65b3101a670 P c223f4b86e4d493a909f933d2e30eea9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } }
I20260808 14:33:46.456920 15310 raft_consensus.cc:374] T 02cf4295e93f4c769830f65b3101a670 P c223f4b86e4d493a909f933d2e30eea9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:33:46.456967 15310 raft_consensus.cc:729] T 02cf4295e93f4c769830f65b3101a670 P c223f4b86e4d493a909f933d2e30eea9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c223f4b86e4d493a909f933d2e30eea9, State: Initialized, Role: FOLLOWER
I20260808 14:33:46.457108 15310 consensus_queue.cc:260] T 02cf4295e93f4c769830f65b3101a670 P c223f4b86e4d493a909f933d2e30eea9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } }
I20260808 14:33:46.457350 15310 ts_tablet_manager.cc:1428] T 02cf4295e93f4c769830f65b3101a670 P c223f4b86e4d493a909f933d2e30eea9: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260808 14:33:46.457392 15316 tablet_replica.cc:439] T 02cf4295e93f4c769830f65b3101a670 P c223f4b86e4d493a909f933d2e30eea9: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } } }
I20260808 14:33:46.457538 15316 tablet_replica.cc:442] T 02cf4295e93f4c769830f65b3101a670 P c223f4b86e4d493a909f933d2e30eea9: This TxnStatusTablet replica's current role is: FOLLOWER
W20260808 14:33:46.463831 15052 tablet.cc:2369] T 02cf4295e93f4c769830f65b3101a670 P c223f4b86e4d493a909f933d2e30eea9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:33:46.480659 14826 tablet.cc:2369] T 02cf4295e93f4c769830f65b3101a670 P bc8e24f303a54de5b4264d4953b28c91: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:33:46.702132 15315 raft_consensus.cc:482] T 02cf4295e93f4c769830f65b3101a670 P bc8e24f303a54de5b4264d4953b28c91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:33:46.702332 15315 raft_consensus.cc:504] T 02cf4295e93f4c769830f65b3101a670 P bc8e24f303a54de5b4264d4953b28c91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } }
I20260808 14:33:46.703861 15315 leader_election.cc:288] T 02cf4295e93f4c769830f65b3101a670 P bc8e24f303a54de5b4264d4953b28c91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c223f4b86e4d493a909f933d2e30eea9 (127.11.131.194:36771), b9d0b1d9589041b4983a7b331fe163ce (127.11.131.195:41581)
I20260808 14:33:46.708742 15305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:46.704227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:44359 (local address 127.11.131.194:36771)
0808 14:33:46.704397 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:46.704403 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:46.704698 (+ 295us) server_negotiation.cc:407] Connection header received
0808 14:33:46.704871 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:46.704877 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:46.704942 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:46.705024 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:33:46.705424 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.706191 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.707559 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.708121 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.708216 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:46.708261 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:46.708525 (+ 264us) server_negotiation.cc:299] Negotiation successful
0808 14:33:46.708587 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260808 14:33:46.708761 15343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:46.704143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.194:36771 (local address 127.11.131.193:44359)
0808 14:33:46.704577 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:46.704592 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:46.704719 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:46.705070 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:46.705073 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:46.705089 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:33:46.705272 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:46.705282 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.706319 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.706322 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:46.707426 (+ 1104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:46.707436 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.708273 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.708277 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:46.708385 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:46.708414 (+ 29us) client_negotiation.cc:769] Sending connection context
0808 14:33:46.708497 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 14:33:46.708568 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":368,"thread_start_us":156,"threads_started":1}
I20260808 14:33:46.709304 15304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:46.704266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:57805 (local address 127.11.131.195:41581)
0808 14:33:46.704428 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:46.704433 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:46.704783 (+ 350us) server_negotiation.cc:407] Connection header received
0808 14:33:46.705036 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:46.705048 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:46.705112 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:46.705206 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:33:46.706081 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.706890 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.708013 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.708572 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.708685 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:46.708792 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:46.709110 (+ 318us) server_negotiation.cc:299] Negotiation successful
0808 14:33:46.709210 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 14:33:46.709306 15347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:46.704161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.195:41581 (local address 127.11.131.193:57805)
0808 14:33:46.704687 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:46.704703 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:46.704847 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:46.705231 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:46.705233 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:46.705249 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:33:46.705925 (+ 676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:46.705936 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.707004 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.707006 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:46.707882 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:46.707893 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.708691 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.708694 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:46.708800 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:46.708991 (+ 191us) client_negotiation.cc:769] Sending connection context
0808 14:33:46.709071 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 14:33:46.709145 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":438,"thread_start_us":149,"threads_started":1}
I20260808 14:33:46.709336 14988 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02cf4295e93f4c769830f65b3101a670" candidate_uuid: "bc8e24f303a54de5b4264d4953b28c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c223f4b86e4d493a909f933d2e30eea9" is_pre_election: true
I20260808 14:33:46.709499 14988 raft_consensus.cc:2454] T 02cf4295e93f4c769830f65b3101a670 P c223f4b86e4d493a909f933d2e30eea9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc8e24f303a54de5b4264d4953b28c91 in term 0.
I20260808 14:33:46.709897 14646 leader_election.cc:302] T 02cf4295e93f4c769830f65b3101a670 P bc8e24f303a54de5b4264d4953b28c91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc8e24f303a54de5b4264d4953b28c91, c223f4b86e4d493a909f933d2e30eea9; no voters:
I20260808 14:33:46.709920 15194 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02cf4295e93f4c769830f65b3101a670" candidate_uuid: "bc8e24f303a54de5b4264d4953b28c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d0b1d9589041b4983a7b331fe163ce" is_pre_election: true
I20260808 14:33:46.710216 15315 raft_consensus.cc:2781] T 02cf4295e93f4c769830f65b3101a670 P bc8e24f303a54de5b4264d4953b28c91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:33:46.710216 15194 raft_consensus.cc:2454] T 02cf4295e93f4c769830f65b3101a670 P b9d0b1d9589041b4983a7b331fe163ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc8e24f303a54de5b4264d4953b28c91 in term 0.
I20260808 14:33:46.710295 15315 raft_consensus.cc:482] T 02cf4295e93f4c769830f65b3101a670 P bc8e24f303a54de5b4264d4953b28c91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:33:46.710335 15315 raft_consensus.cc:3037] T 02cf4295e93f4c769830f65b3101a670 P bc8e24f303a54de5b4264d4953b28c91 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:33:46.711457 15315 raft_consensus.cc:504] T 02cf4295e93f4c769830f65b3101a670 P bc8e24f303a54de5b4264d4953b28c91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } }
I20260808 14:33:46.711786 15315 leader_election.cc:288] T 02cf4295e93f4c769830f65b3101a670 P bc8e24f303a54de5b4264d4953b28c91 [CANDIDATE]: Term 1 election: Requested vote from peers c223f4b86e4d493a909f933d2e30eea9 (127.11.131.194:36771), b9d0b1d9589041b4983a7b331fe163ce (127.11.131.195:41581)
I20260808 14:33:46.712146 15194 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02cf4295e93f4c769830f65b3101a670" candidate_uuid: "bc8e24f303a54de5b4264d4953b28c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d0b1d9589041b4983a7b331fe163ce"
I20260808 14:33:46.712185 14988 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02cf4295e93f4c769830f65b3101a670" candidate_uuid: "bc8e24f303a54de5b4264d4953b28c91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c223f4b86e4d493a909f933d2e30eea9"
I20260808 14:33:46.712283 15194 raft_consensus.cc:3037] T 02cf4295e93f4c769830f65b3101a670 P b9d0b1d9589041b4983a7b331fe163ce [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:33:46.712318 14988 raft_consensus.cc:3037] T 02cf4295e93f4c769830f65b3101a670 P c223f4b86e4d493a909f933d2e30eea9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:33:46.713320 15194 raft_consensus.cc:2454] T 02cf4295e93f4c769830f65b3101a670 P b9d0b1d9589041b4983a7b331fe163ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc8e24f303a54de5b4264d4953b28c91 in term 1.
I20260808 14:33:46.713331 14988 raft_consensus.cc:2454] T 02cf4295e93f4c769830f65b3101a670 P c223f4b86e4d493a909f933d2e30eea9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc8e24f303a54de5b4264d4953b28c91 in term 1.
I20260808 14:33:46.713626 14642 leader_election.cc:302] T 02cf4295e93f4c769830f65b3101a670 P bc8e24f303a54de5b4264d4953b28c91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d0b1d9589041b4983a7b331fe163ce, bc8e24f303a54de5b4264d4953b28c91; no voters:
I20260808 14:33:46.713816 15315 raft_consensus.cc:2781] T 02cf4295e93f4c769830f65b3101a670 P bc8e24f303a54de5b4264d4953b28c91 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:33:46.714031 15315 raft_consensus.cc:686] T 02cf4295e93f4c769830f65b3101a670 P bc8e24f303a54de5b4264d4953b28c91 [term 1 LEADER]: Becoming Leader. State: Replica: bc8e24f303a54de5b4264d4953b28c91, State: Running, Role: LEADER
I20260808 14:33:46.714393 15315 consensus_queue.cc:237] T 02cf4295e93f4c769830f65b3101a670 P bc8e24f303a54de5b4264d4953b28c91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } }
I20260808 14:33:46.716935 15349 tablet_replica.cc:439] T 02cf4295e93f4c769830f65b3101a670 P bc8e24f303a54de5b4264d4953b28c91: TxnStatusTablet state changed. Reason: New leader bc8e24f303a54de5b4264d4953b28c91. Latest consensus state: current_term: 1 leader_uuid: "bc8e24f303a54de5b4264d4953b28c91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } } }
I20260808 14:33:46.717063 15349 tablet_replica.cc:442] T 02cf4295e93f4c769830f65b3101a670 P bc8e24f303a54de5b4264d4953b28c91: This TxnStatusTablet replica's current role is: LEADER
I20260808 14:33:46.717314 15351 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 14:33:46.717530 15351 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 14:33:46.718231 14492 catalog_manager.cc:5495] T 02cf4295e93f4c769830f65b3101a670 P bc8e24f303a54de5b4264d4953b28c91 reported cstate change: term changed from 0 to 1, leader changed from <none> to bc8e24f303a54de5b4264d4953b28c91 (127.11.131.193). New cstate: current_term: 1 leader_uuid: "bc8e24f303a54de5b4264d4953b28c91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } health_report { overall_health: UNKNOWN } } }
I20260808 14:33:46.747416 15335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:46.743081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:35779 (local address 127.0.0.1:39226)
0808 14:33:46.743276 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:46.743300 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:46.743403 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:46.744000 (+ 597us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:46.744004 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:46.744013 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:33:46.744129 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:46.744135 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.744874 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.744878 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:46.745493 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:46.745502 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.746013 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.746017 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:46.746116 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:46.746164 (+ 48us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:33:46.747073 (+ 909us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:33:46.747087 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 14:33:46.747170 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 14:33:46.747263 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":74}
I20260808 14:33:46.747417 15298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:46.743563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39226 (local address 127.11.131.193:35779)
0808 14:33:46.743721 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:46.743725 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:46.743737 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:33:46.743806 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:46.743808 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:46.743867 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:46.743981 (+ 114us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:33:46.744243 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.744751 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.745627 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.745901 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.746010 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:46.746326 (+ 316us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:33:46.746906 (+ 580us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:33:46.747035 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:46.747185 (+ 150us) server_negotiation.cc:299] Negotiation successful
0808 14:33:46.747240 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 14:33:46.752921 14988 raft_consensus.cc:1261] T 02cf4295e93f4c769830f65b3101a670 P c223f4b86e4d493a909f933d2e30eea9 [term 1 FOLLOWER]: Refusing update from remote peer bc8e24f303a54de5b4264d4953b28c91: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:33:46.752938 15194 raft_consensus.cc:1261] T 02cf4295e93f4c769830f65b3101a670 P b9d0b1d9589041b4983a7b331fe163ce [term 1 FOLLOWER]: Refusing update from remote peer bc8e24f303a54de5b4264d4953b28c91: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:33:46.753621 15315 consensus_queue.cc:1035] T 02cf4295e93f4c769830f65b3101a670 P bc8e24f303a54de5b4264d4953b28c91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:33:46.753816 15349 consensus_queue.cc:1035] T 02cf4295e93f4c769830f65b3101a670 P bc8e24f303a54de5b4264d4953b28c91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:33:46.756968 15314 tablet_replica.cc:439] T 02cf4295e93f4c769830f65b3101a670 P b9d0b1d9589041b4983a7b331fe163ce: TxnStatusTablet state changed. Reason: New leader bc8e24f303a54de5b4264d4953b28c91. Latest consensus state: current_term: 1 leader_uuid: "bc8e24f303a54de5b4264d4953b28c91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } } }
I20260808 14:33:46.757089 15314 tablet_replica.cc:442] T 02cf4295e93f4c769830f65b3101a670 P b9d0b1d9589041b4983a7b331fe163ce: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:33:46.757892 15316 tablet_replica.cc:439] T 02cf4295e93f4c769830f65b3101a670 P c223f4b86e4d493a909f933d2e30eea9: TxnStatusTablet state changed. Reason: New leader bc8e24f303a54de5b4264d4953b28c91. Latest consensus state: current_term: 1 leader_uuid: "bc8e24f303a54de5b4264d4953b28c91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } } }
I20260808 14:33:46.758029 15316 tablet_replica.cc:442] T 02cf4295e93f4c769830f65b3101a670 P c223f4b86e4d493a909f933d2e30eea9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:33:46.761334 15315 tablet_replica.cc:439] T 02cf4295e93f4c769830f65b3101a670 P bc8e24f303a54de5b4264d4953b28c91: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "bc8e24f303a54de5b4264d4953b28c91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } } }
I20260808 14:33:46.761456 15315 tablet_replica.cc:442] T 02cf4295e93f4c769830f65b3101a670 P bc8e24f303a54de5b4264d4953b28c91: This TxnStatusTablet replica's current role is: LEADER
I20260808 14:33:46.761802 15315 tablet_replica.cc:439] T 02cf4295e93f4c769830f65b3101a670 P bc8e24f303a54de5b4264d4953b28c91: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "bc8e24f303a54de5b4264d4953b28c91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } } }
I20260808 14:33:46.761924 15315 tablet_replica.cc:442] T 02cf4295e93f4c769830f65b3101a670 P bc8e24f303a54de5b4264d4953b28c91: This TxnStatusTablet replica's current role is: LEADER
I20260808 14:33:46.763742 15356 mvcc.cc:205] Tried to move back new op lower bound from 7316273671172366336 to 7316273671025459200. Current Snapshot: MvccSnapshot[applied={T|T < 7316273671172366336}]
I20260808 14:33:46.764217 15314 tablet_replica.cc:439] T 02cf4295e93f4c769830f65b3101a670 P b9d0b1d9589041b4983a7b331fe163ce: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "bc8e24f303a54de5b4264d4953b28c91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } } }
I20260808 14:33:46.764343 15314 tablet_replica.cc:442] T 02cf4295e93f4c769830f65b3101a670 P b9d0b1d9589041b4983a7b331fe163ce: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:33:46.764828 15360 mvcc.cc:205] Tried to move back new op lower bound from 7316273671172366336 to 7316273671025459200. Current Snapshot: MvccSnapshot[applied={T|T < 7316273671172366336}]
I20260808 14:33:46.765277 15316 tablet_replica.cc:439] T 02cf4295e93f4c769830f65b3101a670 P c223f4b86e4d493a909f933d2e30eea9: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "bc8e24f303a54de5b4264d4953b28c91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } } }
I20260808 14:33:46.765410 15316 tablet_replica.cc:442] T 02cf4295e93f4c769830f65b3101a670 P c223f4b86e4d493a909f933d2e30eea9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:33:46.777107 15304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:46.772440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34110 (local address 127.11.131.195:41581)
0808 14:33:46.772568 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:46.772572 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:46.772840 (+ 268us) server_negotiation.cc:407] Connection header received
0808 14:33:46.773005 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:46.773007 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:46.773064 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:46.773148 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:33:46.773441 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.773950 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.775204 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.775571 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.775693 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:46.776225 (+ 532us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:33:46.776689 (+ 464us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:33:46.776827 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:46.776898 (+ 71us) server_negotiation.cc:299] Negotiation successful
0808 14:33:46.776956 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 14:33:46.789403 15298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:46.785426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:48411 (local address 127.11.131.193:35779)
0808 14:33:46.785563 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:46.785570 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:46.785732 (+ 162us) server_negotiation.cc:407] Connection header received
0808 14:33:46.785893 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:46.785895 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:46.785945 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:46.786003 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:33:46.786306 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.786997 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.788299 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.788520 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.788601 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:46.788980 (+ 379us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:33:46.789051 (+ 71us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:33:46.789104 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:46.789230 (+ 126us) server_negotiation.cc:299] Negotiation successful
0808 14:33:46.789278 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 14:33:46.789475 15372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:46.785261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:35779 (local address 127.11.131.195:48411)
0808 14:33:46.785634 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:46.785651 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:46.785774 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:46.786039 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:46.786042 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:46.786050 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:33:46.786182 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:46.786187 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.787116 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.787119 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:46.788156 (+ 1037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:46.788168 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.788660 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.788665 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:46.788761 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:46.788819 (+ 58us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:33:46.789136 (+ 317us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:33:46.789143 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 14:33:46.789218 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 14:33:46.789302 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":151,"threads_started":1}
I20260808 14:33:46.797123 14988 raft_consensus.cc:1261] T f88ad251f71e403ebfea00d1558ae7af P c223f4b86e4d493a909f933d2e30eea9 [term 1 FOLLOWER]: Refusing update from remote peer b9d0b1d9589041b4983a7b331fe163ce: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:33:46.797274 14750 raft_consensus.cc:1261] T f88ad251f71e403ebfea00d1558ae7af P bc8e24f303a54de5b4264d4953b28c91 [term 1 FOLLOWER]: Refusing update from remote peer b9d0b1d9589041b4983a7b331fe163ce: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:33:46.797725 15323 consensus_queue.cc:1035] T f88ad251f71e403ebfea00d1558ae7af P b9d0b1d9589041b4983a7b331fe163ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:33:46.798148 15314 consensus_queue.cc:1035] T f88ad251f71e403ebfea00d1558ae7af P b9d0b1d9589041b4983a7b331fe163ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:33:46.801744 15357 mvcc.cc:205] Tried to move back new op lower bound from 7316273671356481536 to 7316273669565734912. Current Snapshot: MvccSnapshot[applied={T|T < 7316273671356481536}]
I20260808 14:33:46.822903 15304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:46.817445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:47115 (local address 127.11.131.195:41581)
0808 14:33:46.817552 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:46.817559 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:46.818922 (+ 1363us) server_negotiation.cc:407] Connection header received
0808 14:33:46.819141 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:46.819145 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:46.819207 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:46.819273 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:33:46.819573 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.820385 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.821663 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.821892 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.821979 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:46.822373 (+ 394us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:33:46.822464 (+ 91us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:33:46.822561 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:46.822687 (+ 126us) server_negotiation.cc:299] Negotiation successful
0808 14:33:46.822748 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 14:33:46.822937 15381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:46.816861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.195:41581 (local address 127.11.131.193:47115)
0808 14:33:46.818825 (+ 1964us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:46.818842 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:46.819004 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:46.819307 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:46.819310 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:46.819317 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:33:46.819441 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:46.819446 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.820529 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.820533 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:46.821532 (+ 999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:46.821542 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:46.822014 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:46.822018 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:46.822105 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:46.822167 (+ 62us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:33:46.822564 (+ 397us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:33:46.822572 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 14:33:46.822674 (+ 102us) client_negotiation.cc:240] Negotiation successful
0808 14:33:46.822773 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1828,"thread_start_us":111,"threads_started":1}
I20260808 14:33:46.851719 14492 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52346:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:33:46.851935 14492 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52346:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:33:46.854969 14492 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 786c26e1617949c4b9eb62f3e31153d5: Sending DeleteTablet for 3 replicas of tablet f88ad251f71e403ebfea00d1558ae7af
I20260808 14:33:46.855924 15162 tablet_service.cc:1514] Processing DeleteTablet for tablet f88ad251f71e403ebfea00d1558ae7af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:33:46 UTC) from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:34102
I20260808 14:33:46.856063 14941 tablet_service.cc:1514] Processing DeleteTablet for tablet f88ad251f71e403ebfea00d1558ae7af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:33:46 UTC) from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:44008
I20260808 14:33:46.856773 14712 tablet_service.cc:1514] Processing DeleteTablet for tablet f88ad251f71e403ebfea00d1558ae7af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:33:46 UTC) from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:39224
I20260808 14:33:46.857400 15388 tablet_replica.cc:330] T f88ad251f71e403ebfea00d1558ae7af P c223f4b86e4d493a909f933d2e30eea9: stopping tablet replica
I20260808 14:33:46.857357 14492 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52346:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 14:33:46.857762 15388 raft_consensus.cc:2229] T f88ad251f71e403ebfea00d1558ae7af P c223f4b86e4d493a909f933d2e30eea9 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260808 14:33:46.857784 14492 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:33:46.858004 15388 raft_consensus.cc:2258] T f88ad251f71e403ebfea00d1558ae7af P c223f4b86e4d493a909f933d2e30eea9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:33:46.859584 15388 ts_tablet_manager.cc:1905] T f88ad251f71e403ebfea00d1558ae7af P c223f4b86e4d493a909f933d2e30eea9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:33:46.863183 14941 tablet_service.cc:1467] Processing CreateTablet for tablet d844185a25824006be37d5c98516960f (DEFAULT_TABLE table=test-table [id=bf7227e3b26c4d2e8d19a8a31e0203f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:33:46.863200 14712 tablet_service.cc:1467] Processing CreateTablet for tablet d844185a25824006be37d5c98516960f (DEFAULT_TABLE table=test-table [id=bf7227e3b26c4d2e8d19a8a31e0203f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:33:46.863474 14941 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d844185a25824006be37d5c98516960f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:33:46.863498 14712 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d844185a25824006be37d5c98516960f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:33:46.865931 15307 tablet_bootstrap.cc:492] T d844185a25824006be37d5c98516960f P bc8e24f303a54de5b4264d4953b28c91: Bootstrap starting.
I20260808 14:33:46.865945 15310 tablet_bootstrap.cc:492] T d844185a25824006be37d5c98516960f P c223f4b86e4d493a909f933d2e30eea9: Bootstrap starting.
I20260808 14:33:46.867022 15310 tablet_bootstrap.cc:654] T d844185a25824006be37d5c98516960f P c223f4b86e4d493a909f933d2e30eea9: Neither blocks nor log segments found. Creating new log.
I20260808 14:33:46.867091 15307 tablet_bootstrap.cc:654] T d844185a25824006be37d5c98516960f P bc8e24f303a54de5b4264d4953b28c91: Neither blocks nor log segments found. Creating new log.
I20260808 14:33:46.867074 15162 tablet_service.cc:1467] Processing CreateTablet for tablet d844185a25824006be37d5c98516960f (DEFAULT_TABLE table=test-table [id=bf7227e3b26c4d2e8d19a8a31e0203f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:33:46.867368 15162 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d844185a25824006be37d5c98516960f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:33:46.867920 15388 ts_tablet_manager.cc:1918] T f88ad251f71e403ebfea00d1558ae7af P c223f4b86e4d493a909f933d2e30eea9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:33:46.868029 15388 log.cc:1196] T f88ad251f71e403ebfea00d1558ae7af P c223f4b86e4d493a909f933d2e30eea9: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-1/wal/wals/f88ad251f71e403ebfea00d1558ae7af
I20260808 14:33:46.868395 15388 ts_tablet_manager.cc:1939] T f88ad251f71e403ebfea00d1558ae7af P c223f4b86e4d493a909f933d2e30eea9: Deleting consensus metadata
I20260808 14:33:46.869817 15306 tablet_bootstrap.cc:492] T d844185a25824006be37d5c98516960f P b9d0b1d9589041b4983a7b331fe163ce: Bootstrap starting.
I20260808 14:33:46.870857 15306 tablet_bootstrap.cc:654] T d844185a25824006be37d5c98516960f P b9d0b1d9589041b4983a7b331fe163ce: Neither blocks nor log segments found. Creating new log.
I20260808 14:33:46.871654 15387 tablet_replica.cc:330] T f88ad251f71e403ebfea00d1558ae7af P b9d0b1d9589041b4983a7b331fe163ce: stopping tablet replica
I20260808 14:33:46.871906 14472 catalog_manager.cc:4841] TS c223f4b86e4d493a909f933d2e30eea9 (127.11.131.194:36771): tablet f88ad251f71e403ebfea00d1558ae7af (table test-table [id=a3f4c5aaf472476a8ff0a177b34626da]) successfully deleted
I20260808 14:33:46.872119 15387 raft_consensus.cc:2229] T f88ad251f71e403ebfea00d1558ae7af P b9d0b1d9589041b4983a7b331fe163ce [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:33:46.872555 15387 raft_consensus.cc:2258] T f88ad251f71e403ebfea00d1558ae7af P b9d0b1d9589041b4983a7b331fe163ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:33:46.872970 15306 tablet_bootstrap.cc:492] T d844185a25824006be37d5c98516960f P b9d0b1d9589041b4983a7b331fe163ce: No bootstrap required, opened a new log
I20260808 14:33:46.873067 15306 ts_tablet_manager.cc:1397] T d844185a25824006be37d5c98516960f P b9d0b1d9589041b4983a7b331fe163ce: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 14:33:46.873571 15306 raft_consensus.cc:348] T d844185a25824006be37d5c98516960f P b9d0b1d9589041b4983a7b331fe163ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } }
I20260808 14:33:46.873714 15306 raft_consensus.cc:374] T d844185a25824006be37d5c98516960f P b9d0b1d9589041b4983a7b331fe163ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:33:46.873761 15306 raft_consensus.cc:729] T d844185a25824006be37d5c98516960f P b9d0b1d9589041b4983a7b331fe163ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d0b1d9589041b4983a7b331fe163ce, State: Initialized, Role: FOLLOWER
I20260808 14:33:46.873896 15306 consensus_queue.cc:260] T d844185a25824006be37d5c98516960f P b9d0b1d9589041b4983a7b331fe163ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } }
I20260808 14:33:46.874212 15306 ts_tablet_manager.cc:1428] T d844185a25824006be37d5c98516960f P b9d0b1d9589041b4983a7b331fe163ce: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260808 14:33:46.874465 15389 tablet_replica.cc:330] T f88ad251f71e403ebfea00d1558ae7af P bc8e24f303a54de5b4264d4953b28c91: stopping tablet replica
I20260808 14:33:46.875416 15310 tablet_bootstrap.cc:492] T d844185a25824006be37d5c98516960f P c223f4b86e4d493a909f933d2e30eea9: No bootstrap required, opened a new log
I20260808 14:33:46.875545 15310 ts_tablet_manager.cc:1397] T d844185a25824006be37d5c98516960f P c223f4b86e4d493a909f933d2e30eea9: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20260808 14:33:46.876061 15310 raft_consensus.cc:348] T d844185a25824006be37d5c98516960f P c223f4b86e4d493a909f933d2e30eea9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } }
I20260808 14:33:46.876204 15310 raft_consensus.cc:374] T d844185a25824006be37d5c98516960f P c223f4b86e4d493a909f933d2e30eea9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:33:46.876255 15310 raft_consensus.cc:729] T d844185a25824006be37d5c98516960f P c223f4b86e4d493a909f933d2e30eea9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c223f4b86e4d493a909f933d2e30eea9, State: Initialized, Role: FOLLOWER
I20260808 14:33:46.876391 15310 consensus_queue.cc:260] T d844185a25824006be37d5c98516960f P c223f4b86e4d493a909f933d2e30eea9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } }
I20260808 14:33:46.876500 15389 raft_consensus.cc:2229] T f88ad251f71e403ebfea00d1558ae7af P bc8e24f303a54de5b4264d4953b28c91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:33:46.876688 15389 raft_consensus.cc:2258] T f88ad251f71e403ebfea00d1558ae7af P bc8e24f303a54de5b4264d4953b28c91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:33:46.876694 15310 ts_tablet_manager.cc:1428] T d844185a25824006be37d5c98516960f P c223f4b86e4d493a909f933d2e30eea9: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260808 14:33:46.876972 15387 ts_tablet_manager.cc:1905] T f88ad251f71e403ebfea00d1558ae7af P b9d0b1d9589041b4983a7b331fe163ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:33:46.877496 15307 tablet_bootstrap.cc:492] T d844185a25824006be37d5c98516960f P bc8e24f303a54de5b4264d4953b28c91: No bootstrap required, opened a new log
I20260808 14:33:46.877593 15307 ts_tablet_manager.cc:1397] T d844185a25824006be37d5c98516960f P bc8e24f303a54de5b4264d4953b28c91: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20260808 14:33:46.878051 15307 raft_consensus.cc:348] T d844185a25824006be37d5c98516960f P bc8e24f303a54de5b4264d4953b28c91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } }
I20260808 14:33:46.878160 15307 raft_consensus.cc:374] T d844185a25824006be37d5c98516960f P bc8e24f303a54de5b4264d4953b28c91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:33:46.878193 15307 raft_consensus.cc:729] T d844185a25824006be37d5c98516960f P bc8e24f303a54de5b4264d4953b28c91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc8e24f303a54de5b4264d4953b28c91, State: Initialized, Role: FOLLOWER
I20260808 14:33:46.878324 15307 consensus_queue.cc:260] T d844185a25824006be37d5c98516960f P bc8e24f303a54de5b4264d4953b28c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } }
I20260808 14:33:46.878575 15307 ts_tablet_manager.cc:1428] T d844185a25824006be37d5c98516960f P bc8e24f303a54de5b4264d4953b28c91: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:33:46.880154 15387 ts_tablet_manager.cc:1918] T f88ad251f71e403ebfea00d1558ae7af P b9d0b1d9589041b4983a7b331fe163ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:33:46.880153 15389 ts_tablet_manager.cc:1905] T f88ad251f71e403ebfea00d1558ae7af P bc8e24f303a54de5b4264d4953b28c91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:33:46.880270 15387 log.cc:1196] T f88ad251f71e403ebfea00d1558ae7af P b9d0b1d9589041b4983a7b331fe163ce: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-2/wal/wals/f88ad251f71e403ebfea00d1558ae7af
I20260808 14:33:46.880628 15387 ts_tablet_manager.cc:1939] T f88ad251f71e403ebfea00d1558ae7af P b9d0b1d9589041b4983a7b331fe163ce: Deleting consensus metadata
I20260808 14:33:46.881856 14468 catalog_manager.cc:4841] TS b9d0b1d9589041b4983a7b331fe163ce (127.11.131.195:41581): tablet f88ad251f71e403ebfea00d1558ae7af (table test-table [id=a3f4c5aaf472476a8ff0a177b34626da]) successfully deleted
I20260808 14:33:46.884140 15389 ts_tablet_manager.cc:1918] T f88ad251f71e403ebfea00d1558ae7af P bc8e24f303a54de5b4264d4953b28c91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:33:46.884315 15389 log.cc:1196] T f88ad251f71e403ebfea00d1558ae7af P bc8e24f303a54de5b4264d4953b28c91: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-0/wal/wals/f88ad251f71e403ebfea00d1558ae7af
I20260808 14:33:46.884676 15389 ts_tablet_manager.cc:1939] T f88ad251f71e403ebfea00d1558ae7af P bc8e24f303a54de5b4264d4953b28c91: Deleting consensus metadata
I20260808 14:33:46.885936 14472 catalog_manager.cc:4841] TS bc8e24f303a54de5b4264d4953b28c91 (127.11.131.193:35779): tablet f88ad251f71e403ebfea00d1558ae7af (table test-table [id=a3f4c5aaf472476a8ff0a177b34626da]) successfully deleted
I20260808 14:33:46.913776 15323 raft_consensus.cc:482] T d844185a25824006be37d5c98516960f P b9d0b1d9589041b4983a7b331fe163ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:33:46.913942 15323 raft_consensus.cc:504] T d844185a25824006be37d5c98516960f P b9d0b1d9589041b4983a7b331fe163ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } }
I20260808 14:33:46.914418 15323 leader_election.cc:288] T d844185a25824006be37d5c98516960f P b9d0b1d9589041b4983a7b331fe163ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc8e24f303a54de5b4264d4953b28c91 (127.11.131.193:35779), c223f4b86e4d493a909f933d2e30eea9 (127.11.131.194:36771)
I20260808 14:33:46.914918 14988 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d844185a25824006be37d5c98516960f" candidate_uuid: "b9d0b1d9589041b4983a7b331fe163ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c223f4b86e4d493a909f933d2e30eea9" is_pre_election: true
I20260808 14:33:46.914930 14750 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d844185a25824006be37d5c98516960f" candidate_uuid: "b9d0b1d9589041b4983a7b331fe163ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc8e24f303a54de5b4264d4953b28c91" is_pre_election: true
I20260808 14:33:46.915099 14750 raft_consensus.cc:2454] T d844185a25824006be37d5c98516960f P bc8e24f303a54de5b4264d4953b28c91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d0b1d9589041b4983a7b331fe163ce in term 0.
I20260808 14:33:46.915098 14988 raft_consensus.cc:2454] T d844185a25824006be37d5c98516960f P c223f4b86e4d493a909f933d2e30eea9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d0b1d9589041b4983a7b331fe163ce in term 0.
I20260808 14:33:46.915432 15095 leader_election.cc:302] T d844185a25824006be37d5c98516960f P b9d0b1d9589041b4983a7b331fe163ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d0b1d9589041b4983a7b331fe163ce, c223f4b86e4d493a909f933d2e30eea9; no voters:
I20260808 14:33:46.915637 15323 raft_consensus.cc:2781] T d844185a25824006be37d5c98516960f P b9d0b1d9589041b4983a7b331fe163ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:33:46.915705 15323 raft_consensus.cc:482] T d844185a25824006be37d5c98516960f P b9d0b1d9589041b4983a7b331fe163ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:33:46.915757 15323 raft_consensus.cc:3037] T d844185a25824006be37d5c98516960f P b9d0b1d9589041b4983a7b331fe163ce [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:33:46.917259 15323 raft_consensus.cc:504] T d844185a25824006be37d5c98516960f P b9d0b1d9589041b4983a7b331fe163ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } }
I20260808 14:33:46.917644 15323 leader_election.cc:288] T d844185a25824006be37d5c98516960f P b9d0b1d9589041b4983a7b331fe163ce [CANDIDATE]: Term 1 election: Requested vote from peers bc8e24f303a54de5b4264d4953b28c91 (127.11.131.193:35779), c223f4b86e4d493a909f933d2e30eea9 (127.11.131.194:36771)
I20260808 14:33:46.918035 14750 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d844185a25824006be37d5c98516960f" candidate_uuid: "b9d0b1d9589041b4983a7b331fe163ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc8e24f303a54de5b4264d4953b28c91"
I20260808 14:33:46.918081 14988 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d844185a25824006be37d5c98516960f" candidate_uuid: "b9d0b1d9589041b4983a7b331fe163ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c223f4b86e4d493a909f933d2e30eea9"
I20260808 14:33:46.918195 14750 raft_consensus.cc:3037] T d844185a25824006be37d5c98516960f P bc8e24f303a54de5b4264d4953b28c91 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:33:46.918205 14988 raft_consensus.cc:3037] T d844185a25824006be37d5c98516960f P c223f4b86e4d493a909f933d2e30eea9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:33:46.919251 14750 raft_consensus.cc:2454] T d844185a25824006be37d5c98516960f P bc8e24f303a54de5b4264d4953b28c91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d0b1d9589041b4983a7b331fe163ce in term 1.
I20260808 14:33:46.919502 14988 raft_consensus.cc:2454] T d844185a25824006be37d5c98516960f P c223f4b86e4d493a909f933d2e30eea9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d0b1d9589041b4983a7b331fe163ce in term 1.
I20260808 14:33:46.919560 15095 leader_election.cc:302] T d844185a25824006be37d5c98516960f P b9d0b1d9589041b4983a7b331fe163ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d0b1d9589041b4983a7b331fe163ce, bc8e24f303a54de5b4264d4953b28c91; no voters:
I20260808 14:33:46.919739 15323 raft_consensus.cc:2781] T d844185a25824006be37d5c98516960f P b9d0b1d9589041b4983a7b331fe163ce [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:33:46.919832 15323 raft_consensus.cc:686] T d844185a25824006be37d5c98516960f P b9d0b1d9589041b4983a7b331fe163ce [term 1 LEADER]: Becoming Leader. State: Replica: b9d0b1d9589041b4983a7b331fe163ce, State: Running, Role: LEADER
I20260808 14:33:46.919981 15323 consensus_queue.cc:237] T d844185a25824006be37d5c98516960f P b9d0b1d9589041b4983a7b331fe163ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } }
I20260808 14:33:46.921792 14492 catalog_manager.cc:5495] T d844185a25824006be37d5c98516960f P b9d0b1d9589041b4983a7b331fe163ce reported cstate change: term changed from 0 to 1, leader changed from <none> to b9d0b1d9589041b4983a7b331fe163ce (127.11.131.195). New cstate: current_term: 1 leader_uuid: "b9d0b1d9589041b4983a7b331fe163ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } health_report { overall_health: HEALTHY } } }
I20260808 14:33:46.953042 14988 raft_consensus.cc:1261] T d844185a25824006be37d5c98516960f P c223f4b86e4d493a909f933d2e30eea9 [term 1 FOLLOWER]: Refusing update from remote peer b9d0b1d9589041b4983a7b331fe163ce: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:33:46.953121 14750 raft_consensus.cc:1261] T d844185a25824006be37d5c98516960f P bc8e24f303a54de5b4264d4953b28c91 [term 1 FOLLOWER]: Refusing update from remote peer b9d0b1d9589041b4983a7b331fe163ce: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:33:46.953464 15314 consensus_queue.cc:1035] T d844185a25824006be37d5c98516960f P b9d0b1d9589041b4983a7b331fe163ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:33:46.953956 15323 consensus_queue.cc:1035] T d844185a25824006be37d5c98516960f P b9d0b1d9589041b4983a7b331fe163ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 14:33:46.971954 15360 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 14:33:48.534884 14493 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52346:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:33:48.535066 14493 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52346:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:33:48.537343 14493 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 786c26e1617949c4b9eb62f3e31153d5: Sending DeleteTablet for 3 replicas of tablet d844185a25824006be37d5c98516960f
I20260808 14:33:48.537917 14712 tablet_service.cc:1514] Processing DeleteTablet for tablet d844185a25824006be37d5c98516960f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:33:48 UTC) from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:39224
I20260808 14:33:48.538010 14941 tablet_service.cc:1514] Processing DeleteTablet for tablet d844185a25824006be37d5c98516960f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:33:48 UTC) from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:44008
I20260808 14:33:48.538224 15162 tablet_service.cc:1514] Processing DeleteTablet for tablet d844185a25824006be37d5c98516960f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:33:48 UTC) from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:34102
I20260808 14:33:48.538435 15435 tablet_replica.cc:330] T d844185a25824006be37d5c98516960f P c223f4b86e4d493a909f933d2e30eea9: stopping tablet replica
I20260808 14:33:48.538591 15435 raft_consensus.cc:2229] T d844185a25824006be37d5c98516960f P c223f4b86e4d493a909f933d2e30eea9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:33:48.538746 15435 raft_consensus.cc:2258] T d844185a25824006be37d5c98516960f P c223f4b86e4d493a909f933d2e30eea9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:33:48.539343 15435 ts_tablet_manager.cc:1905] T d844185a25824006be37d5c98516960f P c223f4b86e4d493a909f933d2e30eea9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:33:48.540766 15436 tablet_replica.cc:330] T d844185a25824006be37d5c98516960f P b9d0b1d9589041b4983a7b331fe163ce: stopping tablet replica
I20260808 14:33:48.540935 15436 raft_consensus.cc:2229] T d844185a25824006be37d5c98516960f P b9d0b1d9589041b4983a7b331fe163ce [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:33:48.541397 15436 raft_consensus.cc:2258] T d844185a25824006be37d5c98516960f P b9d0b1d9589041b4983a7b331fe163ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:33:48.542012 15434 tablet_replica.cc:330] T d844185a25824006be37d5c98516960f P bc8e24f303a54de5b4264d4953b28c91: stopping tablet replica
I20260808 14:33:48.542148 15434 raft_consensus.cc:2229] T d844185a25824006be37d5c98516960f P bc8e24f303a54de5b4264d4953b28c91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:33:48.542161 15436 ts_tablet_manager.cc:1905] T d844185a25824006be37d5c98516960f P b9d0b1d9589041b4983a7b331fe163ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:33:48.542268 15434 raft_consensus.cc:2258] T d844185a25824006be37d5c98516960f P bc8e24f303a54de5b4264d4953b28c91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:33:48.542439 15435 ts_tablet_manager.cc:1918] T d844185a25824006be37d5c98516960f P c223f4b86e4d493a909f933d2e30eea9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 14:33:48.542529 15435 log.cc:1196] T d844185a25824006be37d5c98516960f P c223f4b86e4d493a909f933d2e30eea9: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-1/wal/wals/d844185a25824006be37d5c98516960f
I20260808 14:33:48.542873 15435 ts_tablet_manager.cc:1939] T d844185a25824006be37d5c98516960f P c223f4b86e4d493a909f933d2e30eea9: Deleting consensus metadata
I20260808 14:33:48.543092 15434 ts_tablet_manager.cc:1905] T d844185a25824006be37d5c98516960f P bc8e24f303a54de5b4264d4953b28c91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:33:48.543533 14472 catalog_manager.cc:4841] TS c223f4b86e4d493a909f933d2e30eea9 (127.11.131.194:36771): tablet d844185a25824006be37d5c98516960f (table test-table [id=bf7227e3b26c4d2e8d19a8a31e0203f3]) successfully deleted
I20260808 14:33:48.545656 15434 ts_tablet_manager.cc:1918] T d844185a25824006be37d5c98516960f P bc8e24f303a54de5b4264d4953b28c91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 14:33:48.545702 15436 ts_tablet_manager.cc:1918] T d844185a25824006be37d5c98516960f P b9d0b1d9589041b4983a7b331fe163ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 14:33:48.545755 15434 log.cc:1196] T d844185a25824006be37d5c98516960f P bc8e24f303a54de5b4264d4953b28c91: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-0/wal/wals/d844185a25824006be37d5c98516960f
I20260808 14:33:48.545815 15436 log.cc:1196] T d844185a25824006be37d5c98516960f P b9d0b1d9589041b4983a7b331fe163ce: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-2/wal/wals/d844185a25824006be37d5c98516960f
I20260808 14:33:48.546077 15434 ts_tablet_manager.cc:1939] T d844185a25824006be37d5c98516960f P bc8e24f303a54de5b4264d4953b28c91: Deleting consensus metadata
I20260808 14:33:48.546188 15436 ts_tablet_manager.cc:1939] T d844185a25824006be37d5c98516960f P b9d0b1d9589041b4983a7b331fe163ce: Deleting consensus metadata
I20260808 14:33:48.547211 14472 catalog_manager.cc:4841] TS bc8e24f303a54de5b4264d4953b28c91 (127.11.131.193:35779): tablet d844185a25824006be37d5c98516960f (table test-table [id=bf7227e3b26c4d2e8d19a8a31e0203f3]) successfully deleted
I20260808 14:33:48.547241 14468 catalog_manager.cc:4841] TS b9d0b1d9589041b4983a7b331fe163ce (127.11.131.195:41581): tablet d844185a25824006be37d5c98516960f (table test-table [id=bf7227e3b26c4d2e8d19a8a31e0203f3]) successfully deleted
Aug 08 14:33:48 dist-test-slave-twwt krb5kdc[14424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199628, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 14:33:48 dist-test-slave-twwt krb5kdc[14424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199628, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:33:48.569708 15448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:48.560207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52356 (local address 127.11.131.254:34113)
0808 14:33:48.560518 (+ 311us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:48.560529 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:48.560550 (+ 21us) server_negotiation.cc:407] Connection header received
0808 14:33:48.560678 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:48.560682 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:48.560741 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:48.560843 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:33:48.561616 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:48.562182 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:48.563196 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:48.563450 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:48.563537 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:48.566113 (+ 2576us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:33:48.566117 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:33:48.566119 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:33:48.566145 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:33:48.567807 (+ 1662us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:48.568206 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:48.568209 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:48.568210 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:48.568296 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:48.568640 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:48.568643 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:48.568644 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:48.568847 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:33:48.568987 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:48.569379 (+ 392us) server_negotiation.cc:299] Negotiation successful
0808 14:33:48.569567 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":206,"thread_start_us":119,"threads_started":1}
I20260808 14:33:48.572578 14493 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52356:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:33:48.573027 14493 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:33:48.577783 14712 tablet_service.cc:1467] Processing CreateTablet for tablet fb10978f75cc4eb0aabc8aa194b3ca1d (DEFAULT_TABLE table=test-table [id=d100d7c4b337471998d627ab985c972e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:33:48.577904 14941 tablet_service.cc:1467] Processing CreateTablet for tablet fb10978f75cc4eb0aabc8aa194b3ca1d (DEFAULT_TABLE table=test-table [id=d100d7c4b337471998d627ab985c972e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:33:48.578181 14712 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb10978f75cc4eb0aabc8aa194b3ca1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:33:48.578264 14941 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb10978f75cc4eb0aabc8aa194b3ca1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:33:48.580407 15449 tablet_bootstrap.cc:492] T fb10978f75cc4eb0aabc8aa194b3ca1d P c223f4b86e4d493a909f933d2e30eea9: Bootstrap starting.
I20260808 14:33:48.580417 15451 tablet_bootstrap.cc:492] T fb10978f75cc4eb0aabc8aa194b3ca1d P bc8e24f303a54de5b4264d4953b28c91: Bootstrap starting.
I20260808 14:33:48.580856 15162 tablet_service.cc:1467] Processing CreateTablet for tablet fb10978f75cc4eb0aabc8aa194b3ca1d (DEFAULT_TABLE table=test-table [id=d100d7c4b337471998d627ab985c972e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:33:48.581147 15162 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb10978f75cc4eb0aabc8aa194b3ca1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:33:48.581343 15451 tablet_bootstrap.cc:654] T fb10978f75cc4eb0aabc8aa194b3ca1d P bc8e24f303a54de5b4264d4953b28c91: Neither blocks nor log segments found. Creating new log.
I20260808 14:33:48.582034 15449 tablet_bootstrap.cc:654] T fb10978f75cc4eb0aabc8aa194b3ca1d P c223f4b86e4d493a909f933d2e30eea9: Neither blocks nor log segments found. Creating new log.
I20260808 14:33:48.582789 15451 tablet_bootstrap.cc:492] T fb10978f75cc4eb0aabc8aa194b3ca1d P bc8e24f303a54de5b4264d4953b28c91: No bootstrap required, opened a new log
I20260808 14:33:48.582901 15451 ts_tablet_manager.cc:1397] T fb10978f75cc4eb0aabc8aa194b3ca1d P bc8e24f303a54de5b4264d4953b28c91: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 14:33:48.583333 15451 raft_consensus.cc:348] T fb10978f75cc4eb0aabc8aa194b3ca1d P bc8e24f303a54de5b4264d4953b28c91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } }
I20260808 14:33:48.583477 15451 raft_consensus.cc:374] T fb10978f75cc4eb0aabc8aa194b3ca1d P bc8e24f303a54de5b4264d4953b28c91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:33:48.583513 15451 raft_consensus.cc:729] T fb10978f75cc4eb0aabc8aa194b3ca1d P bc8e24f303a54de5b4264d4953b28c91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc8e24f303a54de5b4264d4953b28c91, State: Initialized, Role: FOLLOWER
I20260808 14:33:48.583644 15451 consensus_queue.cc:260] T fb10978f75cc4eb0aabc8aa194b3ca1d P bc8e24f303a54de5b4264d4953b28c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } }
I20260808 14:33:48.583936 15449 tablet_bootstrap.cc:492] T fb10978f75cc4eb0aabc8aa194b3ca1d P c223f4b86e4d493a909f933d2e30eea9: No bootstrap required, opened a new log
I20260808 14:33:48.583966 15451 ts_tablet_manager.cc:1428] T fb10978f75cc4eb0aabc8aa194b3ca1d P bc8e24f303a54de5b4264d4953b28c91: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:33:48.584018 15449 ts_tablet_manager.cc:1397] T fb10978f75cc4eb0aabc8aa194b3ca1d P c223f4b86e4d493a909f933d2e30eea9: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260808 14:33:48.584213 15456 tablet_bootstrap.cc:492] T fb10978f75cc4eb0aabc8aa194b3ca1d P b9d0b1d9589041b4983a7b331fe163ce: Bootstrap starting.
I20260808 14:33:48.584460 15449 raft_consensus.cc:348] T fb10978f75cc4eb0aabc8aa194b3ca1d P c223f4b86e4d493a909f933d2e30eea9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } }
I20260808 14:33:48.584582 15449 raft_consensus.cc:374] T fb10978f75cc4eb0aabc8aa194b3ca1d P c223f4b86e4d493a909f933d2e30eea9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:33:48.584619 15449 raft_consensus.cc:729] T fb10978f75cc4eb0aabc8aa194b3ca1d P c223f4b86e4d493a909f933d2e30eea9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c223f4b86e4d493a909f933d2e30eea9, State: Initialized, Role: FOLLOWER
I20260808 14:33:48.584784 15449 consensus_queue.cc:260] T fb10978f75cc4eb0aabc8aa194b3ca1d P c223f4b86e4d493a909f933d2e30eea9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } }
I20260808 14:33:48.585171 15456 tablet_bootstrap.cc:654] T fb10978f75cc4eb0aabc8aa194b3ca1d P b9d0b1d9589041b4983a7b331fe163ce: Neither blocks nor log segments found. Creating new log.
I20260808 14:33:48.585188 15449 ts_tablet_manager.cc:1428] T fb10978f75cc4eb0aabc8aa194b3ca1d P c223f4b86e4d493a909f933d2e30eea9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:33:48.586479 15456 tablet_bootstrap.cc:492] T fb10978f75cc4eb0aabc8aa194b3ca1d P b9d0b1d9589041b4983a7b331fe163ce: No bootstrap required, opened a new log
I20260808 14:33:48.586570 15456 ts_tablet_manager.cc:1397] T fb10978f75cc4eb0aabc8aa194b3ca1d P b9d0b1d9589041b4983a7b331fe163ce: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 14:33:48.587050 15456 raft_consensus.cc:348] T fb10978f75cc4eb0aabc8aa194b3ca1d P b9d0b1d9589041b4983a7b331fe163ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } }
I20260808 14:33:48.587173 15456 raft_consensus.cc:374] T fb10978f75cc4eb0aabc8aa194b3ca1d P b9d0b1d9589041b4983a7b331fe163ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:33:48.587208 15456 raft_consensus.cc:729] T fb10978f75cc4eb0aabc8aa194b3ca1d P b9d0b1d9589041b4983a7b331fe163ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d0b1d9589041b4983a7b331fe163ce, State: Initialized, Role: FOLLOWER
I20260808 14:33:48.587328 15456 consensus_queue.cc:260] T fb10978f75cc4eb0aabc8aa194b3ca1d P b9d0b1d9589041b4983a7b331fe163ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } }
I20260808 14:33:48.587591 15456 ts_tablet_manager.cc:1428] T fb10978f75cc4eb0aabc8aa194b3ca1d P b9d0b1d9589041b4983a7b331fe163ce: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260808 14:33:48.654424 15457 raft_consensus.cc:482] T fb10978f75cc4eb0aabc8aa194b3ca1d P c223f4b86e4d493a909f933d2e30eea9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:33:48.654582 15457 raft_consensus.cc:504] T fb10978f75cc4eb0aabc8aa194b3ca1d P c223f4b86e4d493a909f933d2e30eea9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } }
I20260808 14:33:48.655776 15457 leader_election.cc:288] T fb10978f75cc4eb0aabc8aa194b3ca1d P c223f4b86e4d493a909f933d2e30eea9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc8e24f303a54de5b4264d4953b28c91 (127.11.131.193:35779), b9d0b1d9589041b4983a7b331fe163ce (127.11.131.195:41581)
I20260808 14:33:48.660383 15461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:48.656052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.195:41581 (local address 127.11.131.194:37909)
0808 14:33:48.656522 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:48.656540 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:48.656665 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:48.656942 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:48.656945 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:48.656972 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:33:48.657107 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:48.657112 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:48.657869 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:48.657872 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:48.659159 (+ 1287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:48.659169 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:48.659906 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:48.659910 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:48.660017 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:48.660040 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 14:33:48.660138 (+ 98us) client_negotiation.cc:240] Negotiation successful
0808 14:33:48.660211 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":398,"mutex_wait_us":27,"spinlock_wait_cycles":768,"thread_start_us":170,"threads_started":1}
I20260808 14:33:48.660379 15463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:48.656148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:37909 (local address 127.11.131.195:41581)
0808 14:33:48.656461 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:48.656471 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:48.656622 (+ 151us) server_negotiation.cc:407] Connection header received
0808 14:33:48.656788 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:48.656790 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:48.656832 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:48.656931 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:33:48.657218 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:48.657734 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:48.659286 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:48.659754 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:48.659908 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:48.659968 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:48.660158 (+ 190us) server_negotiation.cc:299] Negotiation successful
0808 14:33:48.660232 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":230,"thread_start_us":99,"threads_started":1}
I20260808 14:33:48.660426 15466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:48.656146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:40289 (local address 127.11.131.193:35779)
0808 14:33:48.656485 (+ 339us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:48.656496 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:48.656565 (+ 69us) server_negotiation.cc:407] Connection header received
0808 14:33:48.656745 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:48.656748 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:48.656795 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:48.656886 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:33:48.657193 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:48.657723 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:48.659299 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:48.659851 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:48.659985 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:48.660038 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:48.660230 (+ 192us) server_negotiation.cc:299] Negotiation successful
0808 14:33:48.660309 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":267,"thread_start_us":115,"threads_started":1}
I20260808 14:33:48.660822 15194 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb10978f75cc4eb0aabc8aa194b3ca1d" candidate_uuid: "c223f4b86e4d493a909f933d2e30eea9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d0b1d9589041b4983a7b331fe163ce" is_pre_election: true
I20260808 14:33:48.660990 15194 raft_consensus.cc:2454] T fb10978f75cc4eb0aabc8aa194b3ca1d P b9d0b1d9589041b4983a7b331fe163ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c223f4b86e4d493a909f933d2e30eea9 in term 0.
I20260808 14:33:48.661044 15460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:48.656018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:35779 (local address 127.11.131.194:40289)
0808 14:33:48.656460 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:48.656476 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:48.656621 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:48.656900 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:48.656903 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:48.656919 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:33:48.657079 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:48.657086 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:48.657840 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:48.657844 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:48.659174 (+ 1330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:48.659184 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:48.659991 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:48.659995 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:48.660094 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:48.660116 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 14:33:48.660212 (+ 96us) client_negotiation.cc:240] Negotiation successful
0808 14:33:48.660286 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":365,"mutex_wait_us":86,"thread_start_us":193,"threads_started":1}
I20260808 14:33:48.661413 14867 leader_election.cc:302] T fb10978f75cc4eb0aabc8aa194b3ca1d P c223f4b86e4d493a909f933d2e30eea9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d0b1d9589041b4983a7b331fe163ce, c223f4b86e4d493a909f933d2e30eea9; no voters:
I20260808 14:33:48.661608 14750 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb10978f75cc4eb0aabc8aa194b3ca1d" candidate_uuid: "c223f4b86e4d493a909f933d2e30eea9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc8e24f303a54de5b4264d4953b28c91" is_pre_election: true
I20260808 14:33:48.661695 15457 raft_consensus.cc:2781] T fb10978f75cc4eb0aabc8aa194b3ca1d P c223f4b86e4d493a909f933d2e30eea9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:33:48.661767 15457 raft_consensus.cc:482] T fb10978f75cc4eb0aabc8aa194b3ca1d P c223f4b86e4d493a909f933d2e30eea9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:33:48.661767 14750 raft_consensus.cc:2454] T fb10978f75cc4eb0aabc8aa194b3ca1d P bc8e24f303a54de5b4264d4953b28c91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c223f4b86e4d493a909f933d2e30eea9 in term 0.
I20260808 14:33:48.661816 15457 raft_consensus.cc:3037] T fb10978f75cc4eb0aabc8aa194b3ca1d P c223f4b86e4d493a909f933d2e30eea9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:33:48.662897 15457 raft_consensus.cc:504] T fb10978f75cc4eb0aabc8aa194b3ca1d P c223f4b86e4d493a909f933d2e30eea9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } }
I20260808 14:33:48.663268 15457 leader_election.cc:288] T fb10978f75cc4eb0aabc8aa194b3ca1d P c223f4b86e4d493a909f933d2e30eea9 [CANDIDATE]: Term 1 election: Requested vote from peers bc8e24f303a54de5b4264d4953b28c91 (127.11.131.193:35779), b9d0b1d9589041b4983a7b331fe163ce (127.11.131.195:41581)
I20260808 14:33:48.663622 14750 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb10978f75cc4eb0aabc8aa194b3ca1d" candidate_uuid: "c223f4b86e4d493a909f933d2e30eea9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc8e24f303a54de5b4264d4953b28c91"
I20260808 14:33:48.663610 15194 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb10978f75cc4eb0aabc8aa194b3ca1d" candidate_uuid: "c223f4b86e4d493a909f933d2e30eea9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9d0b1d9589041b4983a7b331fe163ce"
I20260808 14:33:48.663735 15194 raft_consensus.cc:3037] T fb10978f75cc4eb0aabc8aa194b3ca1d P b9d0b1d9589041b4983a7b331fe163ce [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:33:48.663743 14750 raft_consensus.cc:3037] T fb10978f75cc4eb0aabc8aa194b3ca1d P bc8e24f303a54de5b4264d4953b28c91 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:33:48.664824 15194 raft_consensus.cc:2454] T fb10978f75cc4eb0aabc8aa194b3ca1d P b9d0b1d9589041b4983a7b331fe163ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c223f4b86e4d493a909f933d2e30eea9 in term 1.
I20260808 14:33:48.664825 14750 raft_consensus.cc:2454] T fb10978f75cc4eb0aabc8aa194b3ca1d P bc8e24f303a54de5b4264d4953b28c91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c223f4b86e4d493a909f933d2e30eea9 in term 1.
I20260808 14:33:48.665118 14867 leader_election.cc:302] T fb10978f75cc4eb0aabc8aa194b3ca1d P c223f4b86e4d493a909f933d2e30eea9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d0b1d9589041b4983a7b331fe163ce, c223f4b86e4d493a909f933d2e30eea9; no voters:
I20260808 14:33:48.665300 15457 raft_consensus.cc:2781] T fb10978f75cc4eb0aabc8aa194b3ca1d P c223f4b86e4d493a909f933d2e30eea9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:33:48.665517 15457 raft_consensus.cc:686] T fb10978f75cc4eb0aabc8aa194b3ca1d P c223f4b86e4d493a909f933d2e30eea9 [term 1 LEADER]: Becoming Leader. State: Replica: c223f4b86e4d493a909f933d2e30eea9, State: Running, Role: LEADER
I20260808 14:33:48.665766 15457 consensus_queue.cc:237] T fb10978f75cc4eb0aabc8aa194b3ca1d P c223f4b86e4d493a909f933d2e30eea9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } }
I20260808 14:33:48.668036 14493 catalog_manager.cc:5495] T fb10978f75cc4eb0aabc8aa194b3ca1d P c223f4b86e4d493a909f933d2e30eea9 reported cstate change: term changed from 0 to 1, leader changed from <none> to c223f4b86e4d493a909f933d2e30eea9 (127.11.131.194). New cstate: current_term: 1 leader_uuid: "c223f4b86e4d493a909f933d2e30eea9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } health_report { overall_health: UNKNOWN } } }
I20260808 14:33:48.691417 15471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:48.687504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44010 (local address 127.11.131.194:36771)
0808 14:33:48.687795 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:48.687803 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:48.687815 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:33:48.687888 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:48.687890 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:48.687941 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:48.688045 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:33:48.688280 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:48.688920 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:48.689838 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:48.690064 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:48.690153 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:48.690413 (+ 260us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:33:48.690964 (+ 551us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:33:48.691064 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:48.691156 (+ 92us) server_negotiation.cc:299] Negotiation successful
0808 14:33:48.691204 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":201,"thread_start_us":107,"threads_started":1}
I20260808 14:33:48.702034 15466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:48.698948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:43883 (local address 127.11.131.193:35779)
0808 14:33:48.699078 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:48.699082 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:48.699226 (+ 144us) server_negotiation.cc:407] Connection header received
0808 14:33:48.699324 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:48.699326 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:48.699372 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:48.699436 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:33:48.699680 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:48.700195 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:48.701093 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:48.701314 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:48.701395 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:48.701672 (+ 277us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:33:48.701738 (+ 66us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:33:48.701797 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:48.701881 (+ 84us) server_negotiation.cc:299] Negotiation successful
0808 14:33:48.701924 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 14:33:48.702090 15476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:48.698815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:35779 (local address 127.11.131.194:43883)
0808 14:33:48.699148 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:48.699161 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:48.699252 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:48.699475 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:48.699478 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:48.699485 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:33:48.699585 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:48.699590 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:48.700285 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:48.700287 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:48.700977 (+ 690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:48.700986 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:48.701436 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:48.701439 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:48.701508 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:48.701555 (+ 47us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:33:48.701818 (+ 263us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:33:48.701823 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:33:48.701874 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 14:33:48.701940 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":119,"threads_started":1}
I20260808 14:33:48.708664 15194 raft_consensus.cc:1261] T fb10978f75cc4eb0aabc8aa194b3ca1d P b9d0b1d9589041b4983a7b331fe163ce [term 1 FOLLOWER]: Refusing update from remote peer c223f4b86e4d493a909f933d2e30eea9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:33:48.708639 14750 raft_consensus.cc:1261] T fb10978f75cc4eb0aabc8aa194b3ca1d P bc8e24f303a54de5b4264d4953b28c91 [term 1 FOLLOWER]: Refusing update from remote peer c223f4b86e4d493a909f933d2e30eea9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:33:48.709158 15468 consensus_queue.cc:1035] T fb10978f75cc4eb0aabc8aa194b3ca1d P c223f4b86e4d493a909f933d2e30eea9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:33:48.709360 15457 consensus_queue.cc:1035] T fb10978f75cc4eb0aabc8aa194b3ca1d P c223f4b86e4d493a909f933d2e30eea9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:33:48.727412 15471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:48.724011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:51009 (local address 127.11.131.194:36771)
0808 14:33:48.724143 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:48.724150 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:48.724369 (+ 219us) server_negotiation.cc:407] Connection header received
0808 14:33:48.724502 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:48.724505 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:48.724560 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:48.724618 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:33:48.724815 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:48.725305 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:48.726153 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:48.726462 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:48.726545 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:48.726904 (+ 359us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:33:48.726991 (+ 87us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:33:48.727074 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:48.727204 (+ 130us) server_negotiation.cc:299] Negotiation successful
0808 14:33:48.727258 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 14:33:48.727417 15486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:48.723973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.194:36771 (local address 127.11.131.193:51009)
0808 14:33:48.724251 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:48.724281 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:48.724404 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:48.724639 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:48.724642 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:48.724648 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:33:48.724743 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:48.724747 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:48.725393 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:48.725395 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:48.726050 (+ 655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:48.726061 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:48.726595 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:48.726598 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:48.726713 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:48.726741 (+ 28us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:33:48.727097 (+ 356us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:33:48.727104 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 14:33:48.727184 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 14:33:48.727272 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":118,"threads_started":1}
I20260808 14:33:48.748951 14495 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52356:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:33:48.749133 14495 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52356:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:33:48.751431 14495 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 786c26e1617949c4b9eb62f3e31153d5: Sending DeleteTablet for 3 replicas of tablet fb10978f75cc4eb0aabc8aa194b3ca1d
I20260808 14:33:48.752286 14941 tablet_service.cc:1514] Processing DeleteTablet for tablet fb10978f75cc4eb0aabc8aa194b3ca1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:33:48 UTC) from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:44008
I20260808 14:33:48.752305 15162 tablet_service.cc:1514] Processing DeleteTablet for tablet fb10978f75cc4eb0aabc8aa194b3ca1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:33:48 UTC) from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:34102
I20260808 14:33:48.752527 15436 tablet_replica.cc:330] T fb10978f75cc4eb0aabc8aa194b3ca1d P b9d0b1d9589041b4983a7b331fe163ce: stopping tablet replica
I20260808 14:33:48.752647 15435 tablet_replica.cc:330] T fb10978f75cc4eb0aabc8aa194b3ca1d P c223f4b86e4d493a909f933d2e30eea9: stopping tablet replica
I20260808 14:33:48.752660 15436 raft_consensus.cc:2229] T fb10978f75cc4eb0aabc8aa194b3ca1d P b9d0b1d9589041b4983a7b331fe163ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:33:48.752810 15436 raft_consensus.cc:2258] T fb10978f75cc4eb0aabc8aa194b3ca1d P b9d0b1d9589041b4983a7b331fe163ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:33:48.752806 15435 raft_consensus.cc:2229] T fb10978f75cc4eb0aabc8aa194b3ca1d P c223f4b86e4d493a909f933d2e30eea9 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:33:48.753119 15435 raft_consensus.cc:2258] T fb10978f75cc4eb0aabc8aa194b3ca1d P c223f4b86e4d493a909f933d2e30eea9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:33:48.753508 14712 tablet_service.cc:1514] Processing DeleteTablet for tablet fb10978f75cc4eb0aabc8aa194b3ca1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:33:48 UTC) from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:39224
I20260808 14:33:48.753679 15436 ts_tablet_manager.cc:1905] T fb10978f75cc4eb0aabc8aa194b3ca1d P b9d0b1d9589041b4983a7b331fe163ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:33:48.753707 15434 tablet_replica.cc:330] T fb10978f75cc4eb0aabc8aa194b3ca1d P bc8e24f303a54de5b4264d4953b28c91: stopping tablet replica
I20260808 14:33:48.753835 15434 raft_consensus.cc:2229] T fb10978f75cc4eb0aabc8aa194b3ca1d P bc8e24f303a54de5b4264d4953b28c91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:33:48.753906 15435 ts_tablet_manager.cc:1905] T fb10978f75cc4eb0aabc8aa194b3ca1d P c223f4b86e4d493a909f933d2e30eea9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:33:48.753949 15434 raft_consensus.cc:2258] T fb10978f75cc4eb0aabc8aa194b3ca1d P bc8e24f303a54de5b4264d4953b28c91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:33:48.754635 14495 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52356:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:33:48.755096 14495 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:33:48.756575 15436 ts_tablet_manager.cc:1918] T fb10978f75cc4eb0aabc8aa194b3ca1d P b9d0b1d9589041b4983a7b331fe163ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:33:48.756654 15436 log.cc:1196] T fb10978f75cc4eb0aabc8aa194b3ca1d P b9d0b1d9589041b4983a7b331fe163ce: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-2/wal/wals/fb10978f75cc4eb0aabc8aa194b3ca1d
I20260808 14:33:48.756922 15436 ts_tablet_manager.cc:1939] T fb10978f75cc4eb0aabc8aa194b3ca1d P b9d0b1d9589041b4983a7b331fe163ce: Deleting consensus metadata
I20260808 14:33:48.757269 15434 ts_tablet_manager.cc:1905] T fb10978f75cc4eb0aabc8aa194b3ca1d P bc8e24f303a54de5b4264d4953b28c91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:33:48.757670 14468 catalog_manager.cc:4841] TS b9d0b1d9589041b4983a7b331fe163ce (127.11.131.195:41581): tablet fb10978f75cc4eb0aabc8aa194b3ca1d (table test-table [id=d100d7c4b337471998d627ab985c972e]) successfully deleted
I20260808 14:33:48.758975 15435 ts_tablet_manager.cc:1918] T fb10978f75cc4eb0aabc8aa194b3ca1d P c223f4b86e4d493a909f933d2e30eea9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:33:48.759130 15435 log.cc:1196] T fb10978f75cc4eb0aabc8aa194b3ca1d P c223f4b86e4d493a909f933d2e30eea9: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-1/wal/wals/fb10978f75cc4eb0aabc8aa194b3ca1d
I20260808 14:33:48.759497 15435 ts_tablet_manager.cc:1939] T fb10978f75cc4eb0aabc8aa194b3ca1d P c223f4b86e4d493a909f933d2e30eea9: Deleting consensus metadata
I20260808 14:33:48.760309 15434 ts_tablet_manager.cc:1918] T fb10978f75cc4eb0aabc8aa194b3ca1d P bc8e24f303a54de5b4264d4953b28c91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:33:48.760398 15434 log.cc:1196] T fb10978f75cc4eb0aabc8aa194b3ca1d P bc8e24f303a54de5b4264d4953b28c91: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-0/wal/wals/fb10978f75cc4eb0aabc8aa194b3ca1d
I20260808 14:33:48.760596 14472 catalog_manager.cc:4841] TS c223f4b86e4d493a909f933d2e30eea9 (127.11.131.194:36771): tablet fb10978f75cc4eb0aabc8aa194b3ca1d (table test-table [id=d100d7c4b337471998d627ab985c972e]) successfully deleted
I20260808 14:33:48.760665 15434 ts_tablet_manager.cc:1939] T fb10978f75cc4eb0aabc8aa194b3ca1d P bc8e24f303a54de5b4264d4953b28c91: Deleting consensus metadata
I20260808 14:33:48.761132 14941 tablet_service.cc:1467] Processing CreateTablet for tablet 8d55f1f379cf4253980832122ea73095 (DEFAULT_TABLE table=test-table [id=c86de6203a274b3fbc9eb0054797c6ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:33:48.761430 14941 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d55f1f379cf4253980832122ea73095. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:33:48.763113 15162 tablet_service.cc:1467] Processing CreateTablet for tablet 8d55f1f379cf4253980832122ea73095 (DEFAULT_TABLE table=test-table [id=c86de6203a274b3fbc9eb0054797c6ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:33:48.763459 15162 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d55f1f379cf4253980832122ea73095. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:33:48.763487 14472 catalog_manager.cc:4841] TS bc8e24f303a54de5b4264d4953b28c91 (127.11.131.193:35779): tablet fb10978f75cc4eb0aabc8aa194b3ca1d (table test-table [id=d100d7c4b337471998d627ab985c972e]) successfully deleted
I20260808 14:33:48.763931 15449 tablet_bootstrap.cc:492] T 8d55f1f379cf4253980832122ea73095 P c223f4b86e4d493a909f933d2e30eea9: Bootstrap starting.
I20260808 14:33:48.764971 15449 tablet_bootstrap.cc:654] T 8d55f1f379cf4253980832122ea73095 P c223f4b86e4d493a909f933d2e30eea9: Neither blocks nor log segments found. Creating new log.
I20260808 14:33:48.766075 15456 tablet_bootstrap.cc:492] T 8d55f1f379cf4253980832122ea73095 P b9d0b1d9589041b4983a7b331fe163ce: Bootstrap starting.
I20260808 14:33:48.766306 14712 tablet_service.cc:1467] Processing CreateTablet for tablet 8d55f1f379cf4253980832122ea73095 (DEFAULT_TABLE table=test-table [id=c86de6203a274b3fbc9eb0054797c6ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:33:48.766583 14712 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d55f1f379cf4253980832122ea73095. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:33:48.766749 15449 tablet_bootstrap.cc:492] T 8d55f1f379cf4253980832122ea73095 P c223f4b86e4d493a909f933d2e30eea9: No bootstrap required, opened a new log
I20260808 14:33:48.766840 15449 ts_tablet_manager.cc:1397] T 8d55f1f379cf4253980832122ea73095 P c223f4b86e4d493a909f933d2e30eea9: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 14:33:48.766947 15456 tablet_bootstrap.cc:654] T 8d55f1f379cf4253980832122ea73095 P b9d0b1d9589041b4983a7b331fe163ce: Neither blocks nor log segments found. Creating new log.
I20260808 14:33:48.767320 15449 raft_consensus.cc:348] T 8d55f1f379cf4253980832122ea73095 P c223f4b86e4d493a909f933d2e30eea9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } }
I20260808 14:33:48.767428 15449 raft_consensus.cc:374] T 8d55f1f379cf4253980832122ea73095 P c223f4b86e4d493a909f933d2e30eea9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:33:48.767457 15449 raft_consensus.cc:729] T 8d55f1f379cf4253980832122ea73095 P c223f4b86e4d493a909f933d2e30eea9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c223f4b86e4d493a909f933d2e30eea9, State: Initialized, Role: FOLLOWER
I20260808 14:33:48.767584 15449 consensus_queue.cc:260] T 8d55f1f379cf4253980832122ea73095 P c223f4b86e4d493a909f933d2e30eea9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } }
I20260808 14:33:48.767864 15449 ts_tablet_manager.cc:1428] T 8d55f1f379cf4253980832122ea73095 P c223f4b86e4d493a909f933d2e30eea9: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260808 14:33:48.769151 15451 tablet_bootstrap.cc:492] T 8d55f1f379cf4253980832122ea73095 P bc8e24f303a54de5b4264d4953b28c91: Bootstrap starting.
I20260808 14:33:48.770074 15451 tablet_bootstrap.cc:654] T 8d55f1f379cf4253980832122ea73095 P bc8e24f303a54de5b4264d4953b28c91: Neither blocks nor log segments found. Creating new log.
I20260808 14:33:48.770987 15456 tablet_bootstrap.cc:492] T 8d55f1f379cf4253980832122ea73095 P b9d0b1d9589041b4983a7b331fe163ce: No bootstrap required, opened a new log
I20260808 14:33:48.771091 15456 ts_tablet_manager.cc:1397] T 8d55f1f379cf4253980832122ea73095 P b9d0b1d9589041b4983a7b331fe163ce: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260808 14:33:48.771513 15456 raft_consensus.cc:348] T 8d55f1f379cf4253980832122ea73095 P b9d0b1d9589041b4983a7b331fe163ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } }
I20260808 14:33:48.771633 15456 raft_consensus.cc:374] T 8d55f1f379cf4253980832122ea73095 P b9d0b1d9589041b4983a7b331fe163ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:33:48.771665 15456 raft_consensus.cc:729] T 8d55f1f379cf4253980832122ea73095 P b9d0b1d9589041b4983a7b331fe163ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9d0b1d9589041b4983a7b331fe163ce, State: Initialized, Role: FOLLOWER
I20260808 14:33:48.771797 15456 consensus_queue.cc:260] T 8d55f1f379cf4253980832122ea73095 P b9d0b1d9589041b4983a7b331fe163ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } }
I20260808 14:33:48.772058 15456 ts_tablet_manager.cc:1428] T 8d55f1f379cf4253980832122ea73095 P b9d0b1d9589041b4983a7b331fe163ce: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:33:48.772591 15451 tablet_bootstrap.cc:492] T 8d55f1f379cf4253980832122ea73095 P bc8e24f303a54de5b4264d4953b28c91: No bootstrap required, opened a new log
I20260808 14:33:48.772703 15451 ts_tablet_manager.cc:1397] T 8d55f1f379cf4253980832122ea73095 P bc8e24f303a54de5b4264d4953b28c91: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260808 14:33:48.773109 15451 raft_consensus.cc:348] T 8d55f1f379cf4253980832122ea73095 P bc8e24f303a54de5b4264d4953b28c91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } }
I20260808 14:33:48.773221 15451 raft_consensus.cc:374] T 8d55f1f379cf4253980832122ea73095 P bc8e24f303a54de5b4264d4953b28c91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:33:48.773252 15451 raft_consensus.cc:729] T 8d55f1f379cf4253980832122ea73095 P bc8e24f303a54de5b4264d4953b28c91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc8e24f303a54de5b4264d4953b28c91, State: Initialized, Role: FOLLOWER
I20260808 14:33:48.773383 15451 consensus_queue.cc:260] T 8d55f1f379cf4253980832122ea73095 P bc8e24f303a54de5b4264d4953b28c91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } }
I20260808 14:33:48.773634 15451 ts_tablet_manager.cc:1428] T 8d55f1f379cf4253980832122ea73095 P bc8e24f303a54de5b4264d4953b28c91: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:33:49.190755 15323 raft_consensus.cc:482] T 8d55f1f379cf4253980832122ea73095 P b9d0b1d9589041b4983a7b331fe163ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:33:49.190919 15323 raft_consensus.cc:504] T 8d55f1f379cf4253980832122ea73095 P b9d0b1d9589041b4983a7b331fe163ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } }
I20260808 14:33:49.191478 15323 leader_election.cc:288] T 8d55f1f379cf4253980832122ea73095 P b9d0b1d9589041b4983a7b331fe163ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc8e24f303a54de5b4264d4953b28c91 (127.11.131.193:35779), c223f4b86e4d493a909f933d2e30eea9 (127.11.131.194:36771)
I20260808 14:33:49.192103 14750 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d55f1f379cf4253980832122ea73095" candidate_uuid: "b9d0b1d9589041b4983a7b331fe163ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc8e24f303a54de5b4264d4953b28c91" is_pre_election: true
I20260808 14:33:49.192103 14988 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d55f1f379cf4253980832122ea73095" candidate_uuid: "b9d0b1d9589041b4983a7b331fe163ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c223f4b86e4d493a909f933d2e30eea9" is_pre_election: true
I20260808 14:33:49.192284 14750 raft_consensus.cc:2454] T 8d55f1f379cf4253980832122ea73095 P bc8e24f303a54de5b4264d4953b28c91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d0b1d9589041b4983a7b331fe163ce in term 0.
I20260808 14:33:49.192313 14988 raft_consensus.cc:2454] T 8d55f1f379cf4253980832122ea73095 P c223f4b86e4d493a909f933d2e30eea9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b9d0b1d9589041b4983a7b331fe163ce in term 0.
I20260808 14:33:49.192677 15095 leader_election.cc:302] T 8d55f1f379cf4253980832122ea73095 P b9d0b1d9589041b4983a7b331fe163ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d0b1d9589041b4983a7b331fe163ce, bc8e24f303a54de5b4264d4953b28c91; no voters:
I20260808 14:33:49.192925 15323 raft_consensus.cc:2781] T 8d55f1f379cf4253980832122ea73095 P b9d0b1d9589041b4983a7b331fe163ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:33:49.192991 15323 raft_consensus.cc:482] T 8d55f1f379cf4253980832122ea73095 P b9d0b1d9589041b4983a7b331fe163ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:33:49.193032 15323 raft_consensus.cc:3037] T 8d55f1f379cf4253980832122ea73095 P b9d0b1d9589041b4983a7b331fe163ce [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:33:49.194164 15323 raft_consensus.cc:504] T 8d55f1f379cf4253980832122ea73095 P b9d0b1d9589041b4983a7b331fe163ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } }
I20260808 14:33:49.194521 15323 leader_election.cc:288] T 8d55f1f379cf4253980832122ea73095 P b9d0b1d9589041b4983a7b331fe163ce [CANDIDATE]: Term 1 election: Requested vote from peers bc8e24f303a54de5b4264d4953b28c91 (127.11.131.193:35779), c223f4b86e4d493a909f933d2e30eea9 (127.11.131.194:36771)
I20260808 14:33:49.194972 14750 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d55f1f379cf4253980832122ea73095" candidate_uuid: "b9d0b1d9589041b4983a7b331fe163ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc8e24f303a54de5b4264d4953b28c91"
I20260808 14:33:49.195043 14988 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d55f1f379cf4253980832122ea73095" candidate_uuid: "b9d0b1d9589041b4983a7b331fe163ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c223f4b86e4d493a909f933d2e30eea9"
I20260808 14:33:49.195127 14750 raft_consensus.cc:3037] T 8d55f1f379cf4253980832122ea73095 P bc8e24f303a54de5b4264d4953b28c91 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:33:49.195205 14988 raft_consensus.cc:3037] T 8d55f1f379cf4253980832122ea73095 P c223f4b86e4d493a909f933d2e30eea9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:33:49.196135 14750 raft_consensus.cc:2454] T 8d55f1f379cf4253980832122ea73095 P bc8e24f303a54de5b4264d4953b28c91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d0b1d9589041b4983a7b331fe163ce in term 1.
I20260808 14:33:49.196228 14988 raft_consensus.cc:2454] T 8d55f1f379cf4253980832122ea73095 P c223f4b86e4d493a909f933d2e30eea9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b9d0b1d9589041b4983a7b331fe163ce in term 1.
I20260808 14:33:49.196537 15095 leader_election.cc:302] T 8d55f1f379cf4253980832122ea73095 P b9d0b1d9589041b4983a7b331fe163ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b9d0b1d9589041b4983a7b331fe163ce, bc8e24f303a54de5b4264d4953b28c91; no voters:
I20260808 14:33:49.196791 15323 raft_consensus.cc:2781] T 8d55f1f379cf4253980832122ea73095 P b9d0b1d9589041b4983a7b331fe163ce [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:33:49.196979 15323 raft_consensus.cc:686] T 8d55f1f379cf4253980832122ea73095 P b9d0b1d9589041b4983a7b331fe163ce [term 1 LEADER]: Becoming Leader. State: Replica: b9d0b1d9589041b4983a7b331fe163ce, State: Running, Role: LEADER
I20260808 14:33:49.197145 15323 consensus_queue.cc:237] T 8d55f1f379cf4253980832122ea73095 P b9d0b1d9589041b4983a7b331fe163ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } }
I20260808 14:33:49.199016 14492 catalog_manager.cc:5495] T 8d55f1f379cf4253980832122ea73095 P b9d0b1d9589041b4983a7b331fe163ce reported cstate change: term changed from 0 to 1, leader changed from <none> to b9d0b1d9589041b4983a7b331fe163ce (127.11.131.195). New cstate: current_term: 1 leader_uuid: "b9d0b1d9589041b4983a7b331fe163ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b9d0b1d9589041b4983a7b331fe163ce" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41581 } health_report { overall_health: HEALTHY } } }
I20260808 14:33:49.237062 15503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:49.232564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34120 (local address 127.11.131.195:41581)
0808 14:33:49.232853 (+ 289us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:49.232876 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:49.232919 (+ 43us) server_negotiation.cc:407] Connection header received
0808 14:33:49.233112 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:49.233115 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:49.233167 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:49.233266 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:33:49.233569 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:49.234250 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:49.235655 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:49.235971 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:49.236066 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:49.236417 (+ 351us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:33:49.236498 (+ 81us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:33:49.236568 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:49.236731 (+ 163us) server_negotiation.cc:299] Negotiation successful
0808 14:33:49.236863 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":200,"thread_start_us":83,"threads_started":1}
I20260808 14:33:49.244259 14750 raft_consensus.cc:1261] T 8d55f1f379cf4253980832122ea73095 P bc8e24f303a54de5b4264d4953b28c91 [term 1 FOLLOWER]: Refusing update from remote peer b9d0b1d9589041b4983a7b331fe163ce: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:33:49.244294 14988 raft_consensus.cc:1261] T 8d55f1f379cf4253980832122ea73095 P c223f4b86e4d493a909f933d2e30eea9 [term 1 FOLLOWER]: Refusing update from remote peer b9d0b1d9589041b4983a7b331fe163ce: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:33:49.244692 15495 consensus_queue.cc:1035] T 8d55f1f379cf4253980832122ea73095 P b9d0b1d9589041b4983a7b331fe163ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc8e24f303a54de5b4264d4953b28c91" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:33:49.245005 15323 consensus_queue.cc:1035] T 8d55f1f379cf4253980832122ea73095 P b9d0b1d9589041b4983a7b331fe163ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "c223f4b86e4d493a909f933d2e30eea9" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 36771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 14:33:49.259122 15412 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 14:33:50.812466 14492 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52356:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:33:50.812623 14492 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52356:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:33:50.814970 14492 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 786c26e1617949c4b9eb62f3e31153d5: Sending DeleteTablet for 3 replicas of tablet 8d55f1f379cf4253980832122ea73095
I20260808 14:33:50.815569 14712 tablet_service.cc:1514] Processing DeleteTablet for tablet 8d55f1f379cf4253980832122ea73095 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:33:50 UTC) from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:39224
I20260808 14:33:50.815639 15162 tablet_service.cc:1514] Processing DeleteTablet for tablet 8d55f1f379cf4253980832122ea73095 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:33:50 UTC) from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:34102
I20260808 14:33:50.815696 14941 tablet_service.cc:1514] Processing DeleteTablet for tablet 8d55f1f379cf4253980832122ea73095 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:33:50 UTC) from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:44008
I20260808 14:33:50.816057 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 14614
I20260808 14:33:50.816074 15550 tablet_replica.cc:330] T 8d55f1f379cf4253980832122ea73095 P b9d0b1d9589041b4983a7b331fe163ce: stopping tablet replica
I20260808 14:33:50.816104 15551 tablet_replica.cc:330] T 8d55f1f379cf4253980832122ea73095 P c223f4b86e4d493a909f933d2e30eea9: stopping tablet replica
I20260808 14:33:50.830216 15551 raft_consensus.cc:2229] T 8d55f1f379cf4253980832122ea73095 P c223f4b86e4d493a909f933d2e30eea9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:33:50.830353 15550 raft_consensus.cc:2229] T 8d55f1f379cf4253980832122ea73095 P b9d0b1d9589041b4983a7b331fe163ce [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:33:50.830526 15551 raft_consensus.cc:2258] T 8d55f1f379cf4253980832122ea73095 P c223f4b86e4d493a909f933d2e30eea9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:33:50.830699 15550 raft_consensus.cc:2258] T 8d55f1f379cf4253980832122ea73095 P b9d0b1d9589041b4983a7b331fe163ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:33:50.831853 15550 ts_tablet_manager.cc:1905] T 8d55f1f379cf4253980832122ea73095 P b9d0b1d9589041b4983a7b331fe163ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:33:50.831914 15551 ts_tablet_manager.cc:1905] T 8d55f1f379cf4253980832122ea73095 P c223f4b86e4d493a909f933d2e30eea9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:33:50.834841 15550 ts_tablet_manager.cc:1918] T 8d55f1f379cf4253980832122ea73095 P b9d0b1d9589041b4983a7b331fe163ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 14:33:50.834949 15550 log.cc:1196] T 8d55f1f379cf4253980832122ea73095 P b9d0b1d9589041b4983a7b331fe163ce: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-2/wal/wals/8d55f1f379cf4253980832122ea73095
I20260808 14:33:50.835283 15550 ts_tablet_manager.cc:1939] T 8d55f1f379cf4253980832122ea73095 P b9d0b1d9589041b4983a7b331fe163ce: Deleting consensus metadata
I20260808 14:33:50.835759 15551 ts_tablet_manager.cc:1918] T 8d55f1f379cf4253980832122ea73095 P c223f4b86e4d493a909f933d2e30eea9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 14:33:50.835829 15551 log.cc:1196] T 8d55f1f379cf4253980832122ea73095 P c223f4b86e4d493a909f933d2e30eea9: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786199615258783-11791-0/minicluster-data/ts-1/wal/wals/8d55f1f379cf4253980832122ea73095
I20260808 14:33:50.836074 15551 ts_tablet_manager.cc:1939] T 8d55f1f379cf4253980832122ea73095 P c223f4b86e4d493a909f933d2e30eea9: Deleting consensus metadata
I20260808 14:33:50.836460 14468 catalog_manager.cc:4841] TS b9d0b1d9589041b4983a7b331fe163ce (127.11.131.195:41581): tablet 8d55f1f379cf4253980832122ea73095 (table test-table [id=c86de6203a274b3fbc9eb0054797c6ae]) successfully deleted
I20260808 14:33:50.836848 14472 catalog_manager.cc:4841] TS c223f4b86e4d493a909f933d2e30eea9 (127.11.131.194:36771): tablet 8d55f1f379cf4253980832122ea73095 (table test-table [id=c86de6203a274b3fbc9eb0054797c6ae]) successfully deleted
W20260808 14:33:50.845908 14472 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.131.193:35779 (error 108)
I20260808 14:33:50.846244 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 14840
I20260808 14:33:50.855548 15558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:50.849233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:35779 (local address 127.0.0.1:39232)
0808 14:33:50.855201 (+ 5968us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:50.855370 (+ 169us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.193:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":5827,"thread_start_us":864,"threads_started":1}
W20260808 14:33:50.855741 14472 catalog_manager.cc:4584] TS bc8e24f303a54de5b4264d4953b28c91 (127.11.131.193:35779): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8d55f1f379cf4253980832122ea73095: Network error: Client connection negotiation failed: client connection to 127.11.131.193:35779: connect: Connection refused (error 111)
I20260808 14:33:50.868520 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 15067
I20260808 14:33:50.882733 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 14442
2026-08-08T14:33:50Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (7071 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:33:50 dist-test-slave-twwt krb5kdc[15566](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:33:50 dist-test-slave-twwt krb5kdc[15566](info): set up 2 sockets
Aug 08 14:33:50 dist-test-slave-twwt krb5kdc[15566](info): commencing operation
krb5kdc: starting...
W20260808 14:33:52.195539 11791 mini_kdc.cc:121] Time spent starting KDC: real 1.281s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Aug 08 14:33:52 dist-test-slave-twwt krb5kdc[15566](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199632, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:33:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:33:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.131.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
I20260808 14:33:52.327869 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:39403
--webserver_interface=127.11.131.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:44185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:39403
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:33:52.449267 15582 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:33:52.449520 15582 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:33:52.449559 15582 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:33:52.453541 15582 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:33:52.453604 15582 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:33:52.453624 15582 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:33:52.453675 15582 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:33:52.453713 15582 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:33:52.459132 15582 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:44185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:39403
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:39403
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.131.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15582
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:33:52.460284 15582 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:33:52.461383 15582 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 14:33:52.470724 15582 server_base.cc:1034] running on GCE node
W20260808 14:33:52.470662 15589 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:33:52.470669 15591 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:33:52.470666 15588 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:33:52.471545 15582 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:33:52.472671 15582 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:33:52.473896 15582 hybrid_clock.cc:648] HybridClock initialized: now 1786199632473868 us; error 39 us; skew 500 ppm
Aug 08 14:33:52 dist-test-slave-twwt krb5kdc[15566](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199632, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:33:52.476707 15582 init.cc:377] Logged in from keytab as kudu/127.11.131.254@KRBTEST.COM (short username kudu)
I20260808 14:33:52.477595 15582 webserver.cc:460] Webserver started at http://127.11.131.254:38353/ using document root <none> and password file <none>
I20260808 14:33:52.478173 15582 fs_manager.cc:359] Metadata directory not provided
I20260808 14:33:52.478264 15582 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:33:52.478513 15582 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:33:52.480628 15582 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/master-0/data/instance:
uuid: "3b861d2fa66e451f97096a84fe56e31d"
format_stamp: "Formatted at 2026-08-08 14:33:52 on dist-test-slave-twwt"
server_key: "bd14d18067d76babe5fa58e5f02826fc"
server_key_iv: "bb2ae12f1a95a5e840f26f957359e8ed"
server_key_version: "encryptionkey@0"
I20260808 14:33:52.481195 15582 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/master-0/wal/instance:
uuid: "3b861d2fa66e451f97096a84fe56e31d"
format_stamp: "Formatted at 2026-08-08 14:33:52 on dist-test-slave-twwt"
server_key: "bd14d18067d76babe5fa58e5f02826fc"
server_key_iv: "bb2ae12f1a95a5e840f26f957359e8ed"
server_key_version: "encryptionkey@0"
I20260808 14:33:52.485039 15582 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 14:33:52.487859 15601 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:52.489158 15582 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:33:52.489305 15582 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "3b861d2fa66e451f97096a84fe56e31d"
format_stamp: "Formatted at 2026-08-08 14:33:52 on dist-test-slave-twwt"
server_key: "bd14d18067d76babe5fa58e5f02826fc"
server_key_iv: "bb2ae12f1a95a5e840f26f957359e8ed"
server_key_version: "encryptionkey@0"
I20260808 14:33:52.489436 15582 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:33:52.499488 15582 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:33:52.502288 15582 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:33:52.502496 15582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:33:52.509663 15582 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.254:39403
I20260808 14:33:52.509735 15678 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.254:39403 every 8 connection(s)
I20260808 14:33:52.510699 15582 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:33:52.513615 15681 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:33:52.515513 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 15582
I20260808 14:33:52.515637 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/master-0/wal/instance
I20260808 14:33:52.515970 11791 external_mini_cluster.cc:1428] Setting key 973efbaa4dfd4181cfd072cfda020cd6
I20260808 14:33:52.521524 15681 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b861d2fa66e451f97096a84fe56e31d: Bootstrap starting.
I20260808 14:33:52.524431 15681 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3b861d2fa66e451f97096a84fe56e31d: Neither blocks nor log segments found. Creating new log.
I20260808 14:33:52.525240 15681 log.cc:824] T 00000000000000000000000000000000 P 3b861d2fa66e451f97096a84fe56e31d: Log is configured to *not* fsync() on all Append() calls
Aug 08 14:33:52 dist-test-slave-twwt krb5kdc[15566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199632, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:33:52.527781 15681 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b861d2fa66e451f97096a84fe56e31d: No bootstrap required, opened a new log
I20260808 14:33:52.531620 15685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:52.517454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38236 (local address 127.11.131.254:39403)
0808 14:33:52.517923 (+ 469us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:52.517943 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:52.517989 (+ 46us) server_negotiation.cc:407] Connection header received
0808 14:33:52.518893 (+ 904us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:52.518927 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:52.519378 (+ 451us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:52.519854 (+ 476us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:33:52.520508 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:52.521960 (+ 1452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:52.522920 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:52.523608 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:52.523772 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:52.526328 (+ 2556us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:33:52.526335 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:33:52.526351 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:33:52.526382 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:33:52.528364 (+ 1982us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:52.528785 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:52.528791 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:52.528797 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:52.528945 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:52.529211 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:52.529214 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:52.529216 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:52.529750 (+ 534us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:33:52.529967 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:52.530207 (+ 240us) server_negotiation.cc:299] Negotiation successful
0808 14:33:52.530584 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":312,"thread_start_us":127,"threads_started":1}
I20260808 14:33:52.532630 15681 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3b861d2fa66e451f97096a84fe56e31d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b861d2fa66e451f97096a84fe56e31d" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 39403 } }
I20260808 14:33:52.532945 15681 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3b861d2fa66e451f97096a84fe56e31d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:33:52.533011 15681 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3b861d2fa66e451f97096a84fe56e31d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b861d2fa66e451f97096a84fe56e31d, State: Initialized, Role: FOLLOWER
I20260808 14:33:52.533486 15681 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3b861d2fa66e451f97096a84fe56e31d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b861d2fa66e451f97096a84fe56e31d" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 39403 } }
I20260808 14:33:52.533618 15681 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3b861d2fa66e451f97096a84fe56e31d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:33:52.533708 15681 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3b861d2fa66e451f97096a84fe56e31d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:33:52.533845 15681 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3b861d2fa66e451f97096a84fe56e31d [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:33:52.535054 15681 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3b861d2fa66e451f97096a84fe56e31d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b861d2fa66e451f97096a84fe56e31d" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 39403 } }
I20260808 14:33:52.535418 15681 leader_election.cc:302] T 00000000000000000000000000000000 P 3b861d2fa66e451f97096a84fe56e31d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3b861d2fa66e451f97096a84fe56e31d; no voters:
I20260808 14:33:52.535741 15681 leader_election.cc:288] T 00000000000000000000000000000000 P 3b861d2fa66e451f97096a84fe56e31d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:33:52.535902 15688 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3b861d2fa66e451f97096a84fe56e31d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:33:52.536140 15688 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3b861d2fa66e451f97096a84fe56e31d [term 1 LEADER]: Becoming Leader. State: Replica: 3b861d2fa66e451f97096a84fe56e31d, State: Running, Role: LEADER
I20260808 14:33:52.536497 15688 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3b861d2fa66e451f97096a84fe56e31d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b861d2fa66e451f97096a84fe56e31d" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 39403 } }
I20260808 14:33:52.537038 15681 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3b861d2fa66e451f97096a84fe56e31d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:33:52.538163 15693 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b861d2fa66e451f97096a84fe56e31d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3b861d2fa66e451f97096a84fe56e31d. Latest consensus state: current_term: 1 leader_uuid: "3b861d2fa66e451f97096a84fe56e31d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b861d2fa66e451f97096a84fe56e31d" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 39403 } } }
I20260808 14:33:52.538290 15693 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b861d2fa66e451f97096a84fe56e31d [sys.catalog]: This master's current role is: LEADER
I20260808 14:33:52.538738 15689 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b861d2fa66e451f97096a84fe56e31d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3b861d2fa66e451f97096a84fe56e31d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3b861d2fa66e451f97096a84fe56e31d" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 39403 } } }
I20260808 14:33:52.538913 15689 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b861d2fa66e451f97096a84fe56e31d [sys.catalog]: This master's current role is: LEADER
I20260808 14:33:52.539393 15703 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:33:52.542111 15703 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:33:52.547933 15703 catalog_manager.cc:1347] Generated new cluster ID: b759474243144ad5b3a45c9f0d1352b0
I20260808 14:33:52.548000 15703 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:33:52.561686 15703 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:33:52.563196 15703 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:33:52.572628 15703 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3b861d2fa66e451f97096a84fe56e31d: Generated new TSK 0
I20260808 14:33:52.573518 15703 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.131.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab.
Entry for principal kudu/127.11.131.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab.
I20260808 14:33:52.604120 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.193:0
--local_ip_for_outbound_sockets=127.11.131.193
--webserver_interface=127.11.131.193
--webserver_port=0
--tserver_master_addrs=127.11.131.254:39403
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab
--principal=kudu/127.11.131.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:44185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:33:52.721757 15725 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:33:52.722077 15725 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:33:52.722164 15725 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:33:52.726204 15725 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:33:52.726300 15725 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:33:52.726397 15725 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.193
I20260808 14:33:52.731805 15725 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:44185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab
--principal=kudu/127.11.131.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.131.193
--webserver_port=0
--tserver_master_addrs=127.11.131.254:39403
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15725
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.193
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:33:52.732971 15725 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:33:52.734030 15725 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:33:52.744117 15736 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:33:52.744123 15733 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:33:52.744307 15725 server_base.cc:1034] running on GCE node
W20260808 14:33:52.744129 15732 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:33:52.744824 15725 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:33:52.745530 15725 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:33:52.746690 15725 hybrid_clock.cc:648] HybridClock initialized: now 1786199632746641 us; error 52 us; skew 500 ppm
Aug 08 14:33:52 dist-test-slave-twwt krb5kdc[15566](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199632, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:33:52.749543 15725 init.cc:377] Logged in from keytab as kudu/127.11.131.193@KRBTEST.COM (short username kudu)
I20260808 14:33:52.750342 15725 webserver.cc:460] Webserver started at http://127.11.131.193:38175/ using document root <none> and password file <none>
I20260808 14:33:52.750946 15725 fs_manager.cc:359] Metadata directory not provided
I20260808 14:33:52.751009 15725 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:33:52.751176 15725 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:33:52.753247 15725 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-0/data/instance:
uuid: "58a343921b0949b8b6d9ff12d3ecfa7b"
format_stamp: "Formatted at 2026-08-08 14:33:52 on dist-test-slave-twwt"
server_key: "d8bd4ab7ef131770da1d28c83feb7d95"
server_key_iv: "955cd4088a0b45e182700686747aadc5"
server_key_version: "encryptionkey@0"
I20260808 14:33:52.753765 15725 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-0/wal/instance:
uuid: "58a343921b0949b8b6d9ff12d3ecfa7b"
format_stamp: "Formatted at 2026-08-08 14:33:52 on dist-test-slave-twwt"
server_key: "d8bd4ab7ef131770da1d28c83feb7d95"
server_key_iv: "955cd4088a0b45e182700686747aadc5"
server_key_version: "encryptionkey@0"
I20260808 14:33:52.757568 15725 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260808 14:33:52.760056 15748 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:52.761579 15725 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 14:33:52.761718 15725 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-0/wal
uuid: "58a343921b0949b8b6d9ff12d3ecfa7b"
format_stamp: "Formatted at 2026-08-08 14:33:52 on dist-test-slave-twwt"
server_key: "d8bd4ab7ef131770da1d28c83feb7d95"
server_key_iv: "955cd4088a0b45e182700686747aadc5"
server_key_version: "encryptionkey@0"
I20260808 14:33:52.761840 15725 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:33:52.790131 15725 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:33:52.793573 15725 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:33:52.793798 15725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:33:52.794472 15725 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:33:52.795389 15725 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:33:52.795439 15725 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:52.795482 15725 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:33:52.795508 15725 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:52.804200 15725 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.193:39233
I20260808 14:33:52.804265 15958 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.193:39233 every 8 connection(s)
I20260808 14:33:52.805168 15725 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
I20260808 14:33:52.812453 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 15725
I20260808 14:33:52.812577 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-0/wal/instance
I20260808 14:33:52.812908 11791 external_mini_cluster.cc:1428] Setting key f297609dc5393d5af03702e215c157bf
Aug 08 14:33:52 dist-test-slave-twwt krb5kdc[15566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199632, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.193@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:33:52.820454 15685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:52.807251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:34587 (local address 127.11.131.254:39403)
0808 14:33:52.807416 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:52.807421 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:52.808367 (+ 946us) server_negotiation.cc:407] Connection header received
0808 14:33:52.809680 (+ 1313us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:52.809683 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:52.809739 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:52.809848 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:33:52.811228 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:52.811841 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:52.813548 (+ 1707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:52.813805 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:52.813927 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:52.816788 (+ 2861us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:33:52.816792 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:33:52.816794 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:33:52.816819 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:33:52.818263 (+ 1444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:52.818870 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:52.818874 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:52.818876 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:52.818963 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:52.819321 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:52.819325 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:52.819326 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:52.819514 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:33:52.819623 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:52.820143 (+ 520us) server_negotiation.cc:299] Negotiation successful
0808 14:33:52.820278 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 14:33:52.821271 15962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:52.807691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:39403 (local address 127.11.131.193:34587)
0808 14:33:52.808195 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:52.808240 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:52.809462 (+ 1222us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:52.810037 (+ 575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:52.810044 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:52.810428 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:33:52.811022 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:52.811037 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:52.812007 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:52.812010 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:52.813411 (+ 1401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:52.813423 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:52.813970 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:52.813974 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:52.814145 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:52.814821 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:33:52.814844 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:33:52.816579 (+ 1735us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:33:52.818387 (+ 1808us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:52.818394 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:52.818409 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:52.818763 (+ 354us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:52.819060 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:52.819063 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:52.819065 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:52.819213 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:52.819625 (+ 412us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:33:52.819634 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:33:52.819896 (+ 262us) client_negotiation.cc:769] Sending connection context
0808 14:33:52.820086 (+ 190us) client_negotiation.cc:240] Negotiation successful
0808 14:33:52.820433 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":118,"threads_started":1}
I20260808 14:33:52.822522 15960 heartbeater.cc:347] Connected to a master server at 127.11.131.254:39403
I20260808 14:33:52.822824 15960 heartbeater.cc:464] Registering TS with master...
I20260808 14:33:52.823485 15960 heartbeater.cc:511] Master 127.11.131.254:39403 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.11.131.194@KRBTEST.COM; defaulting to no policy
I20260808 14:33:52.825291 15630 ts_manager.cc:194] Registered new tserver with Master: 58a343921b0949b8b6d9ff12d3ecfa7b (127.11.131.193:39233)
I20260808 14:33:52.826594 15630 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.193@KRBTEST.COM'} at 127.11.131.193:34587
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab.
Entry for principal kudu/127.11.131.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab.
I20260808 14:33:52.846007 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.194:0
--local_ip_for_outbound_sockets=127.11.131.194
--webserver_interface=127.11.131.194
--webserver_port=0
--tserver_master_addrs=127.11.131.254:39403
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab
--principal=kudu/127.11.131.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:44185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:33:52.960796 15966 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:33:52.961061 15966 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:33:52.961102 15966 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:33:52.965199 15966 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:33:52.965255 15966 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:33:52.965313 15966 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.194
I20260808 14:33:52.970571 15966 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:44185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab
--principal=kudu/127.11.131.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.131.194
--webserver_port=0
--tserver_master_addrs=127.11.131.254:39403
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15966
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.194
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:33:52.971582 15966 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:33:52.972561 15966 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:33:52.982564 15974 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:33:52.982666 15975 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:33:52.982671 15977 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:33:52.983070 15966 server_base.cc:1034] running on GCE node
I20260808 14:33:52.983561 15966 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:33:52.984205 15966 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:33:52.985428 15966 hybrid_clock.cc:648] HybridClock initialized: now 1786199632985406 us; error 33 us; skew 500 ppm
Aug 08 14:33:52 dist-test-slave-twwt krb5kdc[15566](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199632, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:33:52.988382 15966 init.cc:377] Logged in from keytab as kudu/127.11.131.194@KRBTEST.COM (short username kudu)
I20260808 14:33:52.989287 15966 webserver.cc:460] Webserver started at http://127.11.131.194:45427/ using document root <none> and password file <none>
I20260808 14:33:52.989885 15966 fs_manager.cc:359] Metadata directory not provided
I20260808 14:33:52.989984 15966 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:33:52.990226 15966 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:33:52.992427 15966 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-1/data/instance:
uuid: "8211aff109514af6bf62e8bf3a222b9e"
format_stamp: "Formatted at 2026-08-08 14:33:52 on dist-test-slave-twwt"
server_key: "1a875c3c8b702369d0b5437c78295512"
server_key_iv: "f05818055720cc21db12cf55892af9c4"
server_key_version: "encryptionkey@0"
I20260808 14:33:52.993124 15966 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-1/wal/instance:
uuid: "8211aff109514af6bf62e8bf3a222b9e"
format_stamp: "Formatted at 2026-08-08 14:33:52 on dist-test-slave-twwt"
server_key: "1a875c3c8b702369d0b5437c78295512"
server_key_iv: "f05818055720cc21db12cf55892af9c4"
server_key_version: "encryptionkey@0"
I20260808 14:33:52.997080 15966 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 14:33:52.999619 15988 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:53.000891 15966 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 14:33:53.001039 15966 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-1/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-1/wal
uuid: "8211aff109514af6bf62e8bf3a222b9e"
format_stamp: "Formatted at 2026-08-08 14:33:52 on dist-test-slave-twwt"
server_key: "1a875c3c8b702369d0b5437c78295512"
server_key_iv: "f05818055720cc21db12cf55892af9c4"
server_key_version: "encryptionkey@0"
I20260808 14:33:53.001157 15966 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:33:53.026981 15966 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:33:53.030723 15966 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:33:53.031033 15966 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:33:53.031929 15966 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:33:53.032810 15966 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:33:53.032868 15966 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:53.032912 15966 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:33:53.032927 15966 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:53.043095 15966 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.194:41541
I20260808 14:33:53.043124 16167 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.194:41541 every 8 connection(s)
I20260808 14:33:53.044039 15966 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
I20260808 14:33:53.053887 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 15966
I20260808 14:33:53.054028 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-1/wal/instance
I20260808 14:33:53.054363 11791 external_mini_cluster.cc:1428] Setting key 30ad7616a15a0943fa9f695652037f38
Aug 08 14:33:53 dist-test-slave-twwt krb5kdc[15566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199632, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.194@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:33:53.059625 15685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:53.045959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:60579 (local address 127.11.131.254:39403)
0808 14:33:53.046101 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:53.046105 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:53.046954 (+ 849us) server_negotiation.cc:407] Connection header received
0808 14:33:53.048349 (+ 1395us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:53.048353 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:53.048416 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:53.048528 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:33:53.049788 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:53.050321 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:53.051600 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:53.051843 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:53.051962 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:53.055239 (+ 3277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:33:53.055243 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:33:53.055246 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:33:53.055283 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:33:53.057181 (+ 1898us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:53.057748 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:53.057756 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:53.057761 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:53.057880 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:53.058238 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:53.058244 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:53.058249 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:53.058534 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:33:53.058693 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:53.059378 (+ 685us) server_negotiation.cc:299] Negotiation successful
0808 14:33:53.059499 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 14:33:53.060990 16171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:53.046290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:39403 (local address 127.11.131.194:60579)
0808 14:33:53.046801 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:53.046846 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:53.048087 (+ 1241us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:53.048720 (+ 633us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:53.048727 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:53.049109 (+ 382us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:33:53.049618 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:53.049633 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:53.050464 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:53.050467 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:53.051439 (+ 972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:53.051473 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:53.052027 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:53.052032 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:53.052261 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:53.052861 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:33:53.052879 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:33:53.055042 (+ 2163us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:33:53.057316 (+ 2274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:53.057321 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:53.057335 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:53.057628 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:53.057976 (+ 348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:53.057978 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:53.057979 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:53.058130 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:53.058684 (+ 554us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:33:53.058693 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:33:53.059079 (+ 386us) client_negotiation.cc:769] Sending connection context
0808 14:33:53.059316 (+ 237us) client_negotiation.cc:240] Negotiation successful
0808 14:33:53.059718 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":114,"threads_started":1}
I20260808 14:33:53.062528 16168 heartbeater.cc:347] Connected to a master server at 127.11.131.254:39403
I20260808 14:33:53.062830 16168 heartbeater.cc:464] Registering TS with master...
I20260808 14:33:53.063378 16168 heartbeater.cc:511] Master 127.11.131.254:39403 requested a full tablet report, sending...
I20260808 14:33:53.064591 15630 ts_manager.cc:194] Registered new tserver with Master: 8211aff109514af6bf62e8bf3a222b9e (127.11.131.194:41541)
I20260808 14:33:53.065498 15630 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.194@KRBTEST.COM'} at 127.11.131.194:60579
WARNING: no policy specified for kudu/127.11.131.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab.
Entry for principal kudu/127.11.131.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab.
I20260808 14:33:53.086355 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.195:0
--local_ip_for_outbound_sockets=127.11.131.195
--webserver_interface=127.11.131.195
--webserver_port=0
--tserver_master_addrs=127.11.131.254:39403
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab
--principal=kudu/127.11.131.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:44185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:33:53.205689 16176 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:33:53.205976 16176 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:33:53.206056 16176 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:33:53.210180 16176 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:33:53.210237 16176 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:33:53.210331 16176 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.195
I20260808 14:33:53.215677 16176 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:44185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab
--principal=kudu/127.11.131.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.131.195
--webserver_port=0
--tserver_master_addrs=127.11.131.254:39403
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16176
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.195
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:33:53.216781 16176 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:33:53.217850 16176 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:33:53.228127 16191 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:33:53.228113 16189 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:33:53.228129 16187 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:33:53.228355 16176 server_base.cc:1034] running on GCE node
I20260808 14:33:53.228919 16176 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:33:53.229566 16176 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:33:53.230752 16176 hybrid_clock.cc:648] HybridClock initialized: now 1786199633230748 us; error 44 us; skew 500 ppm
Aug 08 14:33:53 dist-test-slave-twwt krb5kdc[15566](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199633, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:33:53.233503 16176 init.cc:377] Logged in from keytab as kudu/127.11.131.195@KRBTEST.COM (short username kudu)
I20260808 14:33:53.234417 16176 webserver.cc:460] Webserver started at http://127.11.131.195:46597/ using document root <none> and password file <none>
I20260808 14:33:53.235039 16176 fs_manager.cc:359] Metadata directory not provided
I20260808 14:33:53.235132 16176 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:33:53.235370 16176 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:33:53.237376 16176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-2/data/instance:
uuid: "516d834f247b4ec88548b83aa2d6e6b8"
format_stamp: "Formatted at 2026-08-08 14:33:53 on dist-test-slave-twwt"
server_key: "466e556985ce56c4719528fdb301b9a8"
server_key_iv: "a9ac48efa9ab41897018f6797c312772"
server_key_version: "encryptionkey@0"
I20260808 14:33:53.238056 16176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-2/wal/instance:
uuid: "516d834f247b4ec88548b83aa2d6e6b8"
format_stamp: "Formatted at 2026-08-08 14:33:53 on dist-test-slave-twwt"
server_key: "466e556985ce56c4719528fdb301b9a8"
server_key_iv: "a9ac48efa9ab41897018f6797c312772"
server_key_version: "encryptionkey@0"
I20260808 14:33:53.241724 16176 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 14:33:53.244274 16203 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:53.245437 16176 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 14:33:53.245584 16176 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-2/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-2/wal
uuid: "516d834f247b4ec88548b83aa2d6e6b8"
format_stamp: "Formatted at 2026-08-08 14:33:53 on dist-test-slave-twwt"
server_key: "466e556985ce56c4719528fdb301b9a8"
server_key_iv: "a9ac48efa9ab41897018f6797c312772"
server_key_version: "encryptionkey@0"
I20260808 14:33:53.245695 16176 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:33:53.263626 16176 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:33:53.266902 16176 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:33:53.267103 16176 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:33:53.267784 16176 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:33:53.268738 16176 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:33:53.268805 16176 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:53.268872 16176 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:33:53.268922 16176 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:53.278380 16176 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.195:39913
I20260808 14:33:53.278417 16374 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.195:39913 every 8 connection(s)
I20260808 14:33:53.279321 16176 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
I20260808 14:33:53.284045 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 16176
I20260808 14:33:53.284170 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-2/wal/instance
I20260808 14:33:53.284516 11791 external_mini_cluster.cc:1428] Setting key 6c447f43afe47cee5bbf02d7992b9382
Aug 08 14:33:53 dist-test-slave-twwt krb5kdc[15566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199633, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.195@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:33:53.293210 15685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:53.281248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:33157 (local address 127.11.131.254:39403)
0808 14:33:53.281409 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:53.281414 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:53.282335 (+ 921us) server_negotiation.cc:407] Connection header received
0808 14:33:53.283678 (+ 1343us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:53.283681 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:53.283730 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:53.283806 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:33:53.285266 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:53.286007 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:53.287245 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:53.287473 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:53.287557 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:53.289883 (+ 2326us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:33:53.289886 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:33:53.289888 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:33:53.289912 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:33:53.291383 (+ 1471us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:53.291832 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:53.291834 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:53.291835 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:53.291910 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:53.292201 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:53.292204 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:53.292205 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:53.292371 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:33:53.292447 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:53.292971 (+ 524us) server_negotiation.cc:299] Negotiation successful
0808 14:33:53.293089 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 14:33:53.294029 16380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:53.281713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:39403 (local address 127.11.131.195:33157)
0808 14:33:53.282175 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:53.282218 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:53.283468 (+ 1250us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:53.284037 (+ 569us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:53.284048 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:53.284571 (+ 523us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:33:53.285140 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:53.285154 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:53.286134 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:53.286136 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:53.287135 (+ 999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:53.287145 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:53.287606 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:53.287609 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:53.287751 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:53.288270 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:33:53.288286 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:33:53.289727 (+ 1441us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:33:53.291480 (+ 1753us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:53.291485 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:53.291496 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:53.291732 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:53.291991 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:53.291994 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:53.291995 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:53.292122 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:53.292468 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:33:53.292473 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:33:53.292728 (+ 255us) client_negotiation.cc:769] Sending connection context
0808 14:33:53.292908 (+ 180us) client_negotiation.cc:240] Negotiation successful
0808 14:33:53.293151 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":122,"threads_started":1}
I20260808 14:33:53.295202 16376 heartbeater.cc:347] Connected to a master server at 127.11.131.254:39403
I20260808 14:33:53.295439 16376 heartbeater.cc:464] Registering TS with master...
I20260808 14:33:53.295889 16376 heartbeater.cc:511] Master 127.11.131.254:39403 requested a full tablet report, sending...
I20260808 14:33:53.296980 15630 ts_manager.cc:194] Registered new tserver with Master: 516d834f247b4ec88548b83aa2d6e6b8 (127.11.131.195:39913)
I20260808 14:33:53.297642 15630 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.195@KRBTEST.COM'} at 127.11.131.195:33157
I20260808 14:33:53.298903 11791 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 14:33:53.314219 15685 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:33:53.312649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38252 (local address 127.11.131.254:39403)
0808 14:33:53.312894 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:53.312899 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:53.313032 (+ 133us) server_negotiation.cc:407] Connection header received
0808 14:33:53.313220 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:53.313223 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:53.313267 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:53.313354 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:33:53.314083 (+ 729us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38252: BlockingRecv error: recv got EOF from 127.0.0.1:38252 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 14:33:53.315600 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 15725
I20260808 14:33:53.329279 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 15966
I20260808 14:33:53.353664 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 16176
I20260808 14:33:53.365046 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 15582
2026-08-08T14:33:53Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2480 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786199615258783-11791-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:33:53 dist-test-slave-twwt krb5kdc[16393](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:33:53 dist-test-slave-twwt krb5kdc[16393](info): set up 2 sockets
Aug 08 14:33:53 dist-test-slave-twwt krb5kdc[16393](info): commencing operation
krb5kdc: starting...
W20260808 14:33:54.709272 11791 mini_kdc.cc:121] Time spent starting KDC: real 1.315s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Aug 08 14:33:54 dist-test-slave-twwt krb5kdc[16393](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199634, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:33:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:33:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.131.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
I20260808 14:33:54.837358 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:40743
--webserver_interface=127.11.131.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:34955
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:40743
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:33:54.974852 16415 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:33:54.975111 16415 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:33:54.975152 16415 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:33:54.979176 16415 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:33:54.979240 16415 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:33:54.979260 16415 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:33:54.979277 16415 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:33:54.979292 16415 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:33:54.984601 16415 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:34955
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786199615258783-11791-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:40743
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:40743
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.131.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16415
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:33:54.985713 16415 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:33:54.986845 16415 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:33:54.995697 16426 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:33:54.995707 16424 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:33:54.995850 16415 server_base.cc:1034] running on GCE node
W20260808 14:33:54.995715 16423 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:33:54.996519 16415 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:33:54.997587 16415 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:33:54.998730 16415 hybrid_clock.cc:648] HybridClock initialized: now 1786199634998706 us; error 45 us; skew 500 ppm
Aug 08 14:33:54 dist-test-slave-twwt krb5kdc[16393](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199634, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:33:55.001515 16415 init.cc:377] Logged in from keytab as kudu/127.11.131.254@KRBTEST.COM (short username kudu)
I20260808 14:33:55.002435 16415 webserver.cc:460] Webserver started at http://127.11.131.254:43285/ using document root <none> and password file <none>
I20260808 14:33:55.003060 16415 fs_manager.cc:359] Metadata directory not provided
I20260808 14:33:55.003153 16415 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:33:55.003402 16415 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:33:55.005499 16415 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786199615258783-11791-0/minicluster-data/master-0/data/instance:
uuid: "6bddef0645ef435f996afadae649697f"
format_stamp: "Formatted at 2026-08-08 14:33:54 on dist-test-slave-twwt"
server_key: "1e3b87a8bc90f625734e32eda9e3fb3e"
server_key_iv: "021d6a80121cb9e9d4ead4c9dcc161c6"
server_key_version: "encryptionkey@0"
I20260808 14:33:55.006072 16415 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786199615258783-11791-0/minicluster-data/master-0/wal/instance:
uuid: "6bddef0645ef435f996afadae649697f"
format_stamp: "Formatted at 2026-08-08 14:33:54 on dist-test-slave-twwt"
server_key: "1e3b87a8bc90f625734e32eda9e3fb3e"
server_key_iv: "021d6a80121cb9e9d4ead4c9dcc161c6"
server_key_version: "encryptionkey@0"
I20260808 14:33:55.009892 16415 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 14:33:55.012452 16438 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:55.013773 16415 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 14:33:55.013923 16415 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "6bddef0645ef435f996afadae649697f"
format_stamp: "Formatted at 2026-08-08 14:33:54 on dist-test-slave-twwt"
server_key: "1e3b87a8bc90f625734e32eda9e3fb3e"
server_key_iv: "021d6a80121cb9e9d4ead4c9dcc161c6"
server_key_version: "encryptionkey@0"
I20260808 14:33:55.014045 16415 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:33:55.038899 16415 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:33:55.042407 16415 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:33:55.042650 16415 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:33:55.049839 16415 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.254:40743
I20260808 14:33:55.050132 16524 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.254:40743 every 8 connection(s)
I20260808 14:33:55.050915 16415 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:33:55.053843 16525 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:33:55.055146 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 16415
I20260808 14:33:55.055269 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786199615258783-11791-0/minicluster-data/master-0/wal/instance
I20260808 14:33:55.055600 11791 external_mini_cluster.cc:1428] Setting key 3411ad8296badc0f596418c783c9d114
I20260808 14:33:55.060767 16525 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6bddef0645ef435f996afadae649697f: Bootstrap starting.
I20260808 14:33:55.063616 16525 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6bddef0645ef435f996afadae649697f: Neither blocks nor log segments found. Creating new log.
I20260808 14:33:55.064646 16525 log.cc:824] T 00000000000000000000000000000000 P 6bddef0645ef435f996afadae649697f: Log is configured to *not* fsync() on all Append() calls
Aug 08 14:33:55 dist-test-slave-twwt krb5kdc[16393](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199634, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:33:55.067260 16525 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6bddef0645ef435f996afadae649697f: No bootstrap required, opened a new log
I20260808 14:33:55.070973 16528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:55.056951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47700 (local address 127.11.131.254:40743)
0808 14:33:55.057398 (+ 447us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:55.057415 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:55.057452 (+ 37us) server_negotiation.cc:407] Connection header received
0808 14:33:55.058084 (+ 632us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:55.058102 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:55.058435 (+ 333us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:55.058811 (+ 376us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:33:55.059715 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:55.060682 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:55.061827 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:55.062301 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:55.062426 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:55.065661 (+ 3235us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:33:55.065671 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:33:55.065690 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:33:55.065720 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:33:55.067731 (+ 2011us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:55.068149 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:55.068155 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:55.068162 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:55.068300 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:55.068566 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:55.068569 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:55.068570 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:55.069080 (+ 510us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:33:55.069284 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:55.069604 (+ 320us) server_negotiation.cc:299] Negotiation successful
0808 14:33:55.069968 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":291,"thread_start_us":131,"threads_started":1}
I20260808 14:33:55.072031 16525 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6bddef0645ef435f996afadae649697f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6bddef0645ef435f996afadae649697f" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 40743 } }
I20260808 14:33:55.072296 16525 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6bddef0645ef435f996afadae649697f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:33:55.072363 16525 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6bddef0645ef435f996afadae649697f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6bddef0645ef435f996afadae649697f, State: Initialized, Role: FOLLOWER
I20260808 14:33:55.072846 16525 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6bddef0645ef435f996afadae649697f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6bddef0645ef435f996afadae649697f" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 40743 } }
I20260808 14:33:55.072983 16525 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6bddef0645ef435f996afadae649697f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:33:55.073068 16525 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6bddef0645ef435f996afadae649697f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:33:55.073172 16525 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6bddef0645ef435f996afadae649697f [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:33:55.074215 16525 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6bddef0645ef435f996afadae649697f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6bddef0645ef435f996afadae649697f" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 40743 } }
I20260808 14:33:55.074483 11791 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:33:55.074594 16525 leader_election.cc:302] T 00000000000000000000000000000000 P 6bddef0645ef435f996afadae649697f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6bddef0645ef435f996afadae649697f; no voters:
I20260808 14:33:55.074970 16525 leader_election.cc:288] T 00000000000000000000000000000000 P 6bddef0645ef435f996afadae649697f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:33:55.075081 16531 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6bddef0645ef435f996afadae649697f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:33:55.075335 16531 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6bddef0645ef435f996afadae649697f [term 1 LEADER]: Becoming Leader. State: Replica: 6bddef0645ef435f996afadae649697f, State: Running, Role: LEADER
I20260808 14:33:55.075639 16531 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6bddef0645ef435f996afadae649697f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6bddef0645ef435f996afadae649697f" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 40743 } }
I20260808 14:33:55.076347 16525 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6bddef0645ef435f996afadae649697f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:33:55.076752 16531 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6bddef0645ef435f996afadae649697f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6bddef0645ef435f996afadae649697f. Latest consensus state: current_term: 1 leader_uuid: "6bddef0645ef435f996afadae649697f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6bddef0645ef435f996afadae649697f" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 40743 } } }
I20260808 14:33:55.076872 16531 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6bddef0645ef435f996afadae649697f [sys.catalog]: This master's current role is: LEADER
I20260808 14:33:55.077190 16533 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6bddef0645ef435f996afadae649697f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6bddef0645ef435f996afadae649697f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6bddef0645ef435f996afadae649697f" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 40743 } } }
I20260808 14:33:55.077253 16533 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6bddef0645ef435f996afadae649697f [sys.catalog]: This master's current role is: LEADER
W20260808 14:33:55.081693 16556 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6bddef0645ef435f996afadae649697f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:33:55.081822 16556 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:33:55.082774 16538 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:33:55.083932 16538 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:33:55.090246 16538 catalog_manager.cc:1347] Generated new cluster ID: 59cb56fc7cd04d6c9af7b2a320ded4f2
I20260808 14:33:55.090322 16538 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:33:55.096819 16538 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:33:55.097958 16528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:55.091807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47702 (local address 127.11.131.254:40743)
0808 14:33:55.091909 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:55.091914 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:55.092284 (+ 370us) server_negotiation.cc:407] Connection header received
0808 14:33:55.092439 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:55.092442 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:55.092490 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:55.092584 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:33:55.093228 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:55.094038 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:55.095302 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:55.095556 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:55.095679 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:55.096744 (+ 1065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:33:55.096748 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:33:55.096752 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:33:55.097343 (+ 591us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:33:55.097377 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:33:55.097396 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:33:55.097460 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:55.097655 (+ 195us) server_negotiation.cc:299] Negotiation successful
0808 14:33:55.097797 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":60,"server-negotiator.queue_time_us":35}
I20260808 14:33:55.098373 16538 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:33:55.107165 16538 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6bddef0645ef435f996afadae649697f: Generated new TSK 0
I20260808 14:33:55.108088 16538 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:33:55.120493 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 16415
2026-08-08T14:33:55Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1758 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:33:55 dist-test-slave-twwt krb5kdc[16573](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:33:55 dist-test-slave-twwt krb5kdc[16573](info): set up 2 sockets
Aug 08 14:33:55 dist-test-slave-twwt krb5kdc[16573](info): commencing operation
krb5kdc: starting...
W20260808 14:33:56.378922 11791 mini_kdc.cc:121] Time spent starting KDC: real 1.226s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Aug 08 14:33:56 dist-test-slave-twwt krb5kdc[16573](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199636, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:33:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:33:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.131.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
I20260808 14:33:56.509742 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:45819
--webserver_interface=127.11.131.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:46443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:45819
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:33:56.633847 16596 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:33:56.634202 16596 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:33:56.634316 16596 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:33:56.638789 16596 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:33:56.638890 16596 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:33:56.638931 16596 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:33:56.638967 16596 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:33:56.639000 16596 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:33:56.644500 16596 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:46443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:45819
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:45819
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.131.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16596
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:33:56.645710 16596 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:33:56.646852 16596 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:33:56.656061 16602 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:33:56.656211 16596 server_base.cc:1034] running on GCE node
W20260808 14:33:56.656061 16605 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:33:56.656066 16607 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:33:56.657040 16596 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:33:56.658258 16596 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:33:56.659447 16596 hybrid_clock.cc:648] HybridClock initialized: now 1786199636659395 us; error 68 us; skew 500 ppm
Aug 08 14:33:56 dist-test-slave-twwt krb5kdc[16573](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199636, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:33:56.667770 16596 init.cc:377] Logged in from keytab as kudu/127.11.131.254@KRBTEST.COM (short username kudu)
I20260808 14:33:56.668779 16596 webserver.cc:460] Webserver started at http://127.11.131.254:40435/ using document root <none> and password file <none>
I20260808 14:33:56.669396 16596 fs_manager.cc:359] Metadata directory not provided
I20260808 14:33:56.669494 16596 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:33:56.669749 16596 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:33:56.672015 16596 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/master-0/data/instance:
uuid: "54985d83cc3d4a1890c5ff37621d1cae"
format_stamp: "Formatted at 2026-08-08 14:33:56 on dist-test-slave-twwt"
server_key: "a257bfb50c68ef805e8e1c6ec5689326"
server_key_iv: "9c739a193050b0cde7b7165f1e878b79"
server_key_version: "encryptionkey@0"
I20260808 14:33:56.672621 16596 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/master-0/wal/instance:
uuid: "54985d83cc3d4a1890c5ff37621d1cae"
format_stamp: "Formatted at 2026-08-08 14:33:56 on dist-test-slave-twwt"
server_key: "a257bfb50c68ef805e8e1c6ec5689326"
server_key_iv: "9c739a193050b0cde7b7165f1e878b79"
server_key_version: "encryptionkey@0"
I20260808 14:33:56.676587 16596 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 14:33:56.679175 16617 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:56.680423 16596 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 14:33:56.680573 16596 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "54985d83cc3d4a1890c5ff37621d1cae"
format_stamp: "Formatted at 2026-08-08 14:33:56 on dist-test-slave-twwt"
server_key: "a257bfb50c68ef805e8e1c6ec5689326"
server_key_iv: "9c739a193050b0cde7b7165f1e878b79"
server_key_version: "encryptionkey@0"
I20260808 14:33:56.680692 16596 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:33:56.700227 16596 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:33:56.703302 16596 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:33:56.703523 16596 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:33:56.711254 16596 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.254:45819
I20260808 14:33:56.711560 16698 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.254:45819 every 8 connection(s)
I20260808 14:33:56.712363 16596 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:33:56.715582 16699 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:33:56.717842 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 16596
I20260808 14:33:56.717942 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/master-0/wal/instance
I20260808 14:33:56.718228 11791 external_mini_cluster.cc:1428] Setting key 887d959f2642c5aa74a43644ef42b90c
I20260808 14:33:56.721909 16699 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54985d83cc3d4a1890c5ff37621d1cae: Bootstrap starting.
I20260808 14:33:56.724367 16699 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 54985d83cc3d4a1890c5ff37621d1cae: Neither blocks nor log segments found. Creating new log.
I20260808 14:33:56.725162 16699 log.cc:824] T 00000000000000000000000000000000 P 54985d83cc3d4a1890c5ff37621d1cae: Log is configured to *not* fsync() on all Append() calls
Aug 08 14:33:56 dist-test-slave-twwt krb5kdc[16573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199636, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:33:56.727716 16699 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54985d83cc3d4a1890c5ff37621d1cae: No bootstrap required, opened a new log
I20260808 14:33:56.731680 16699 raft_consensus.cc:348] T 00000000000000000000000000000000 P 54985d83cc3d4a1890c5ff37621d1cae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54985d83cc3d4a1890c5ff37621d1cae" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 45819 } }
I20260808 14:33:56.731959 16699 raft_consensus.cc:374] T 00000000000000000000000000000000 P 54985d83cc3d4a1890c5ff37621d1cae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:33:56.732087 16699 raft_consensus.cc:729] T 00000000000000000000000000000000 P 54985d83cc3d4a1890c5ff37621d1cae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54985d83cc3d4a1890c5ff37621d1cae, State: Initialized, Role: FOLLOWER
I20260808 14:33:56.732620 16699 consensus_queue.cc:260] T 00000000000000000000000000000000 P 54985d83cc3d4a1890c5ff37621d1cae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54985d83cc3d4a1890c5ff37621d1cae" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 45819 } }
I20260808 14:33:56.732771 16699 raft_consensus.cc:388] T 00000000000000000000000000000000 P 54985d83cc3d4a1890c5ff37621d1cae [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:33:56.732863 16699 raft_consensus.cc:482] T 00000000000000000000000000000000 P 54985d83cc3d4a1890c5ff37621d1cae [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:33:56.732988 16699 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 54985d83cc3d4a1890c5ff37621d1cae [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:33:56.733150 16706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:56.719758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45336 (local address 127.11.131.254:45819)
0808 14:33:56.720249 (+ 491us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:56.720266 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:56.720303 (+ 37us) server_negotiation.cc:407] Connection header received
0808 14:33:56.720961 (+ 658us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:56.720978 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:56.721319 (+ 341us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:56.721670 (+ 351us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:33:56.722507 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:56.723578 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:56.724470 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:56.724957 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:56.725130 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:56.728117 (+ 2987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:33:56.728123 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:33:56.728137 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:33:56.728166 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:33:56.729893 (+ 1727us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:56.730385 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:56.730391 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:56.730397 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:56.730529 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:56.730850 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:56.730853 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:56.730855 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:56.731279 (+ 424us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:33:56.731505 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:56.731823 (+ 318us) server_negotiation.cc:299] Negotiation successful
0808 14:33:56.732183 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":343,"thread_start_us":143,"threads_started":1}
I20260808 14:33:56.734038 16699 raft_consensus.cc:504] T 00000000000000000000000000000000 P 54985d83cc3d4a1890c5ff37621d1cae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54985d83cc3d4a1890c5ff37621d1cae" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 45819 } }
I20260808 14:33:56.734408 16699 leader_election.cc:302] T 00000000000000000000000000000000 P 54985d83cc3d4a1890c5ff37621d1cae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 54985d83cc3d4a1890c5ff37621d1cae; no voters:
I20260808 14:33:56.734825 16699 leader_election.cc:288] T 00000000000000000000000000000000 P 54985d83cc3d4a1890c5ff37621d1cae [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:33:56.734916 16709 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 54985d83cc3d4a1890c5ff37621d1cae [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:33:56.735103 16709 raft_consensus.cc:686] T 00000000000000000000000000000000 P 54985d83cc3d4a1890c5ff37621d1cae [term 1 LEADER]: Becoming Leader. State: Replica: 54985d83cc3d4a1890c5ff37621d1cae, State: Running, Role: LEADER
I20260808 14:33:56.735469 16709 consensus_queue.cc:237] T 00000000000000000000000000000000 P 54985d83cc3d4a1890c5ff37621d1cae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54985d83cc3d4a1890c5ff37621d1cae" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 45819 } }
I20260808 14:33:56.736199 16699 sys_catalog.cc:564] T 00000000000000000000000000000000 P 54985d83cc3d4a1890c5ff37621d1cae [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:33:56.737331 16710 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54985d83cc3d4a1890c5ff37621d1cae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "54985d83cc3d4a1890c5ff37621d1cae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54985d83cc3d4a1890c5ff37621d1cae" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 45819 } } }
I20260808 14:33:56.737357 16711 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54985d83cc3d4a1890c5ff37621d1cae [sys.catalog]: SysCatalogTable state changed. Reason: New leader 54985d83cc3d4a1890c5ff37621d1cae. Latest consensus state: current_term: 1 leader_uuid: "54985d83cc3d4a1890c5ff37621d1cae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54985d83cc3d4a1890c5ff37621d1cae" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 45819 } } }
I20260808 14:33:56.737551 16711 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54985d83cc3d4a1890c5ff37621d1cae [sys.catalog]: This master's current role is: LEADER
I20260808 14:33:56.737846 16710 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54985d83cc3d4a1890c5ff37621d1cae [sys.catalog]: This master's current role is: LEADER
I20260808 14:33:56.738018 16723 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:33:56.741423 16723 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:33:56.747627 16723 catalog_manager.cc:1347] Generated new cluster ID: 5618d28bede040c29f064e9785abb2a4
I20260808 14:33:56.747709 16723 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:33:56.756512 16723 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:33:56.757511 16723 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:33:56.771984 16723 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 54985d83cc3d4a1890c5ff37621d1cae: Generated new TSK 0
I20260808 14:33:56.772812 16723 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.131.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab.
Entry for principal kudu/127.11.131.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab.
I20260808 14:33:56.809743 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.193:0
--local_ip_for_outbound_sockets=127.11.131.193
--webserver_interface=127.11.131.193
--webserver_port=0
--tserver_master_addrs=127.11.131.254:45819
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab
--principal=kudu/127.11.131.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:46443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:33:56.936329 16749 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:33:56.936683 16749 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:33:56.936802 16749 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:33:56.941558 16749 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:33:56.941628 16749 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:33:56.941730 16749 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.193
I20260808 14:33:56.947407 16749 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:46443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab
--principal=kudu/127.11.131.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.131.193
--webserver_port=0
--tserver_master_addrs=127.11.131.254:45819
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16749
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.193
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:33:56.948575 16749 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:33:56.949717 16749 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:33:56.960026 16756 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:33:56.960089 16749 server_base.cc:1034] running on GCE node
W20260808 14:33:56.960040 16757 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:33:56.960033 16760 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:33:56.960700 16749 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:33:56.961340 16749 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:33:56.962533 16749 hybrid_clock.cc:648] HybridClock initialized: now 1786199636962499 us; error 45 us; skew 500 ppm
Aug 08 14:33:56 dist-test-slave-twwt krb5kdc[16573](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199636, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:33:56.965276 16749 init.cc:377] Logged in from keytab as kudu/127.11.131.193@KRBTEST.COM (short username kudu)
I20260808 14:33:56.966126 16749 webserver.cc:460] Webserver started at http://127.11.131.193:41515/ using document root <none> and password file <none>
I20260808 14:33:56.966761 16749 fs_manager.cc:359] Metadata directory not provided
I20260808 14:33:56.966853 16749 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:33:56.967105 16749 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:33:56.969228 16749 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-0/data/instance:
uuid: "0c96fcb141884d24b6fbb6db60b13289"
format_stamp: "Formatted at 2026-08-08 14:33:56 on dist-test-slave-twwt"
server_key: "1b1625fd2c4a6236e7a1d6dd4ea1ade7"
server_key_iv: "b701780c49bfb1e25abc6e40e65b537f"
server_key_version: "encryptionkey@0"
I20260808 14:33:56.969818 16749 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-0/wal/instance:
uuid: "0c96fcb141884d24b6fbb6db60b13289"
format_stamp: "Formatted at 2026-08-08 14:33:56 on dist-test-slave-twwt"
server_key: "1b1625fd2c4a6236e7a1d6dd4ea1ade7"
server_key_iv: "b701780c49bfb1e25abc6e40e65b537f"
server_key_version: "encryptionkey@0"
I20260808 14:33:56.973767 16749 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 14:33:56.976332 16773 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:56.977639 16749 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260808 14:33:56.977780 16749 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-0/wal
uuid: "0c96fcb141884d24b6fbb6db60b13289"
format_stamp: "Formatted at 2026-08-08 14:33:56 on dist-test-slave-twwt"
server_key: "1b1625fd2c4a6236e7a1d6dd4ea1ade7"
server_key_iv: "b701780c49bfb1e25abc6e40e65b537f"
server_key_version: "encryptionkey@0"
I20260808 14:33:56.977905 16749 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:33:56.997542 16749 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:33:57.001420 16749 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:33:57.001653 16749 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:33:57.002337 16749 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:33:57.003298 16749 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:33:57.003378 16749 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:57.003455 16749 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:33:57.003504 16749 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:57.013468 16749 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.193:40281
I20260808 14:33:57.013509 16941 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.193:40281 every 8 connection(s)
I20260808 14:33:57.014438 16749 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
I20260808 14:33:57.019234 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 16749
I20260808 14:33:57.019379 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-0/wal/instance
I20260808 14:33:57.019707 11791 external_mini_cluster.cc:1428] Setting key 313c0fd70660481ccd8bfcf7648b87cd
Aug 08 14:33:57 dist-test-slave-twwt krb5kdc[16573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199636, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.193@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:33:57.029812 16706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:57.016424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:52827 (local address 127.11.131.254:45819)
0808 14:33:57.016582 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:57.016585 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:57.017477 (+ 892us) server_negotiation.cc:407] Connection header received
0808 14:33:57.019046 (+ 1569us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:57.019051 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:57.019125 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:57.019233 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:33:57.020684 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:57.021404 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:57.022571 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:57.023009 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:57.023138 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:57.026024 (+ 2886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:33:57.026027 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:33:57.026029 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:33:57.026053 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:33:57.027685 (+ 1632us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:57.028225 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:57.028229 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:57.028231 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:57.028321 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:57.028673 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:57.028677 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:57.028679 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:57.028870 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:33:57.028982 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:57.029487 (+ 505us) server_negotiation.cc:299] Negotiation successful
0808 14:33:57.029623 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":20,"server-negotiator.queue_time_us":65}
WARNING: no policy specified for kudu/127.11.131.194@KRBTEST.COM; defaulting to no policy
I20260808 14:33:57.030711 16948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:57.016805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45819 (local address 127.11.131.193:52827)
0808 14:33:57.017293 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:57.017353 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:57.018759 (+ 1406us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:57.019468 (+ 709us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:57.019483 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:57.019918 (+ 435us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:33:57.020541 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:57.020557 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:57.021536 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:57.021539 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:57.022430 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:57.022440 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:57.023158 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:57.023161 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:57.023360 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:57.024047 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:33:57.024073 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:33:57.025838 (+ 1765us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:33:57.027818 (+ 1980us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:57.027825 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:57.027840 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:57.028111 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:57.028418 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:57.028421 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:57.028423 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:57.028573 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:57.028983 (+ 410us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:33:57.028991 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:33:57.029246 (+ 255us) client_negotiation.cc:769] Sending connection context
0808 14:33:57.029443 (+ 197us) client_negotiation.cc:240] Negotiation successful
0808 14:33:57.029774 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":114,"threads_started":1}
I20260808 14:33:57.032166 16943 heartbeater.cc:347] Connected to a master server at 127.11.131.254:45819
I20260808 14:33:57.032457 16943 heartbeater.cc:464] Registering TS with master...
I20260808 14:33:57.033001 16943 heartbeater.cc:511] Master 127.11.131.254:45819 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.194@KRBTEST.COM" created.
I20260808 14:33:57.034703 16646 ts_manager.cc:194] Registered new tserver with Master: 0c96fcb141884d24b6fbb6db60b13289 (127.11.131.193:40281)
I20260808 14:33:57.035930 16646 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.193@KRBTEST.COM'} at 127.11.131.193:52827
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab.
Entry for principal kudu/127.11.131.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab.
I20260808 14:33:57.050352 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.194:0
--local_ip_for_outbound_sockets=127.11.131.194
--webserver_interface=127.11.131.194
--webserver_port=0
--tserver_master_addrs=127.11.131.254:45819
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab
--principal=kudu/127.11.131.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:46443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:33:57.168200 16951 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:33:57.168453 16951 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:33:57.168495 16951 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:33:57.172617 16951 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:33:57.172679 16951 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:33:57.172762 16951 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.194
I20260808 14:33:57.178126 16951 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:46443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab
--principal=kudu/127.11.131.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.131.194
--webserver_port=0
--tserver_master_addrs=127.11.131.254:45819
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16951
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.194
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:33:57.179347 16951 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:33:57.180382 16951 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:33:57.190869 16965 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:33:57.190892 16960 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:33:57.191094 16951 server_base.cc:1034] running on GCE node
W20260808 14:33:57.191011 16959 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:33:57.191612 16951 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:33:57.192317 16951 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:33:57.193516 16951 hybrid_clock.cc:648] HybridClock initialized: now 1786199637193498 us; error 35 us; skew 500 ppm
Aug 08 14:33:57 dist-test-slave-twwt krb5kdc[16573](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199637, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:33:57.196379 16951 init.cc:377] Logged in from keytab as kudu/127.11.131.194@KRBTEST.COM (short username kudu)
I20260808 14:33:57.197239 16951 webserver.cc:460] Webserver started at http://127.11.131.194:37381/ using document root <none> and password file <none>
I20260808 14:33:57.197783 16951 fs_manager.cc:359] Metadata directory not provided
I20260808 14:33:57.197841 16951 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:33:57.198014 16951 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:33:57.200630 16951 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-1/data/instance:
uuid: "869f384a79b7424185d7985ba6b73f60"
format_stamp: "Formatted at 2026-08-08 14:33:57 on dist-test-slave-twwt"
server_key: "bf5f8dac669ed2950106d2d3026e7b00"
server_key_iv: "23d85520a8970f33ce61b6fd2ac69483"
server_key_version: "encryptionkey@0"
I20260808 14:33:57.201224 16951 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-1/wal/instance:
uuid: "869f384a79b7424185d7985ba6b73f60"
format_stamp: "Formatted at 2026-08-08 14:33:57 on dist-test-slave-twwt"
server_key: "bf5f8dac669ed2950106d2d3026e7b00"
server_key_iv: "23d85520a8970f33ce61b6fd2ac69483"
server_key_version: "encryptionkey@0"
I20260808 14:33:57.205056 16951 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260808 14:33:57.207564 16975 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:57.208832 16951 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 14:33:57.208940 16951 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-1/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-1/wal
uuid: "869f384a79b7424185d7985ba6b73f60"
format_stamp: "Formatted at 2026-08-08 14:33:57 on dist-test-slave-twwt"
server_key: "bf5f8dac669ed2950106d2d3026e7b00"
server_key_iv: "23d85520a8970f33ce61b6fd2ac69483"
server_key_version: "encryptionkey@0"
I20260808 14:33:57.209028 16951 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:33:57.231271 16951 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:33:57.234261 16951 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:33:57.234426 16951 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:33:57.235044 16951 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:33:57.235849 16951 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:33:57.235898 16951 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:57.235940 16951 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:33:57.235961 16951 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:57.246825 16951 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.194:37393
I20260808 14:33:57.246822 17139 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.194:37393 every 8 connection(s)
I20260808 14:33:57.247896 16951 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
I20260808 14:33:57.248478 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 16951
I20260808 14:33:57.248607 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-1/wal/instance
I20260808 14:33:57.249006 11791 external_mini_cluster.cc:1428] Setting key 9575a7864cb4f8bf2b2cf8f92844512a
Aug 08 14:33:57 dist-test-slave-twwt krb5kdc[16573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199637, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.194@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.131.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.195@KRBTEST.COM" created.
I20260808 14:33:57.264577 16706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:57.249906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:47979 (local address 127.11.131.254:45819)
0808 14:33:57.250084 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:57.250089 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:57.251059 (+ 970us) server_negotiation.cc:407] Connection header received
0808 14:33:57.252460 (+ 1401us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:57.252468 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:57.252564 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:57.252703 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:33:57.254717 (+ 2014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:57.255693 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:57.256887 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:57.257353 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:57.257503 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:57.260492 (+ 2989us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:33:57.260497 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:33:57.260500 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:33:57.260534 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:33:57.262150 (+ 1616us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:57.262927 (+ 777us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:57.262930 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:57.262931 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:57.263018 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:57.263387 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:57.263390 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:57.263391 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:57.263579 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:33:57.263656 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:57.264272 (+ 616us) server_negotiation.cc:299] Negotiation successful
0808 14:33:57.264438 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 14:33:57.265668 17142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:57.250357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45819 (local address 127.11.131.194:47979)
0808 14:33:57.250883 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:57.250937 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:57.252238 (+ 1301us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:57.253167 (+ 929us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:57.253180 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:57.253751 (+ 571us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:33:57.254493 (+ 742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:57.254511 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:57.255853 (+ 1342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:57.255856 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:57.256742 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:57.256753 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:57.257523 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:57.257526 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:57.257667 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:57.258322 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:33:57.258339 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:33:57.260251 (+ 1912us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:33:57.262288 (+ 2037us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:57.262294 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:57.262308 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:57.262802 (+ 494us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:57.263132 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:57.263135 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:57.263136 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:57.263279 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:57.263675 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:33:57.263680 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:33:57.264033 (+ 353us) client_negotiation.cc:769] Sending connection context
0808 14:33:57.264196 (+ 163us) client_negotiation.cc:240] Negotiation successful
0808 14:33:57.264573 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":304,"thread_start_us":146,"threads_started":1}
I20260808 14:33:57.266955 17140 heartbeater.cc:347] Connected to a master server at 127.11.131.254:45819
I20260808 14:33:57.267369 17140 heartbeater.cc:464] Registering TS with master...
I20260808 14:33:57.268005 17140 heartbeater.cc:511] Master 127.11.131.254:45819 requested a full tablet report, sending...
I20260808 14:33:57.269198 16646 ts_manager.cc:194] Registered new tserver with Master: 869f384a79b7424185d7985ba6b73f60 (127.11.131.194:37393)
I20260808 14:33:57.270143 16646 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.194@KRBTEST.COM'} at 127.11.131.194:47979
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab.
Entry for principal kudu/127.11.131.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab.
I20260808 14:33:57.282697 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.195:0
--local_ip_for_outbound_sockets=127.11.131.195
--webserver_interface=127.11.131.195
--webserver_port=0
--tserver_master_addrs=127.11.131.254:45819
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab
--principal=kudu/127.11.131.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:46443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:33:57.399955 17147 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:33:57.400195 17147 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:33:57.400236 17147 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:33:57.404119 17147 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:33:57.404172 17147 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:33:57.404227 17147 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.195
I20260808 14:33:57.409351 17147 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:46443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab
--principal=kudu/127.11.131.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.131.195
--webserver_port=0
--tserver_master_addrs=127.11.131.254:45819
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17147
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.195
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:33:57.410328 17147 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:33:57.411369 17147 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:33:57.421263 17159 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:33:57.421319 17157 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:33:57.421319 17154 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:33:57.421612 17147 server_base.cc:1034] running on GCE node
I20260808 14:33:57.422006 17147 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:33:57.422748 17147 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:33:57.423939 17147 hybrid_clock.cc:648] HybridClock initialized: now 1786199637423922 us; error 28 us; skew 500 ppm
Aug 08 14:33:57 dist-test-slave-twwt krb5kdc[16573](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199637, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:33:57.426748 17147 init.cc:377] Logged in from keytab as kudu/127.11.131.195@KRBTEST.COM (short username kudu)
I20260808 14:33:57.427583 17147 webserver.cc:460] Webserver started at http://127.11.131.195:44517/ using document root <none> and password file <none>
I20260808 14:33:57.428109 17147 fs_manager.cc:359] Metadata directory not provided
I20260808 14:33:57.428169 17147 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:33:57.428334 17147 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:33:57.430359 17147 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-2/data/instance:
uuid: "91b8063bf162495a8500d11212c74afe"
format_stamp: "Formatted at 2026-08-08 14:33:57 on dist-test-slave-twwt"
server_key: "3df91f04c2aa1c1c266b7d51c710e516"
server_key_iv: "f6918311453294962bc97e1080fe9cf1"
server_key_version: "encryptionkey@0"
I20260808 14:33:57.430969 17147 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-2/wal/instance:
uuid: "91b8063bf162495a8500d11212c74afe"
format_stamp: "Formatted at 2026-08-08 14:33:57 on dist-test-slave-twwt"
server_key: "3df91f04c2aa1c1c266b7d51c710e516"
server_key_iv: "f6918311453294962bc97e1080fe9cf1"
server_key_version: "encryptionkey@0"
I20260808 14:33:57.434713 17147 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 14:33:57.437249 17168 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:57.438848 17147 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:33:57.438953 17147 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-2/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-2/wal
uuid: "91b8063bf162495a8500d11212c74afe"
format_stamp: "Formatted at 2026-08-08 14:33:57 on dist-test-slave-twwt"
server_key: "3df91f04c2aa1c1c266b7d51c710e516"
server_key_iv: "f6918311453294962bc97e1080fe9cf1"
server_key_version: "encryptionkey@0"
I20260808 14:33:57.439049 17147 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:33:57.452268 17147 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:33:57.455530 17147 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:33:57.455736 17147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:33:57.456336 17147 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:33:57.457217 17147 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:33:57.457289 17147 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:57.457365 17147 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:33:57.457417 17147 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:57.466429 17147 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.195:35183
I20260808 14:33:57.466491 17347 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.195:35183 every 8 connection(s)
I20260808 14:33:57.467430 17147 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
I20260808 14:33:57.470326 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 17147
I20260808 14:33:57.470467 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786199615258783-11791-0/minicluster-data/ts-2/wal/instance
I20260808 14:33:57.470880 11791 external_mini_cluster.cc:1428] Setting key 17d3352ee88036360c41577bed3acf3c
Aug 08 14:33:57 dist-test-slave-twwt krb5kdc[16573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199637, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.195@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:33:57.481799 16706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:57.469366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:60465 (local address 127.11.131.254:45819)
0808 14:33:57.469527 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:57.469532 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:57.470459 (+ 927us) server_negotiation.cc:407] Connection header received
0808 14:33:57.472471 (+ 2012us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:57.472476 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:57.472533 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:57.472618 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:33:57.473919 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:57.474469 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:57.475664 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:57.475876 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:57.475959 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:57.478393 (+ 2434us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:33:57.478403 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:33:57.478405 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:33:57.478428 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:33:57.479706 (+ 1278us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:57.480235 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:57.480238 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:57.480239 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:57.480316 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:57.480737 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:57.480739 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:57.480740 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:57.480915 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:33:57.481035 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:57.481539 (+ 504us) server_negotiation.cc:299] Negotiation successful
0808 14:33:57.481647 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 14:33:57.482748 17352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:57.469799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45819 (local address 127.11.131.195:60465)
0808 14:33:57.470287 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:57.470336 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:57.472171 (+ 1835us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:57.472789 (+ 618us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:57.472796 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:57.473279 (+ 483us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:33:57.473773 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:57.473787 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:57.474583 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:57.474586 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:57.475550 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:57.475561 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:57.476024 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:57.476027 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:57.476166 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:57.476785 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:33:57.476802 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:33:57.478233 (+ 1431us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:33:57.479814 (+ 1581us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:57.479835 (+ 21us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:57.479846 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:57.480137 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:57.480434 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:57.480437 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:57.480439 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:57.480601 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:57.481053 (+ 452us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:33:57.481059 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:33:57.481317 (+ 258us) client_negotiation.cc:769] Sending connection context
0808 14:33:57.481489 (+ 172us) client_negotiation.cc:240] Negotiation successful
0808 14:33:57.481762 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":148,"threads_started":1}
I20260808 14:33:57.484151 17348 heartbeater.cc:347] Connected to a master server at 127.11.131.254:45819
I20260808 14:33:57.484407 17348 heartbeater.cc:464] Registering TS with master...
I20260808 14:33:57.485070 17348 heartbeater.cc:511] Master 127.11.131.254:45819 requested a full tablet report, sending...
I20260808 14:33:57.486057 16646 ts_manager.cc:194] Registered new tserver with Master: 91b8063bf162495a8500d11212c74afe (127.11.131.195:35183)
I20260808 14:33:57.486702 16646 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.195@KRBTEST.COM'} at 127.11.131.195:60465
I20260808 14:33:57.496905 11791 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 14:33:57 dist-test-slave-twwt krb5kdc[16573](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199637, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 08 14:33:57 dist-test-slave-twwt krb5kdc[16573](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199637, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:33:57.523936 16706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:57.515751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45338 (local address 127.11.131.254:45819)
0808 14:33:57.515922 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:57.515928 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:57.516095 (+ 167us) server_negotiation.cc:407] Connection header received
0808 14:33:57.516215 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:57.516217 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:57.516262 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:57.516333 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:33:57.517072 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:57.517573 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:57.518367 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:57.518568 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:57.518709 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:57.521142 (+ 2433us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:33:57.521146 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:33:57.521148 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:33:57.521172 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:33:57.522402 (+ 1230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:57.522836 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:57.522839 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:57.522840 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:57.522925 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:57.523155 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:57.523157 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:57.523158 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:57.523355 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:33:57.523455 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:57.523629 (+ 174us) server_negotiation.cc:299] Negotiation successful
0808 14:33:57.523729 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
W20260808 14:33:57.524362 16646 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:45338
I20260808 14:33:57.525339 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 16749
I20260808 14:33:57.538017 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 16951
I20260808 14:33:57.552824 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 17147
I20260808 14:33:57.581571 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 16596
2026-08-08T14:33:57Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2460 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:33:57 dist-test-slave-twwt krb5kdc[17368](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:33:57 dist-test-slave-twwt krb5kdc[17368](info): set up 2 sockets
Aug 08 14:33:57 dist-test-slave-twwt krb5kdc[17368](info): commencing operation
krb5kdc: starting...
W20260808 14:33:58.843170 11791 mini_kdc.cc:121] Time spent starting KDC: real 1.229s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Aug 08 14:33:58 dist-test-slave-twwt krb5kdc[17368](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199638, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:33:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:33:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.131.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
I20260808 14:33:58.973601 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:32925
--webserver_interface=127.11.131.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:39613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:32925
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:33:59.090162 17391 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:33:59.090445 17391 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:33:59.090485 17391 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:33:59.094492 17391 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:33:59.094547 17391 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:33:59.094566 17391 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:33:59.094583 17391 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:33:59.094599 17391 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:33:59.099910 17391 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:39613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:32925
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:32925
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.131.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17391
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:33:59.100931 17391 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:33:59.101938 17391 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:33:59.110783 17397 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:33:59.110843 17402 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:33:59.110777 17398 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:33:59.111289 17391 server_base.cc:1034] running on GCE node
I20260808 14:33:59.111915 17391 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:33:59.113154 17391 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:33:59.114362 17391 hybrid_clock.cc:648] HybridClock initialized: now 1786199639114330 us; error 47 us; skew 500 ppm
Aug 08 14:33:59 dist-test-slave-twwt krb5kdc[17368](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199639, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:33:59.117470 17391 init.cc:377] Logged in from keytab as kudu/127.11.131.254@KRBTEST.COM (short username kudu)
I20260808 14:33:59.118535 17391 webserver.cc:460] Webserver started at http://127.11.131.254:36601/ using document root <none> and password file <none>
I20260808 14:33:59.119216 17391 fs_manager.cc:359] Metadata directory not provided
I20260808 14:33:59.119319 17391 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:33:59.119582 17391 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:33:59.121762 17391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/master-0/data/instance:
uuid: "a0d59c8111ab469a9c4ed4479b170763"
format_stamp: "Formatted at 2026-08-08 14:33:59 on dist-test-slave-twwt"
server_key: "9b3a05d2e1c80ba4ad759a496dce0691"
server_key_iv: "afc16209292fd667f72a5fb99b58d3cc"
server_key_version: "encryptionkey@0"
I20260808 14:33:59.122366 17391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/master-0/wal/instance:
uuid: "a0d59c8111ab469a9c4ed4479b170763"
format_stamp: "Formatted at 2026-08-08 14:33:59 on dist-test-slave-twwt"
server_key: "9b3a05d2e1c80ba4ad759a496dce0691"
server_key_iv: "afc16209292fd667f72a5fb99b58d3cc"
server_key_version: "encryptionkey@0"
I20260808 14:33:59.126356 17391 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.000s
I20260808 14:33:59.129032 17411 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:59.130373 17391 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 14:33:59.130541 17391 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "a0d59c8111ab469a9c4ed4479b170763"
format_stamp: "Formatted at 2026-08-08 14:33:59 on dist-test-slave-twwt"
server_key: "9b3a05d2e1c80ba4ad759a496dce0691"
server_key_iv: "afc16209292fd667f72a5fb99b58d3cc"
server_key_version: "encryptionkey@0"
I20260808 14:33:59.130720 17391 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:33:59.149924 17391 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:33:59.153379 17391 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:33:59.153597 17391 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:33:59.161363 17391 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.254:32925
I20260808 14:33:59.161392 17502 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.254:32925 every 8 connection(s)
I20260808 14:33:59.162389 17391 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:33:59.165445 17503 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:33:59.171232 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 17391
I20260808 14:33:59.171370 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/master-0/wal/instance
I20260808 14:33:59.171495 17503 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0d59c8111ab469a9c4ed4479b170763: Bootstrap starting.
I20260808 14:33:59.171689 11791 external_mini_cluster.cc:1428] Setting key b1102ff8cbe2218e875fb06347e42cbb
I20260808 14:33:59.174202 17503 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a0d59c8111ab469a9c4ed4479b170763: Neither blocks nor log segments found. Creating new log.
I20260808 14:33:59.175068 17503 log.cc:824] T 00000000000000000000000000000000 P a0d59c8111ab469a9c4ed4479b170763: Log is configured to *not* fsync() on all Append() calls
I20260808 14:33:59.177174 17503 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0d59c8111ab469a9c4ed4479b170763: No bootstrap required, opened a new log
Aug 08 14:33:59 dist-test-slave-twwt krb5kdc[17368](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199638, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:33:59.181514 17503 raft_consensus.cc:348] T 00000000000000000000000000000000 P a0d59c8111ab469a9c4ed4479b170763 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0d59c8111ab469a9c4ed4479b170763" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 32925 } }
I20260808 14:33:59.181831 17503 raft_consensus.cc:374] T 00000000000000000000000000000000 P a0d59c8111ab469a9c4ed4479b170763 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:33:59.181908 17503 raft_consensus.cc:729] T 00000000000000000000000000000000 P a0d59c8111ab469a9c4ed4479b170763 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0d59c8111ab469a9c4ed4479b170763, State: Initialized, Role: FOLLOWER
I20260808 14:33:59.182447 17503 consensus_queue.cc:260] T 00000000000000000000000000000000 P a0d59c8111ab469a9c4ed4479b170763 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0d59c8111ab469a9c4ed4479b170763" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 32925 } }
I20260808 14:33:59.182618 17503 raft_consensus.cc:388] T 00000000000000000000000000000000 P a0d59c8111ab469a9c4ed4479b170763 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:33:59.182732 17503 raft_consensus.cc:482] T 00000000000000000000000000000000 P a0d59c8111ab469a9c4ed4479b170763 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:33:59.182848 17503 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a0d59c8111ab469a9c4ed4479b170763 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:33:59.183794 17503 raft_consensus.cc:504] T 00000000000000000000000000000000 P a0d59c8111ab469a9c4ed4479b170763 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0d59c8111ab469a9c4ed4479b170763" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 32925 } }
I20260808 14:33:59.184154 17503 leader_election.cc:302] T 00000000000000000000000000000000 P a0d59c8111ab469a9c4ed4479b170763 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a0d59c8111ab469a9c4ed4479b170763; no voters:
I20260808 14:33:59.184530 17503 leader_election.cc:288] T 00000000000000000000000000000000 P a0d59c8111ab469a9c4ed4479b170763 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:33:59.184607 17508 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a0d59c8111ab469a9c4ed4479b170763 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:33:59.184819 17508 raft_consensus.cc:686] T 00000000000000000000000000000000 P a0d59c8111ab469a9c4ed4479b170763 [term 1 LEADER]: Becoming Leader. State: Replica: a0d59c8111ab469a9c4ed4479b170763, State: Running, Role: LEADER
I20260808 14:33:59.185194 17508 consensus_queue.cc:237] T 00000000000000000000000000000000 P a0d59c8111ab469a9c4ed4479b170763 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0d59c8111ab469a9c4ed4479b170763" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 32925 } }
I20260808 14:33:59.185930 17503 sys_catalog.cc:564] T 00000000000000000000000000000000 P a0d59c8111ab469a9c4ed4479b170763 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:33:59.186451 17508 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0d59c8111ab469a9c4ed4479b170763 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a0d59c8111ab469a9c4ed4479b170763. Latest consensus state: current_term: 1 leader_uuid: "a0d59c8111ab469a9c4ed4479b170763" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0d59c8111ab469a9c4ed4479b170763" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 32925 } } }
I20260808 14:33:59.186667 17508 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0d59c8111ab469a9c4ed4479b170763 [sys.catalog]: This master's current role is: LEADER
I20260808 14:33:59.186900 17510 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0d59c8111ab469a9c4ed4479b170763 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a0d59c8111ab469a9c4ed4479b170763" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0d59c8111ab469a9c4ed4479b170763" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 32925 } } }
I20260808 14:33:59.187006 17510 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0d59c8111ab469a9c4ed4479b170763 [sys.catalog]: This master's current role is: LEADER
I20260808 14:33:59.187811 17506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:59.173188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50204 (local address 127.11.131.254:32925)
0808 14:33:59.173663 (+ 475us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:59.173679 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:59.173715 (+ 36us) server_negotiation.cc:407] Connection header received
0808 14:33:59.174441 (+ 726us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:59.174462 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:59.174880 (+ 418us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:59.175239 (+ 359us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:33:59.176100 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:59.177189 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:59.178097 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:59.178838 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:59.179028 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:59.181501 (+ 2473us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:33:59.181507 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:33:59.181527 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:33:59.181566 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:33:59.183604 (+ 2038us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:59.184118 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:59.184124 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:59.184129 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:59.184308 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:59.184727 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:59.184730 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:59.184731 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:59.185249 (+ 518us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:33:59.186023 (+ 774us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:59.186165 (+ 142us) server_negotiation.cc:299] Negotiation successful
0808 14:33:59.186485 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":325,"thread_start_us":161,"threads_started":1}
W20260808 14:33:59.191340 17538 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a0d59c8111ab469a9c4ed4479b170763: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:33:59.191422 17538 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:33:59.191481 17518 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:33:59.192394 17518 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:33:59.198463 17518 catalog_manager.cc:1347] Generated new cluster ID: ab5f6f71227a44968dd03319e0b12be8
I20260808 14:33:59.198547 17518 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:33:59.217273 17518 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:33:59.218318 17518 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:33:59.224591 17518 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a0d59c8111ab469a9c4ed4479b170763: Generated new TSK 0
I20260808 14:33:59.225309 17518 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.131.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab.
Entry for principal kudu/127.11.131.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab.
I20260808 14:33:59.259783 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.193:0
--local_ip_for_outbound_sockets=127.11.131.193
--webserver_interface=127.11.131.193
--webserver_port=0
--tserver_master_addrs=127.11.131.254:32925
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab
--principal=kudu/127.11.131.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:39613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:33:59.396732 17546 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:33:59.397060 17546 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:33:59.397146 17546 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:33:59.401268 17546 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:33:59.401369 17546 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:33:59.401469 17546 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.193
I20260808 14:33:59.407352 17546 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:39613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab
--principal=kudu/127.11.131.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.131.193
--webserver_port=0
--tserver_master_addrs=127.11.131.254:32925
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17546
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.193
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:33:59.408500 17546 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:33:59.409634 17546 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:33:59.419714 17552 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:33:59.419801 17551 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:33:59.419776 17546 server_base.cc:1034] running on GCE node
W20260808 14:33:59.419713 17554 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:33:59.420363 17546 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:33:59.420981 17546 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:33:59.422170 17546 hybrid_clock.cc:648] HybridClock initialized: now 1786199639422135 us; error 44 us; skew 500 ppm
Aug 08 14:33:59 dist-test-slave-twwt krb5kdc[17368](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199639, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:33:59.425148 17546 init.cc:377] Logged in from keytab as kudu/127.11.131.193@KRBTEST.COM (short username kudu)
I20260808 14:33:59.426007 17546 webserver.cc:460] Webserver started at http://127.11.131.193:40687/ using document root <none> and password file <none>
I20260808 14:33:59.426549 17546 fs_manager.cc:359] Metadata directory not provided
I20260808 14:33:59.426661 17546 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:33:59.426882 17546 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:33:59.428903 17546 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/ts-0/data/instance:
uuid: "c2f4614aee854536a7473f4f4707a02b"
format_stamp: "Formatted at 2026-08-08 14:33:59 on dist-test-slave-twwt"
server_key: "1509e20249956c449592e1a342bb83ec"
server_key_iv: "70f52becae70e9926944a19e0b9d7357"
server_key_version: "encryptionkey@0"
I20260808 14:33:59.429428 17546 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/ts-0/wal/instance:
uuid: "c2f4614aee854536a7473f4f4707a02b"
format_stamp: "Formatted at 2026-08-08 14:33:59 on dist-test-slave-twwt"
server_key: "1509e20249956c449592e1a342bb83ec"
server_key_iv: "70f52becae70e9926944a19e0b9d7357"
server_key_version: "encryptionkey@0"
I20260808 14:33:59.433187 17546 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260808 14:33:59.435734 17561 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:59.437000 17546 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 14:33:59.437142 17546 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/ts-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/ts-0/wal
uuid: "c2f4614aee854536a7473f4f4707a02b"
format_stamp: "Formatted at 2026-08-08 14:33:59 on dist-test-slave-twwt"
server_key: "1509e20249956c449592e1a342bb83ec"
server_key_iv: "70f52becae70e9926944a19e0b9d7357"
server_key_version: "encryptionkey@0"
I20260808 14:33:59.437263 17546 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:33:59.459043 17546 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:33:59.462044 17546 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:33:59.462265 17546 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:33:59.462945 17546 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:33:59.463842 17546 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:33:59.463919 17546 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:59.463991 17546 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:33:59.464042 17546 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:59.473204 17546 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.193:37353
I20260808 14:33:59.473239 17725 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.193:37353 every 8 connection(s)
I20260808 14:33:59.474107 17546 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
I20260808 14:33:59.478099 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 17546
I20260808 14:33:59.478237 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/ts-0/wal/instance
I20260808 14:33:59.478577 11791 external_mini_cluster.cc:1428] Setting key 3f23c82863bf466ebfb8cb896891a9c6
Aug 08 14:33:59 dist-test-slave-twwt krb5kdc[17368](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199639, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.193@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.131.194@KRBTEST.COM; defaulting to no policy
I20260808 14:33:59.490516 17506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:59.476066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:36827 (local address 127.11.131.254:32925)
0808 14:33:59.476218 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:59.476223 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:59.477135 (+ 912us) server_negotiation.cc:407] Connection header received
0808 14:33:59.479021 (+ 1886us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:59.479025 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:59.479086 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:59.479184 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:33:59.480660 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:59.481185 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:59.483016 (+ 1831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:59.483367 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:59.483487 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:59.486478 (+ 2991us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:33:59.486482 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:33:59.486485 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:33:59.486518 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:33:59.488205 (+ 1687us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:59.488840 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:59.488843 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:59.488844 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:59.488928 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:59.489366 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:59.489368 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:59.489369 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:59.489569 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:33:59.489654 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:59.490281 (+ 627us) server_negotiation.cc:299] Negotiation successful
0808 14:33:59.490389 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 14:33:59.491369 17729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:59.476516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:32925 (local address 127.11.131.193:36827)
0808 14:33:59.476981 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:59.477024 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:59.478751 (+ 1727us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:59.479390 (+ 639us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:59.479399 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:59.479786 (+ 387us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:33:59.480499 (+ 713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:59.480522 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:59.481320 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:59.481324 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:59.482846 (+ 1522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:59.482859 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:59.483530 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:59.483534 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:59.483716 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:59.484345 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:33:59.484361 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:33:59.486245 (+ 1884us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:33:59.488325 (+ 2080us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:59.488332 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:59.488349 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:59.488713 (+ 364us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:59.489038 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:59.489044 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:59.489048 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:59.489251 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:59.489687 (+ 436us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:33:59.489696 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:33:59.490037 (+ 341us) client_negotiation.cc:769] Sending connection context
0808 14:33:59.490221 (+ 184us) client_negotiation.cc:240] Negotiation successful
0808 14:33:59.490483 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":103,"threads_started":1}
I20260808 14:33:59.492781 17727 heartbeater.cc:347] Connected to a master server at 127.11.131.254:32925
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.194@KRBTEST.COM" created.
I20260808 14:33:59.493069 17727 heartbeater.cc:464] Registering TS with master...
I20260808 14:33:59.493706 17727 heartbeater.cc:511] Master 127.11.131.254:32925 requested a full tablet report, sending...
I20260808 14:33:59.495611 17441 ts_manager.cc:194] Registered new tserver with Master: c2f4614aee854536a7473f4f4707a02b (127.11.131.193:37353)
I20260808 14:33:59.497036 17441 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.193@KRBTEST.COM'} at 127.11.131.193:36827
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab.
Entry for principal kudu/127.11.131.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab.
I20260808 14:33:59.511332 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.194:0
--local_ip_for_outbound_sockets=127.11.131.194
--webserver_interface=127.11.131.194
--webserver_port=0
--tserver_master_addrs=127.11.131.254:32925
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab
--principal=kudu/127.11.131.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:39613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:33:59.626554 17732 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:33:59.626827 17732 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:33:59.626912 17732 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:33:59.630980 17732 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:33:59.631037 17732 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:33:59.631134 17732 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.194
I20260808 14:33:59.636528 17732 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:39613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab
--principal=kudu/127.11.131.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.131.194
--webserver_port=0
--tserver_master_addrs=127.11.131.254:32925
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17732
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.194
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:33:59.637606 17732 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:33:59.638742 17732 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:33:59.648639 17738 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:33:59.648674 17743 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:33:59.648744 17732 server_base.cc:1034] running on GCE node
W20260808 14:33:59.648685 17739 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:33:59.649259 17732 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:33:59.649927 17732 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:33:59.651117 17732 hybrid_clock.cc:648] HybridClock initialized: now 1786199639651097 us; error 25 us; skew 500 ppm
Aug 08 14:33:59 dist-test-slave-twwt krb5kdc[17368](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199639, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:33:59.654008 17732 init.cc:377] Logged in from keytab as kudu/127.11.131.194@KRBTEST.COM (short username kudu)
I20260808 14:33:59.654978 17732 webserver.cc:460] Webserver started at http://127.11.131.194:38243/ using document root <none> and password file <none>
I20260808 14:33:59.655560 17732 fs_manager.cc:359] Metadata directory not provided
I20260808 14:33:59.655654 17732 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:33:59.655912 17732 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:33:59.658159 17732 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/ts-1/data/instance:
uuid: "b60c1fac92c74f478cf15909cbbde8e2"
format_stamp: "Formatted at 2026-08-08 14:33:59 on dist-test-slave-twwt"
server_key: "86bac31db6e81a3df07245213c004849"
server_key_iv: "076b8c11bd0c1ff70c92c8d19610afdb"
server_key_version: "encryptionkey@0"
I20260808 14:33:59.658756 17732 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/ts-1/wal/instance:
uuid: "b60c1fac92c74f478cf15909cbbde8e2"
format_stamp: "Formatted at 2026-08-08 14:33:59 on dist-test-slave-twwt"
server_key: "86bac31db6e81a3df07245213c004849"
server_key_iv: "076b8c11bd0c1ff70c92c8d19610afdb"
server_key_version: "encryptionkey@0"
I20260808 14:33:59.662461 17732 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:33:59.664888 17755 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:59.666131 17732 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 14:33:59.666226 17732 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/ts-1/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/ts-1/wal
uuid: "b60c1fac92c74f478cf15909cbbde8e2"
format_stamp: "Formatted at 2026-08-08 14:33:59 on dist-test-slave-twwt"
server_key: "86bac31db6e81a3df07245213c004849"
server_key_iv: "076b8c11bd0c1ff70c92c8d19610afdb"
server_key_version: "encryptionkey@0"
I20260808 14:33:59.666311 17732 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:33:59.679956 17732 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:33:59.683367 17732 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:33:59.683526 17732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:33:59.684087 17732 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:33:59.684895 17732 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:33:59.684944 17732 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:59.684985 17732 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:33:59.685001 17732 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:59.694837 17732 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.194:34399
I20260808 14:33:59.694907 17932 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.194:34399 every 8 connection(s)
I20260808 14:33:59.695773 17732 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
I20260808 14:33:59.698428 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 17732
I20260808 14:33:59.698577 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/ts-1/wal/instance
I20260808 14:33:59.699011 11791 external_mini_cluster.cc:1428] Setting key ac90e9379cc23017da586f0b162a6263
Aug 08 14:33:59 dist-test-slave-twwt krb5kdc[17368](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199639, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.194@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.131.195@KRBTEST.COM; defaulting to no policy
I20260808 14:33:59.711216 17506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:59.697742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:55355 (local address 127.11.131.254:32925)
0808 14:33:59.697887 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:59.697891 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:59.698942 (+ 1051us) server_negotiation.cc:407] Connection header received
0808 14:33:59.700762 (+ 1820us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:59.700765 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:59.700812 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:59.700888 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:33:59.702599 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:59.703172 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:59.704395 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:59.704616 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:59.704732 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:59.707488 (+ 2756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:33:59.707491 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:33:59.707493 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:33:59.707518 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:33:59.708973 (+ 1455us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:59.709531 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:59.709539 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:59.709541 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:59.709619 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:59.709986 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:59.709990 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:59.709991 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:59.710180 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:33:59.710291 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:59.710919 (+ 628us) server_negotiation.cc:299] Negotiation successful
0808 14:33:59.711046 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 14:33:59.712160 17939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:59.698157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:32925 (local address 127.11.131.194:55355)
0808 14:33:59.698744 (+ 587us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:59.698808 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:59.700504 (+ 1696us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:59.701112 (+ 608us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:59.701122 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:59.701695 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:33:59.702437 (+ 742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:59.702460 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:59.703309 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:59.703314 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:59.704215 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:59.704225 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:59.704778 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:59.704782 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:59.704975 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:59.705659 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:33:59.705676 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:33:59.707304 (+ 1628us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:33:59.709103 (+ 1799us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:59.709110 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:59.709127 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:59.709415 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:59.709717 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:59.709720 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:59.709722 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:59.709878 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:59.710291 (+ 413us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:33:59.710299 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:33:59.710601 (+ 302us) client_negotiation.cc:769] Sending connection context
0808 14:33:59.710874 (+ 273us) client_negotiation.cc:240] Negotiation successful
0808 14:33:59.711217 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":304,"thread_start_us":111,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.195@KRBTEST.COM" created.
I20260808 14:33:59.713590 17933 heartbeater.cc:347] Connected to a master server at 127.11.131.254:32925
I20260808 14:33:59.713860 17933 heartbeater.cc:464] Registering TS with master...
I20260808 14:33:59.714545 17933 heartbeater.cc:511] Master 127.11.131.254:32925 requested a full tablet report, sending...
I20260808 14:33:59.715920 17441 ts_manager.cc:194] Registered new tserver with Master: b60c1fac92c74f478cf15909cbbde8e2 (127.11.131.194:34399)
I20260808 14:33:59.716549 17441 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.194@KRBTEST.COM'} at 127.11.131.194:55355
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab.
Entry for principal kudu/127.11.131.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab.
I20260808 14:33:59.734794 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.195:0
--local_ip_for_outbound_sockets=127.11.131.195
--webserver_interface=127.11.131.195
--webserver_port=0
--tserver_master_addrs=127.11.131.254:32925
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab
--principal=kudu/127.11.131.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:39613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:33:59.855798 17944 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:33:59.856058 17944 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:33:59.856135 17944 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:33:59.860200 17944 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:33:59.860260 17944 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:33:59.860351 17944 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.195
I20260808 14:33:59.866285 17944 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:39613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab
--principal=kudu/127.11.131.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.131.195
--webserver_port=0
--tserver_master_addrs=127.11.131.254:32925
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17944
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.195
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:33:59.867841 17944 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:33:59.868930 17944 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:33:59.878961 17953 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:33:59.879093 17944 server_base.cc:1034] running on GCE node
W20260808 14:33:59.878978 17952 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:33:59.878961 17956 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:33:59.879640 17944 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:33:59.880268 17944 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:33:59.881454 17944 hybrid_clock.cc:648] HybridClock initialized: now 1786199639881426 us; error 42 us; skew 500 ppm
Aug 08 14:33:59 dist-test-slave-twwt krb5kdc[17368](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199639, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:33:59.884301 17944 init.cc:377] Logged in from keytab as kudu/127.11.131.195@KRBTEST.COM (short username kudu)
I20260808 14:33:59.885152 17944 webserver.cc:460] Webserver started at http://127.11.131.195:38929/ using document root <none> and password file <none>
I20260808 14:33:59.885732 17944 fs_manager.cc:359] Metadata directory not provided
I20260808 14:33:59.885797 17944 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:33:59.885967 17944 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:33:59.888207 17944 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/ts-2/data/instance:
uuid: "170ce379b5554f4db3eae7a03dd45854"
format_stamp: "Formatted at 2026-08-08 14:33:59 on dist-test-slave-twwt"
server_key: "97c32b7bd652524c71cece0ad056dc3f"
server_key_iv: "33a916b9c83fcc742edd967ad6bfc056"
server_key_version: "encryptionkey@0"
I20260808 14:33:59.888742 17944 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/ts-2/wal/instance:
uuid: "170ce379b5554f4db3eae7a03dd45854"
format_stamp: "Formatted at 2026-08-08 14:33:59 on dist-test-slave-twwt"
server_key: "97c32b7bd652524c71cece0ad056dc3f"
server_key_iv: "33a916b9c83fcc742edd967ad6bfc056"
server_key_version: "encryptionkey@0"
I20260808 14:33:59.892452 17944 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 14:33:59.894896 17967 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:59.896097 17944 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 14:33:59.896220 17944 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/ts-2/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/ts-2/wal
uuid: "170ce379b5554f4db3eae7a03dd45854"
format_stamp: "Formatted at 2026-08-08 14:33:59 on dist-test-slave-twwt"
server_key: "97c32b7bd652524c71cece0ad056dc3f"
server_key_iv: "33a916b9c83fcc742edd967ad6bfc056"
server_key_version: "encryptionkey@0"
I20260808 14:33:59.896328 17944 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:33:59.911887 17944 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:33:59.914995 17944 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:33:59.915205 17944 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:33:59.915855 17944 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:33:59.916742 17944 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:33:59.916791 17944 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:59.916862 17944 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:33:59.916903 17944 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:33:59.926374 17944 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.195:44213
I20260808 14:33:59.926401 18131 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.195:44213 every 8 connection(s)
I20260808 14:33:59.927376 17944 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
I20260808 14:33:59.932706 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 17944
I20260808 14:33:59.932858 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786199615258783-11791-0/minicluster-data/ts-2/wal/instance
I20260808 14:33:59.933153 11791 external_mini_cluster.cc:1428] Setting key bde90151fc7878665be4e420fa7cf615
Aug 08 14:33:59 dist-test-slave-twwt krb5kdc[17368](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199639, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.195@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:33:59.941743 17506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:59.929328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:51403 (local address 127.11.131.254:32925)
0808 14:33:59.929481 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:59.929485 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:59.930304 (+ 819us) server_negotiation.cc:407] Connection header received
0808 14:33:59.931851 (+ 1547us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:59.931854 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:59.931915 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:59.932015 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:33:59.933326 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:59.934046 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:59.935629 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:59.935864 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:59.935955 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:59.938327 (+ 2372us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:33:59.938330 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:33:59.938332 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:33:59.938356 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:33:59.939873 (+ 1517us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:59.940342 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:59.940344 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:59.940345 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:59.940429 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:59.940725 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:59.940727 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:59.940728 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:59.940962 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:33:59.941056 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:59.941529 (+ 473us) server_negotiation.cc:299] Negotiation successful
0808 14:33:59.941623 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 14:33:59.942698 18135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:59.929711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:32925 (local address 127.11.131.195:51403)
0808 14:33:59.930155 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0808 14:33:59.930198 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 14:33:59.931613 (+ 1415us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:33:59.932198 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:33:59.932205 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:33:59.932563 (+ 358us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:33:59.933166 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:59.933181 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:59.934182 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:59.934186 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:59.935483 (+ 1297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:33:59.935494 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:33:59.936008 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:33:59.936011 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:33:59.936153 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:59.936710 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:33:59.936726 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:33:59.938174 (+ 1448us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:33:59.939990 (+ 1816us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:59.939995 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:59.940006 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:59.940254 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:59.940510 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:33:59.940512 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:33:59.940513 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:33:59.940646 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:33:59.941078 (+ 432us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:33:59.941083 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:33:59.941320 (+ 237us) client_negotiation.cc:769] Sending connection context
0808 14:33:59.941480 (+ 160us) client_negotiation.cc:240] Negotiation successful
0808 14:33:59.941724 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":111,"threads_started":1}
I20260808 14:33:59.943874 18132 heartbeater.cc:347] Connected to a master server at 127.11.131.254:32925
I20260808 14:33:59.944116 18132 heartbeater.cc:464] Registering TS with master...
I20260808 14:33:59.944614 18132 heartbeater.cc:511] Master 127.11.131.254:32925 requested a full tablet report, sending...
I20260808 14:33:59.945708 17441 ts_manager.cc:194] Registered new tserver with Master: 170ce379b5554f4db3eae7a03dd45854 (127.11.131.195:44213)
I20260808 14:33:59.946352 17441 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.195@KRBTEST.COM'} at 127.11.131.195:51403
I20260808 14:33:59.947093 11791 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 14:33:59 dist-test-slave-twwt krb5kdc[17368](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199639, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 14:33:59 dist-test-slave-twwt krb5kdc[17368](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199639, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.131.193@KRBTEST.COM
I20260808 14:33:59.976840 18141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:59.967289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52714 (local address 127.11.131.193:37353)
0808 14:33:59.967569 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:59.967588 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:59.967624 (+ 36us) server_negotiation.cc:407] Connection header received
0808 14:33:59.967679 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:59.967685 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:59.967896 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:59.968022 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:33:59.968693 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:59.969557 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:59.970368 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:59.970821 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:59.970970 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:59.973379 (+ 2409us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:33:59.973388 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:33:59.973405 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:33:59.973430 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:33:59.975085 (+ 1655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:59.975528 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:59.975533 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:59.975534 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:59.975614 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:59.975867 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:59.975869 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:59.975870 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:59.976112 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:33:59.976275 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:59.976463 (+ 188us) server_negotiation.cc:299] Negotiation successful
0808 14:33:59.976634 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":96,"threads_started":1}
Aug 08 14:33:59 dist-test-slave-twwt krb5kdc[17368](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199639, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:33:59.988319 17506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:33:59.979759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50212 (local address 127.11.131.254:32925)
0808 14:33:59.979901 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0808 14:33:59.979906 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:33:59.980034 (+ 128us) server_negotiation.cc:407] Connection header received
0808 14:33:59.980115 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:33:59.980117 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:33:59.980158 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:33:59.980227 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:33:59.980789 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:59.981299 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:59.982067 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:33:59.982274 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:33:59.982364 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:33:59.984631 (+ 2267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:33:59.984634 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:33:59.984636 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:33:59.984661 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:33:59.986215 (+ 1554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:59.986801 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:59.986804 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:59.986806 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:59.986940 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:33:59.987299 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:33:59.987302 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:33:59.987303 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:33:59.987541 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:33:59.987655 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 14:33:59.987993 (+ 338us) server_negotiation.cc:299] Negotiation successful
0808 14:33:59.988111 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
W20260808 14:33:59.988741 17441 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50212
I20260808 14:33:59.989392 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 17546
I20260808 14:34:00.006759 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 17732
I20260808 14:34:00.024549 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 17944
I20260808 14:34:00.040848 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 17391
2026-08-08T14:34:00Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2455 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:34:00 dist-test-slave-twwt krb5kdc[18149](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:34:00 dist-test-slave-twwt krb5kdc[18149](info): set up 2 sockets
Aug 08 14:34:00 dist-test-slave-twwt krb5kdc[18149](info): commencing operation
krb5kdc: starting...
W20260808 14:34:01.296314 11791 mini_kdc.cc:121] Time spent starting KDC: real 1.227s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Aug 08 14:34:01 dist-test-slave-twwt krb5kdc[18149](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199641, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:34:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:34:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.131.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
I20260808 14:34:01.429662 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:41289
--webserver_interface=127.11.131.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:33253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:41289
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:34:01.551606 18165 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:34:01.551883 18165 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:34:01.551927 18165 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:34:01.556044 18165 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:34:01.556111 18165 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:34:01.556130 18165 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:34:01.556147 18165 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:34:01.556164 18165 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:34:01.561633 18165 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:33253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:41289
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:41289
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.131.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18165
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:34:01.562857 18165 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:34:01.564018 18165 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:34:01.573109 18177 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:01.573190 18173 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:01.573191 18179 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:01.573320 18165 server_base.cc:1034] running on GCE node
I20260808 14:34:01.574064 18165 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:34:01.575309 18165 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:34:01.576532 18165 hybrid_clock.cc:648] HybridClock initialized: now 1786199641576510 us; error 32 us; skew 500 ppm
Aug 08 14:34:01 dist-test-slave-twwt krb5kdc[18149](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199641, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:34:01.579600 18165 init.cc:377] Logged in from keytab as kudu/127.11.131.254@KRBTEST.COM (short username kudu)
I20260808 14:34:01.580489 18165 fs_manager.cc:359] Metadata directory not provided
I20260808 14:34:01.580559 18165 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:34:01.580806 18165 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:34:01.583277 18165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/master-0/data/instance:
uuid: "945688fa9a8a4ea2a27567cb55c107b1"
format_stamp: "Formatted at 2026-08-08 14:34:01 on dist-test-slave-twwt"
server_key: "5f77fffb7be594674f53f91bc4ff7cb3"
server_key_iv: "adb00e9bfb60fe71cc153e9304e82988"
server_key_version: "encryptionkey@0"
I20260808 14:34:01.583930 18165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/master-0/wal/instance:
uuid: "945688fa9a8a4ea2a27567cb55c107b1"
format_stamp: "Formatted at 2026-08-08 14:34:01 on dist-test-slave-twwt"
server_key: "5f77fffb7be594674f53f91bc4ff7cb3"
server_key_iv: "adb00e9bfb60fe71cc153e9304e82988"
server_key_version: "encryptionkey@0"
I20260808 14:34:01.588021 18165 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 14:34:01.590772 18187 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:01.592124 18165 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:34:01.592303 18165 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "945688fa9a8a4ea2a27567cb55c107b1"
format_stamp: "Formatted at 2026-08-08 14:34:01 on dist-test-slave-twwt"
server_key: "5f77fffb7be594674f53f91bc4ff7cb3"
server_key_iv: "adb00e9bfb60fe71cc153e9304e82988"
server_key_version: "encryptionkey@0"
I20260808 14:34:01.592427 18165 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:34:01.609521 18165 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:34:01.612795 18165 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:34:01.613049 18165 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:34:01.620496 18165 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.254:41289
I20260808 14:34:01.620781 18270 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.254:41289 every 8 connection(s)
I20260808 14:34:01.621238 18165 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:34:01.624138 18272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:34:01.627791 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 18165
I20260808 14:34:01.627969 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/master-0/wal/instance
I20260808 14:34:01.628239 11791 external_mini_cluster.cc:1428] Setting key 755dd5d151cfbe4d6579d331eed55699
I20260808 14:34:01.630393 18272 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 945688fa9a8a4ea2a27567cb55c107b1: Bootstrap starting.
I20260808 14:34:01.633227 18272 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 945688fa9a8a4ea2a27567cb55c107b1: Neither blocks nor log segments found. Creating new log.
I20260808 14:34:01.634128 18272 log.cc:824] T 00000000000000000000000000000000 P 945688fa9a8a4ea2a27567cb55c107b1: Log is configured to *not* fsync() on all Append() calls
I20260808 14:34:01.636502 18272 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 945688fa9a8a4ea2a27567cb55c107b1: No bootstrap required, opened a new log
Aug 08 14:34:01 dist-test-slave-twwt krb5kdc[18149](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199641, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:34:01.640888 18272 raft_consensus.cc:348] T 00000000000000000000000000000000 P 945688fa9a8a4ea2a27567cb55c107b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "945688fa9a8a4ea2a27567cb55c107b1" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 41289 } }
I20260808 14:34:01.641215 18272 raft_consensus.cc:374] T 00000000000000000000000000000000 P 945688fa9a8a4ea2a27567cb55c107b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:34:01.641314 18272 raft_consensus.cc:729] T 00000000000000000000000000000000 P 945688fa9a8a4ea2a27567cb55c107b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 945688fa9a8a4ea2a27567cb55c107b1, State: Initialized, Role: FOLLOWER
I20260808 14:34:01.641860 18272 consensus_queue.cc:260] T 00000000000000000000000000000000 P 945688fa9a8a4ea2a27567cb55c107b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "945688fa9a8a4ea2a27567cb55c107b1" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 41289 } }
I20260808 14:34:01.642000 18272 raft_consensus.cc:388] T 00000000000000000000000000000000 P 945688fa9a8a4ea2a27567cb55c107b1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:34:01.642088 18272 raft_consensus.cc:482] T 00000000000000000000000000000000 P 945688fa9a8a4ea2a27567cb55c107b1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:34:01.642187 18272 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 945688fa9a8a4ea2a27567cb55c107b1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:34:01.643436 18272 raft_consensus.cc:504] T 00000000000000000000000000000000 P 945688fa9a8a4ea2a27567cb55c107b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "945688fa9a8a4ea2a27567cb55c107b1" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 41289 } }
I20260808 14:34:01.643793 18272 leader_election.cc:302] T 00000000000000000000000000000000 P 945688fa9a8a4ea2a27567cb55c107b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 945688fa9a8a4ea2a27567cb55c107b1; no voters:
I20260808 14:34:01.643972 18276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:01.629716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53678 (local address 127.11.131.254:41289)
0808 14:34:01.630147 (+ 431us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:01.630173 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:01.630217 (+ 44us) server_negotiation.cc:407] Connection header received
0808 14:34:01.631070 (+ 853us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:01.631095 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:01.631531 (+ 436us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:01.631923 (+ 392us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:01.632666 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:01.634205 (+ 1539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:01.635336 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:01.636006 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:01.636172 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:01.638920 (+ 2748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:01.638926 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:01.638940 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:01.638967 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:01.640704 (+ 1737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:01.641237 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:01.641245 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:01.641255 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:01.641487 (+ 232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:01.641788 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:01.641791 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:01.641792 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:01.642356 (+ 564us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:01.642514 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:01.642857 (+ 343us) server_negotiation.cc:299] Negotiation successful
0808 14:34:01.643095 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":280,"thread_start_us":120,"threads_started":1}
I20260808 14:34:01.644150 18272 leader_election.cc:288] T 00000000000000000000000000000000 P 945688fa9a8a4ea2a27567cb55c107b1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:34:01.644312 18279 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 945688fa9a8a4ea2a27567cb55c107b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:34:01.644501 18279 raft_consensus.cc:686] T 00000000000000000000000000000000 P 945688fa9a8a4ea2a27567cb55c107b1 [term 1 LEADER]: Becoming Leader. State: Replica: 945688fa9a8a4ea2a27567cb55c107b1, State: Running, Role: LEADER
I20260808 14:34:01.644783 18279 consensus_queue.cc:237] T 00000000000000000000000000000000 P 945688fa9a8a4ea2a27567cb55c107b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "945688fa9a8a4ea2a27567cb55c107b1" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 41289 } }
I20260808 14:34:01.645478 18272 sys_catalog.cc:564] T 00000000000000000000000000000000 P 945688fa9a8a4ea2a27567cb55c107b1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:34:01.645999 18279 sys_catalog.cc:455] T 00000000000000000000000000000000 P 945688fa9a8a4ea2a27567cb55c107b1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 945688fa9a8a4ea2a27567cb55c107b1. Latest consensus state: current_term: 1 leader_uuid: "945688fa9a8a4ea2a27567cb55c107b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "945688fa9a8a4ea2a27567cb55c107b1" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 41289 } } }
I20260808 14:34:01.646113 18279 sys_catalog.cc:458] T 00000000000000000000000000000000 P 945688fa9a8a4ea2a27567cb55c107b1 [sys.catalog]: This master's current role is: LEADER
I20260808 14:34:01.646531 18284 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:34:01.646552 18280 sys_catalog.cc:455] T 00000000000000000000000000000000 P 945688fa9a8a4ea2a27567cb55c107b1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "945688fa9a8a4ea2a27567cb55c107b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "945688fa9a8a4ea2a27567cb55c107b1" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 41289 } } }
I20260808 14:34:01.646790 18280 sys_catalog.cc:458] T 00000000000000000000000000000000 P 945688fa9a8a4ea2a27567cb55c107b1 [sys.catalog]: This master's current role is: LEADER
I20260808 14:34:01.649937 18284 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:34:01.656494 18284 catalog_manager.cc:1347] Generated new cluster ID: 68959bd10fda44ce8ec9fc15abbb10e5
I20260808 14:34:01.656605 18284 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:34:01.663873 18284 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:34:01.665040 18284 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:34:01.677049 18284 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 945688fa9a8a4ea2a27567cb55c107b1: Generated new TSK 0
I20260808 14:34:01.678119 18284 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.131.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab.
Entry for principal kudu/127.11.131.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab.
I20260808 14:34:01.721335 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.193:0
--local_ip_for_outbound_sockets=127.11.131.193
--webserver_interface=127.11.131.193
--webserver_port=0
--tserver_master_addrs=127.11.131.254:41289
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab
--principal=kudu/127.11.131.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:33253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:34:01.844790 18308 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:34:01.845201 18308 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:34:01.845284 18308 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:34:01.849880 18308 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:34:01.849973 18308 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:34:01.850090 18308 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.193
I20260808 14:34:01.855755 18308 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:33253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab
--principal=kudu/127.11.131.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.131.193
--webserver_port=0
--tserver_master_addrs=127.11.131.254:41289
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18308
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.193
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:34:01.856946 18308 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:34:01.858100 18308 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:34:01.868335 18320 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:01.868335 18317 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:01.868906 18318 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:01.869628 18308 server_base.cc:1034] running on GCE node
I20260808 14:34:01.870148 18308 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:34:01.870949 18308 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:34:01.872148 18308 hybrid_clock.cc:648] HybridClock initialized: now 1786199641872120 us; error 48 us; skew 500 ppm
Aug 08 14:34:01 dist-test-slave-twwt krb5kdc[18149](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199641, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:34:01.879988 18308 init.cc:377] Logged in from keytab as kudu/127.11.131.193@KRBTEST.COM (short username kudu)
I20260808 14:34:01.880939 18308 fs_manager.cc:359] Metadata directory not provided
I20260808 14:34:01.881047 18308 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:34:01.881294 18308 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:34:01.884250 18308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/ts-0/data/instance:
uuid: "e9e7cbfa3b2d4964a9b8f3af55ec1e00"
format_stamp: "Formatted at 2026-08-08 14:34:01 on dist-test-slave-twwt"
server_key: "02d3dd2843fd3a5b925073710985c3fc"
server_key_iv: "1d4cd0d63fef6d0addaa831a76f02614"
server_key_version: "encryptionkey@0"
I20260808 14:34:01.885125 18308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/ts-0/wal/instance:
uuid: "e9e7cbfa3b2d4964a9b8f3af55ec1e00"
format_stamp: "Formatted at 2026-08-08 14:34:01 on dist-test-slave-twwt"
server_key: "02d3dd2843fd3a5b925073710985c3fc"
server_key_iv: "1d4cd0d63fef6d0addaa831a76f02614"
server_key_version: "encryptionkey@0"
I20260808 14:34:01.891399 18308 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260808 14:34:01.895467 18326 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:01.897650 18308 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.006s sys 0.000s
I20260808 14:34:01.897907 18308 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/ts-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/ts-0/wal
uuid: "e9e7cbfa3b2d4964a9b8f3af55ec1e00"
format_stamp: "Formatted at 2026-08-08 14:34:01 on dist-test-slave-twwt"
server_key: "02d3dd2843fd3a5b925073710985c3fc"
server_key_iv: "1d4cd0d63fef6d0addaa831a76f02614"
server_key_version: "encryptionkey@0"
I20260808 14:34:01.898178 18308 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:34:01.923684 18308 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:34:01.927507 18308 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:34:01.927726 18308 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:34:01.928400 18308 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:34:01.929339 18308 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:34:01.929435 18308 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:01.929504 18308 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:34:01.929538 18308 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:01.941608 18308 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.193:40999
I20260808 14:34:01.941612 18497 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.193:40999 every 8 connection(s)
I20260808 14:34:01.942519 18308 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
I20260808 14:34:01.949975 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 18308
I20260808 14:34:01.950139 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/ts-0/wal/instance
I20260808 14:34:01.950508 11791 external_mini_cluster.cc:1428] Setting key 28f9f70269d71071b87a595b23afe9d6
Aug 08 14:34:01 dist-test-slave-twwt krb5kdc[18149](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199641, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.193@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:34:01.960698 18276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:01.946309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:60103 (local address 127.11.131.254:41289)
0808 14:34:01.946470 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:01.946475 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:01.946493 (+ 18us) server_negotiation.cc:407] Connection header received
0808 14:34:01.948373 (+ 1880us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:01.948376 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:01.948425 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:01.948536 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:01.949954 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:01.950967 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:01.952878 (+ 1911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:01.953317 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:01.953410 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:01.956761 (+ 3351us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:01.956765 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:01.956768 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:01.956795 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:01.958333 (+ 1538us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:01.959063 (+ 730us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:01.959066 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:01.959067 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:01.959150 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:01.959526 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:01.959530 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:01.959531 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:01.959728 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:01.959849 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:01.960391 (+ 542us) server_negotiation.cc:299] Negotiation successful
0808 14:34:01.960529 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 14:34:01.961671 18502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:01.945141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:41289 (local address 127.11.131.193:60103)
0808 14:34:01.945833 (+ 692us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:01.945910 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:01.947950 (+ 2040us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:01.948751 (+ 801us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:01.948758 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:01.949141 (+ 383us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:01.949745 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:01.949770 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:01.951122 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:01.951129 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:01.952680 (+ 1551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:01.952712 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:01.953657 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:01.953664 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:01.953941 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:01.954717 (+ 776us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:01.954743 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:01.956582 (+ 1839us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:01.958463 (+ 1881us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:01.958470 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:01.958488 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:01.958917 (+ 429us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:01.959248 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:01.959252 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:01.959254 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:01.959415 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:01.959850 (+ 435us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:01.959858 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:01.960136 (+ 278us) client_negotiation.cc:769] Sending connection context
0808 14:34:01.960341 (+ 205us) client_negotiation.cc:240] Negotiation successful
0808 14:34:01.960701 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":145,"threads_started":1}
I20260808 14:34:01.963109 18498 heartbeater.cc:347] Connected to a master server at 127.11.131.254:41289
I20260808 14:34:01.963390 18498 heartbeater.cc:464] Registering TS with master...
I20260808 14:34:01.963898 18498 heartbeater.cc:511] Master 127.11.131.254:41289 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.11.131.194@KRBTEST.COM; defaulting to no policy
I20260808 14:34:01.965494 18217 ts_manager.cc:194] Registered new tserver with Master: e9e7cbfa3b2d4964a9b8f3af55ec1e00 (127.11.131.193:40999)
I20260808 14:34:01.967356 18217 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.193@KRBTEST.COM'} at 127.11.131.193:60103
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab.
Entry for principal kudu/127.11.131.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab.
I20260808 14:34:01.991655 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.194:0
--local_ip_for_outbound_sockets=127.11.131.194
--webserver_interface=127.11.131.194
--webserver_port=0
--tserver_master_addrs=127.11.131.254:41289
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab
--principal=kudu/127.11.131.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:33253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:34:02.115440 18508 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:34:02.115742 18508 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:34:02.115790 18508 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:34:02.119957 18508 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:34:02.120029 18508 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:34:02.120127 18508 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.194
I20260808 14:34:02.125560 18508 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:33253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab
--principal=kudu/127.11.131.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.131.194
--webserver_port=0
--tserver_master_addrs=127.11.131.254:41289
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18508
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.194
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:34:02.126761 18508 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:34:02.127866 18508 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:34:02.137782 18520 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:02.137807 18516 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:02.137801 18518 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:02.138155 18508 server_base.cc:1034] running on GCE node
I20260808 14:34:02.138564 18508 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:34:02.139305 18508 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:34:02.140506 18508 hybrid_clock.cc:648] HybridClock initialized: now 1786199642140492 us; error 35 us; skew 500 ppm
Aug 08 14:34:02 dist-test-slave-twwt krb5kdc[18149](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199642, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:34:02.143406 18508 init.cc:377] Logged in from keytab as kudu/127.11.131.194@KRBTEST.COM (short username kudu)
I20260808 14:34:02.144158 18508 fs_manager.cc:359] Metadata directory not provided
I20260808 14:34:02.144256 18508 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:34:02.144505 18508 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:34:02.146843 18508 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/ts-1/data/instance:
uuid: "64477cf11fa54e8faeadb07b00437fbe"
format_stamp: "Formatted at 2026-08-08 14:34:02 on dist-test-slave-twwt"
server_key: "53f33e8d45ecf2463c2ef034614bbebc"
server_key_iv: "995836ecb239ad08e29ca36941bcd49a"
server_key_version: "encryptionkey@0"
I20260808 14:34:02.147493 18508 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/ts-1/wal/instance:
uuid: "64477cf11fa54e8faeadb07b00437fbe"
format_stamp: "Formatted at 2026-08-08 14:34:02 on dist-test-slave-twwt"
server_key: "53f33e8d45ecf2463c2ef034614bbebc"
server_key_iv: "995836ecb239ad08e29ca36941bcd49a"
server_key_version: "encryptionkey@0"
I20260808 14:34:02.151393 18508 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 14:34:02.153908 18529 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:02.155306 18508 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:34:02.155457 18508 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/ts-1/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/ts-1/wal
uuid: "64477cf11fa54e8faeadb07b00437fbe"
format_stamp: "Formatted at 2026-08-08 14:34:02 on dist-test-slave-twwt"
server_key: "53f33e8d45ecf2463c2ef034614bbebc"
server_key_iv: "995836ecb239ad08e29ca36941bcd49a"
server_key_version: "encryptionkey@0"
I20260808 14:34:02.155581 18508 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:34:02.174034 18508 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:34:02.177165 18508 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:34:02.177377 18508 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:34:02.178005 18508 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:34:02.178969 18508 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:34:02.179061 18508 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:02.179157 18508 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:34:02.179209 18508 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:02.189213 18508 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.194:38377
I20260808 14:34:02.189229 18697 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.194:38377 every 8 connection(s)
I20260808 14:34:02.189877 18508 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
Aug 08 14:34:02 dist-test-slave-twwt krb5kdc[18149](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199642, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.194@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:34:02.200065 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 18508
I20260808 14:34:02.200206 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/ts-1/wal/instance
I20260808 14:34:02.200560 11791 external_mini_cluster.cc:1428] Setting key 79d914a76fc6d86c1604da1e4b619496
I20260808 14:34:02.205317 18276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:02.191816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:35885 (local address 127.11.131.254:41289)
0808 14:34:02.191987 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:02.191991 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:02.193278 (+ 1287us) server_negotiation.cc:407] Connection header received
0808 14:34:02.194245 (+ 967us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:02.194249 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:02.194312 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:02.194421 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:02.195743 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:02.196292 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:02.197496 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:02.197727 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:02.197838 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:02.200541 (+ 2703us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:02.200546 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:02.200548 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:02.200582 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:02.202369 (+ 1787us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:02.203172 (+ 803us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:02.203175 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:02.203176 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:02.203268 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:02.203745 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:02.203747 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:02.203748 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:02.204019 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:02.204115 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:02.204918 (+ 803us) server_negotiation.cc:299] Negotiation successful
0808 14:34:02.205091 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 14:34:02.206243 18704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:02.192232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:41289 (local address 127.11.131.194:35885)
0808 14:34:02.193117 (+ 885us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:02.193162 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:02.194017 (+ 855us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:02.194668 (+ 651us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:02.194677 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:02.195077 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:02.195591 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:02.195605 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:02.196439 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:02.196443 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:02.197344 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:02.197355 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:02.197904 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:02.197908 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:02.198084 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:02.198733 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:02.198750 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:02.200359 (+ 1609us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:02.202523 (+ 2164us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:02.202532 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:02.202551 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:02.203003 (+ 452us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:02.203399 (+ 396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:02.203405 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:02.203410 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:02.203629 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:02.204149 (+ 520us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:02.204160 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:02.204564 (+ 404us) client_negotiation.cc:769] Sending connection context
0808 14:34:02.204787 (+ 223us) client_negotiation.cc:240] Negotiation successful
0808 14:34:02.205203 (+ 416us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":123,"threads_started":1}
I20260808 14:34:02.207617 18699 heartbeater.cc:347] Connected to a master server at 127.11.131.254:41289
I20260808 14:34:02.207906 18699 heartbeater.cc:464] Registering TS with master...
I20260808 14:34:02.208506 18699 heartbeater.cc:511] Master 127.11.131.254:41289 requested a full tablet report, sending...
I20260808 14:34:02.209718 18217 ts_manager.cc:194] Registered new tserver with Master: 64477cf11fa54e8faeadb07b00437fbe (127.11.131.194:38377)
I20260808 14:34:02.210342 18217 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.194@KRBTEST.COM'} at 127.11.131.194:35885
WARNING: no policy specified for kudu/127.11.131.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab.
Entry for principal kudu/127.11.131.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab.
I20260808 14:34:02.235311 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.195:0
--local_ip_for_outbound_sockets=127.11.131.195
--webserver_interface=127.11.131.195
--webserver_port=0
--tserver_master_addrs=127.11.131.254:41289
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab
--principal=kudu/127.11.131.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:33253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:34:02.354912 18707 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:34:02.355218 18707 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:34:02.355301 18707 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:34:02.359412 18707 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:34:02.359493 18707 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:34:02.359580 18707 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.195
I20260808 14:34:02.364996 18707 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:33253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab
--principal=kudu/127.11.131.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.131.195
--webserver_port=0
--tserver_master_addrs=127.11.131.254:41289
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18707
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.195
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:34:02.366123 18707 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:34:02.367296 18707 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:34:02.377427 18718 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:02.377434 18720 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:02.377488 18707 server_base.cc:1034] running on GCE node
W20260808 14:34:02.377429 18717 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:02.378185 18707 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:34:02.379024 18707 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:34:02.380249 18707 hybrid_clock.cc:648] HybridClock initialized: now 1786199642380225 us; error 33 us; skew 500 ppm
Aug 08 14:34:02 dist-test-slave-twwt krb5kdc[18149](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199642, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:34:02.383381 18707 init.cc:377] Logged in from keytab as kudu/127.11.131.195@KRBTEST.COM (short username kudu)
I20260808 14:34:02.384248 18707 fs_manager.cc:359] Metadata directory not provided
I20260808 14:34:02.384342 18707 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:34:02.384672 18707 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:34:02.386901 18707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/ts-2/data/instance:
uuid: "d7fb2bd04f864c30992b153203be8f79"
format_stamp: "Formatted at 2026-08-08 14:34:02 on dist-test-slave-twwt"
server_key: "e03814782c87f016fc785311bc12288c"
server_key_iv: "7ace7856a2beb5cd6768e96c86b1f7f6"
server_key_version: "encryptionkey@0"
I20260808 14:34:02.387509 18707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/ts-2/wal/instance:
uuid: "d7fb2bd04f864c30992b153203be8f79"
format_stamp: "Formatted at 2026-08-08 14:34:02 on dist-test-slave-twwt"
server_key: "e03814782c87f016fc785311bc12288c"
server_key_iv: "7ace7856a2beb5cd6768e96c86b1f7f6"
server_key_version: "encryptionkey@0"
I20260808 14:34:02.391320 18707 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 14:34:02.394016 18730 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:02.395515 18707 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 14:34:02.395678 18707 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/ts-2/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/ts-2/wal
uuid: "d7fb2bd04f864c30992b153203be8f79"
format_stamp: "Formatted at 2026-08-08 14:34:02 on dist-test-slave-twwt"
server_key: "e03814782c87f016fc785311bc12288c"
server_key_iv: "7ace7856a2beb5cd6768e96c86b1f7f6"
server_key_version: "encryptionkey@0"
I20260808 14:34:02.395779 18707 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:34:02.423718 18707 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:34:02.426962 18707 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:34:02.427129 18707 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:34:02.427696 18707 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:34:02.428539 18707 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:34:02.428586 18707 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:02.428627 18707 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:34:02.428649 18707 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:02.437494 18707 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.195:36487
I20260808 14:34:02.437517 18898 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.195:36487 every 8 connection(s)
I20260808 14:34:02.438117 18707 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
I20260808 14:34:02.443849 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 18707
I20260808 14:34:02.443996 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/ts-2/wal/instance
I20260808 14:34:02.444273 11791 external_mini_cluster.cc:1428] Setting key ca123e5206adda3cd652793b963802a6
Aug 08 14:34:02 dist-test-slave-twwt krb5kdc[18149](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199642, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.195@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:34:02.452387 18276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:02.439898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:42897 (local address 127.11.131.254:41289)
0808 14:34:02.440056 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:02.440061 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:02.441554 (+ 1493us) server_negotiation.cc:407] Connection header received
0808 14:34:02.442389 (+ 835us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:02.442392 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:02.442440 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:02.442519 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:02.443722 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:02.444336 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:02.445768 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:02.446095 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:02.446195 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:02.448979 (+ 2784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:02.448982 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:02.448984 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:02.449010 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:02.450470 (+ 1460us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:02.451013 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:02.451015 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:02.451016 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:02.451095 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:02.451431 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:02.451433 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:02.451435 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:02.451612 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:02.451686 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:02.452159 (+ 473us) server_negotiation.cc:299] Negotiation successful
0808 14:34:02.452264 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 14:34:02.453329 18902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:02.440331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:41289 (local address 127.11.131.195:42897)
0808 14:34:02.441394 (+ 1063us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:02.441444 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:02.442205 (+ 761us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:02.442672 (+ 467us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:02.442678 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:02.443037 (+ 359us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:02.443533 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:02.443568 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:02.444508 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:02.444512 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:02.445630 (+ 1118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:02.445644 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:02.446300 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:02.446304 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:02.446570 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:02.447252 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:02.447293 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:02.448806 (+ 1513us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:02.450575 (+ 1769us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:02.450579 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:02.450592 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:02.450923 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:02.451178 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:02.451181 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:02.451182 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:02.451335 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:02.451699 (+ 364us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:02.451705 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:02.451943 (+ 238us) client_negotiation.cc:769] Sending connection context
0808 14:34:02.452097 (+ 154us) client_negotiation.cc:240] Negotiation successful
0808 14:34:02.452375 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":408,"thread_start_us":146,"threads_started":1}
I20260808 14:34:02.454569 18899 heartbeater.cc:347] Connected to a master server at 127.11.131.254:41289
I20260808 14:34:02.454856 18899 heartbeater.cc:464] Registering TS with master...
I20260808 14:34:02.455346 18899 heartbeater.cc:511] Master 127.11.131.254:41289 requested a full tablet report, sending...
I20260808 14:34:02.456403 18217 ts_manager.cc:194] Registered new tserver with Master: d7fb2bd04f864c30992b153203be8f79 (127.11.131.195:36487)
I20260808 14:34:02.456943 18217 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.195@KRBTEST.COM'} at 127.11.131.195:42897
I20260808 14:34:02.458523 11791 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:34:02.468250 18276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:02.460769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50230 (local address 127.11.131.254:41289)
0808 14:34:02.460893 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:02.460897 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:02.461110 (+ 213us) server_negotiation.cc:407] Connection header received
0808 14:34:02.461197 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:02.461199 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:02.461239 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:02.461308 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:02.461993 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:02.462494 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:02.463387 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:02.463609 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:02.463687 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:02.465102 (+ 1415us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:02.465106 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:02.465109 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:02.465143 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:02.466377 (+ 1234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:02.466903 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:02.466906 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:02.466908 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:02.466999 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:02.467296 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:02.467300 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:02.467302 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:02.467546 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:02.467695 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:02.467948 (+ 253us) server_negotiation.cc:299] Negotiation successful
0808 14:34:02.468077 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 14:34:02.471246 18217 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50230:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:34:02.474342 18217 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:34:02.489851 18921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:02.484249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36874 (local address 127.11.131.193:40999)
0808 14:34:02.484845 (+ 596us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:02.484852 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:02.484875 (+ 23us) server_negotiation.cc:407] Connection header received
0808 14:34:02.484947 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:02.484953 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:02.485141 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:02.485293 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:34:02.485711 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:02.486841 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:02.488172 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:02.488960 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:02.489095 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:02.489247 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:02.489607 (+ 360us) server_negotiation.cc:299] Negotiation successful
0808 14:34:02.489721 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":478,"thread_start_us":96,"threads_started":1}
I20260808 14:34:02.489841 18916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:02.483218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.194:38377 (local address 127.0.0.1:33446)
0808 14:34:02.483872 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:02.483934 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:02.484066 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:02.484930 (+ 864us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:02.484938 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:02.484968 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:34:02.485145 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:02.485154 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:02.486639 (+ 1485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:02.486643 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:02.488264 (+ 1621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:02.488277 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:02.489348 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:02.489351 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:02.489447 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:02.489470 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 14:34:02.489566 (+ 96us) client_negotiation.cc:240] Negotiation successful
0808 14:34:02.489646 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":465,"mutex_wait_us":2,"spinlock_wait_cycles":768,"thread_start_us":79,"threads_started":1}
I20260808 14:34:02.490124 18913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:02.483310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:40999 (local address 127.0.0.1:36874)
0808 14:34:02.484474 (+ 1164us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:02.484490 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:02.484579 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:02.485449 (+ 870us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:02.485452 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:02.485473 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:34:02.485575 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:02.485582 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:02.486970 (+ 1388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:02.486973 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:02.488044 (+ 1071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:02.488054 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:02.489104 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:02.489108 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:02.489235 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:02.489284 (+ 49us) client_negotiation.cc:769] Sending connection context
0808 14:34:02.489427 (+ 143us) client_negotiation.cc:240] Negotiation successful
0808 14:34:02.489559 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":530,"mutex_wait_us":92,"thread_start_us":137,"threads_started":1}
I20260808 14:34:02.490219 18920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:02.484164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49524 (local address 127.11.131.195:36487)
0808 14:34:02.484772 (+ 608us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:02.484782 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:02.485114 (+ 332us) server_negotiation.cc:407] Connection header received
0808 14:34:02.485202 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:02.485210 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:02.485396 (+ 186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:02.485549 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:34:02.485766 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:02.486520 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:02.488509 (+ 1989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:02.489138 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:02.489261 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:02.489395 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:02.489922 (+ 527us) server_negotiation.cc:299] Negotiation successful
0808 14:34:02.490051 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":488,"thread_start_us":98,"threads_started":1}
I20260808 14:34:02.489852 18919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:02.483942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.195:36487 (local address 127.0.0.1:49524)
0808 14:34:02.484921 (+ 979us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:02.484934 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:02.485017 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:02.485529 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:02.485532 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:02.485552 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:34:02.485644 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:02.485650 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:02.486878 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:02.486882 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:02.488380 (+ 1498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:02.488391 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:02.489462 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:02.489465 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:02.489543 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:02.489563 (+ 20us) client_negotiation.cc:769] Sending connection context
0808 14:34:02.489633 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 14:34:02.489702 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":917,"mutex_wait_us":217,"thread_start_us":97,"threads_started":1}
I20260808 14:34:02.490949 18918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:02.483372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33446 (local address 127.11.131.194:38377)
0808 14:34:02.484389 (+ 1017us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:02.484402 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:02.484428 (+ 26us) server_negotiation.cc:407] Connection header received
0808 14:34:02.484508 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:02.484515 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:02.484731 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:02.484912 (+ 181us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:34:02.485273 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:02.486466 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:02.488424 (+ 1958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:02.489197 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:02.489355 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:02.489498 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:02.489747 (+ 249us) server_negotiation.cc:299] Negotiation successful
0808 14:34:02.489857 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":896,"thread_start_us":113,"threads_started":1}
I20260808 14:34:02.493292 18382 tablet_service.cc:1467] Processing CreateTablet for tablet f9d3d4b40ea54d8bb77f05bb5d812bab (DEFAULT_TABLE table=test-table [id=b78b82cc85614f65bbd04b1805c09625]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:34:02.493335 18601 tablet_service.cc:1467] Processing CreateTablet for tablet f9d3d4b40ea54d8bb77f05bb5d812bab (DEFAULT_TABLE table=test-table [id=b78b82cc85614f65bbd04b1805c09625]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:34:02.494442 18601 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9d3d4b40ea54d8bb77f05bb5d812bab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:34:02.494441 18382 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9d3d4b40ea54d8bb77f05bb5d812bab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:34:02.496004 18800 tablet_service.cc:1467] Processing CreateTablet for tablet f9d3d4b40ea54d8bb77f05bb5d812bab (DEFAULT_TABLE table=test-table [id=b78b82cc85614f65bbd04b1805c09625]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:34:02.497124 18800 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9d3d4b40ea54d8bb77f05bb5d812bab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:34:02.501626 18923 tablet_bootstrap.cc:492] T f9d3d4b40ea54d8bb77f05bb5d812bab P 64477cf11fa54e8faeadb07b00437fbe: Bootstrap starting.
I20260808 14:34:02.502352 18924 tablet_bootstrap.cc:492] T f9d3d4b40ea54d8bb77f05bb5d812bab P e9e7cbfa3b2d4964a9b8f3af55ec1e00: Bootstrap starting.
I20260808 14:34:02.504922 18924 tablet_bootstrap.cc:654] T f9d3d4b40ea54d8bb77f05bb5d812bab P e9e7cbfa3b2d4964a9b8f3af55ec1e00: Neither blocks nor log segments found. Creating new log.
I20260808 14:34:02.504943 18923 tablet_bootstrap.cc:654] T f9d3d4b40ea54d8bb77f05bb5d812bab P 64477cf11fa54e8faeadb07b00437fbe: Neither blocks nor log segments found. Creating new log.
I20260808 14:34:02.505950 18924 log.cc:824] T f9d3d4b40ea54d8bb77f05bb5d812bab P e9e7cbfa3b2d4964a9b8f3af55ec1e00: Log is configured to *not* fsync() on all Append() calls
I20260808 14:34:02.506067 18923 log.cc:824] T f9d3d4b40ea54d8bb77f05bb5d812bab P 64477cf11fa54e8faeadb07b00437fbe: Log is configured to *not* fsync() on all Append() calls
I20260808 14:34:02.506306 18925 tablet_bootstrap.cc:492] T f9d3d4b40ea54d8bb77f05bb5d812bab P d7fb2bd04f864c30992b153203be8f79: Bootstrap starting.
I20260808 14:34:02.508229 18924 tablet_bootstrap.cc:492] T f9d3d4b40ea54d8bb77f05bb5d812bab P e9e7cbfa3b2d4964a9b8f3af55ec1e00: No bootstrap required, opened a new log
I20260808 14:34:02.508304 18923 tablet_bootstrap.cc:492] T f9d3d4b40ea54d8bb77f05bb5d812bab P 64477cf11fa54e8faeadb07b00437fbe: No bootstrap required, opened a new log
I20260808 14:34:02.508471 18924 ts_tablet_manager.cc:1397] T f9d3d4b40ea54d8bb77f05bb5d812bab P e9e7cbfa3b2d4964a9b8f3af55ec1e00: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 14:34:02.508504 18923 ts_tablet_manager.cc:1397] T f9d3d4b40ea54d8bb77f05bb5d812bab P 64477cf11fa54e8faeadb07b00437fbe: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260808 14:34:02.508639 18925 tablet_bootstrap.cc:654] T f9d3d4b40ea54d8bb77f05bb5d812bab P d7fb2bd04f864c30992b153203be8f79: Neither blocks nor log segments found. Creating new log.
I20260808 14:34:02.509874 18925 log.cc:824] T f9d3d4b40ea54d8bb77f05bb5d812bab P d7fb2bd04f864c30992b153203be8f79: Log is configured to *not* fsync() on all Append() calls
I20260808 14:34:02.512269 18925 tablet_bootstrap.cc:492] T f9d3d4b40ea54d8bb77f05bb5d812bab P d7fb2bd04f864c30992b153203be8f79: No bootstrap required, opened a new log
I20260808 14:34:02.512475 18925 ts_tablet_manager.cc:1397] T f9d3d4b40ea54d8bb77f05bb5d812bab P d7fb2bd04f864c30992b153203be8f79: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 14:34:02.512480 18924 raft_consensus.cc:348] T f9d3d4b40ea54d8bb77f05bb5d812bab P e9e7cbfa3b2d4964a9b8f3af55ec1e00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64477cf11fa54e8faeadb07b00437fbe" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 38377 } } peers { permanent_uuid: "e9e7cbfa3b2d4964a9b8f3af55ec1e00" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 40999 } } peers { permanent_uuid: "d7fb2bd04f864c30992b153203be8f79" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 36487 } }
I20260808 14:34:02.512478 18923 raft_consensus.cc:348] T f9d3d4b40ea54d8bb77f05bb5d812bab P 64477cf11fa54e8faeadb07b00437fbe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64477cf11fa54e8faeadb07b00437fbe" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 38377 } } peers { permanent_uuid: "e9e7cbfa3b2d4964a9b8f3af55ec1e00" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 40999 } } peers { permanent_uuid: "d7fb2bd04f864c30992b153203be8f79" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 36487 } }
I20260808 14:34:02.512792 18923 raft_consensus.cc:374] T f9d3d4b40ea54d8bb77f05bb5d812bab P 64477cf11fa54e8faeadb07b00437fbe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:34:02.512794 18924 raft_consensus.cc:374] T f9d3d4b40ea54d8bb77f05bb5d812bab P e9e7cbfa3b2d4964a9b8f3af55ec1e00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:34:02.512845 18923 raft_consensus.cc:729] T f9d3d4b40ea54d8bb77f05bb5d812bab P 64477cf11fa54e8faeadb07b00437fbe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64477cf11fa54e8faeadb07b00437fbe, State: Initialized, Role: FOLLOWER
I20260808 14:34:02.512866 18924 raft_consensus.cc:729] T f9d3d4b40ea54d8bb77f05bb5d812bab P e9e7cbfa3b2d4964a9b8f3af55ec1e00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9e7cbfa3b2d4964a9b8f3af55ec1e00, State: Initialized, Role: FOLLOWER
I20260808 14:34:02.513331 18924 consensus_queue.cc:260] T f9d3d4b40ea54d8bb77f05bb5d812bab P e9e7cbfa3b2d4964a9b8f3af55ec1e00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64477cf11fa54e8faeadb07b00437fbe" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 38377 } } peers { permanent_uuid: "e9e7cbfa3b2d4964a9b8f3af55ec1e00" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 40999 } } peers { permanent_uuid: "d7fb2bd04f864c30992b153203be8f79" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 36487 } }
I20260808 14:34:02.513406 18923 consensus_queue.cc:260] T f9d3d4b40ea54d8bb77f05bb5d812bab P 64477cf11fa54e8faeadb07b00437fbe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64477cf11fa54e8faeadb07b00437fbe" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 38377 } } peers { permanent_uuid: "e9e7cbfa3b2d4964a9b8f3af55ec1e00" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 40999 } } peers { permanent_uuid: "d7fb2bd04f864c30992b153203be8f79" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 36487 } }
I20260808 14:34:02.514086 18498 heartbeater.cc:503] Master 127.11.131.254:41289 was elected leader, sending a full tablet report...
I20260808 14:34:02.514371 18699 heartbeater.cc:503] Master 127.11.131.254:41289 was elected leader, sending a full tablet report...
I20260808 14:34:02.514418 18923 ts_tablet_manager.cc:1428] T f9d3d4b40ea54d8bb77f05bb5d812bab P 64477cf11fa54e8faeadb07b00437fbe: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260808 14:34:02.514428 18924 ts_tablet_manager.cc:1428] T f9d3d4b40ea54d8bb77f05bb5d812bab P e9e7cbfa3b2d4964a9b8f3af55ec1e00: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 14:34:02.517329 18925 raft_consensus.cc:348] T f9d3d4b40ea54d8bb77f05bb5d812bab P d7fb2bd04f864c30992b153203be8f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64477cf11fa54e8faeadb07b00437fbe" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 38377 } } peers { permanent_uuid: "e9e7cbfa3b2d4964a9b8f3af55ec1e00" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 40999 } } peers { permanent_uuid: "d7fb2bd04f864c30992b153203be8f79" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 36487 } }
I20260808 14:34:02.517659 18925 raft_consensus.cc:374] T f9d3d4b40ea54d8bb77f05bb5d812bab P d7fb2bd04f864c30992b153203be8f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:34:02.517726 18925 raft_consensus.cc:729] T f9d3d4b40ea54d8bb77f05bb5d812bab P d7fb2bd04f864c30992b153203be8f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fb2bd04f864c30992b153203be8f79, State: Initialized, Role: FOLLOWER
I20260808 14:34:02.518195 18925 consensus_queue.cc:260] T f9d3d4b40ea54d8bb77f05bb5d812bab P d7fb2bd04f864c30992b153203be8f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64477cf11fa54e8faeadb07b00437fbe" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 38377 } } peers { permanent_uuid: "e9e7cbfa3b2d4964a9b8f3af55ec1e00" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 40999 } } peers { permanent_uuid: "d7fb2bd04f864c30992b153203be8f79" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 36487 } }
I20260808 14:34:02.519009 18899 heartbeater.cc:503] Master 127.11.131.254:41289 was elected leader, sending a full tablet report...
I20260808 14:34:02.519346 18925 ts_tablet_manager.cc:1428] T f9d3d4b40ea54d8bb77f05bb5d812bab P d7fb2bd04f864c30992b153203be8f79: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260808 14:34:02.589715 18931 raft_consensus.cc:482] T f9d3d4b40ea54d8bb77f05bb5d812bab P e9e7cbfa3b2d4964a9b8f3af55ec1e00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:34:02.589995 18931 raft_consensus.cc:504] T f9d3d4b40ea54d8bb77f05bb5d812bab P e9e7cbfa3b2d4964a9b8f3af55ec1e00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64477cf11fa54e8faeadb07b00437fbe" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 38377 } } peers { permanent_uuid: "e9e7cbfa3b2d4964a9b8f3af55ec1e00" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 40999 } } peers { permanent_uuid: "d7fb2bd04f864c30992b153203be8f79" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 36487 } }
I20260808 14:34:02.591383 18931 leader_election.cc:288] T f9d3d4b40ea54d8bb77f05bb5d812bab P e9e7cbfa3b2d4964a9b8f3af55ec1e00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 64477cf11fa54e8faeadb07b00437fbe (127.11.131.194:38377), d7fb2bd04f864c30992b153203be8f79 (127.11.131.195:36487)
I20260808 14:34:02.595716 18935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:02.591674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.194:38377 (local address 127.11.131.193:43663)
0808 14:34:02.592253 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:02.592265 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:02.592395 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:02.592729 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:02.592731 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:02.592747 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:34:02.592874 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:02.592880 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:02.593668 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:02.593670 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:02.594540 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:02.594550 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:02.595263 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:02.595267 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:02.595360 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:02.595393 (+ 33us) client_negotiation.cc:769] Sending connection context
0808 14:34:02.595465 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 14:34:02.595563 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":520,"mutex_wait_us":87,"thread_start_us":132,"threads_started":1}
I20260808 14:34:02.595743 18918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:02.591829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:43663 (local address 127.11.131.194:38377)
0808 14:34:02.591976 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:02.591981 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:02.592357 (+ 376us) server_negotiation.cc:407] Connection header received
0808 14:34:02.592521 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:02.592523 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:02.592594 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:02.592673 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:34:02.593029 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:02.593525 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:02.594697 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:02.595127 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:02.595258 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:02.595321 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:02.595532 (+ 211us) server_negotiation.cc:299] Negotiation successful
0808 14:34:02.595617 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 14:34:02.595760 18920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:02.591803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:43895 (local address 127.11.131.195:36487)
0808 14:34:02.591983 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:02.591988 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:02.592245 (+ 257us) server_negotiation.cc:407] Connection header received
0808 14:34:02.592458 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:02.592461 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:02.592516 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:02.592583 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:34:02.592972 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:02.593513 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:02.594755 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:02.595153 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:02.595292 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:02.595360 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:02.595581 (+ 221us) server_negotiation.cc:299] Negotiation successful
0808 14:34:02.595658 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260808 14:34:02.596128 18934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:02.591674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.195:36487 (local address 127.11.131.193:43895)
0808 14:34:02.592127 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:02.592140 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:02.592288 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:02.592625 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:02.592631 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:02.592653 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:34:02.592834 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:02.592840 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:02.593627 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:02.593631 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:02.594580 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:02.594590 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:02.595299 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:02.595303 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:02.595411 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:02.595431 (+ 20us) client_negotiation.cc:769] Sending connection context
0808 14:34:02.595907 (+ 476us) client_negotiation.cc:240] Negotiation successful
0808 14:34:02.595998 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":393,"mutex_wait_us":45,"thread_start_us":129,"threads_started":1}
I20260808 14:34:02.596666 18631 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9d3d4b40ea54d8bb77f05bb5d812bab" candidate_uuid: "e9e7cbfa3b2d4964a9b8f3af55ec1e00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64477cf11fa54e8faeadb07b00437fbe" is_pre_election: true
I20260808 14:34:02.596741 18835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9d3d4b40ea54d8bb77f05bb5d812bab" candidate_uuid: "e9e7cbfa3b2d4964a9b8f3af55ec1e00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fb2bd04f864c30992b153203be8f79" is_pre_election: true
I20260808 14:34:02.597054 18835 raft_consensus.cc:2454] T f9d3d4b40ea54d8bb77f05bb5d812bab P d7fb2bd04f864c30992b153203be8f79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9e7cbfa3b2d4964a9b8f3af55ec1e00 in term 0.
I20260808 14:34:02.597054 18631 raft_consensus.cc:2454] T f9d3d4b40ea54d8bb77f05bb5d812bab P 64477cf11fa54e8faeadb07b00437fbe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9e7cbfa3b2d4964a9b8f3af55ec1e00 in term 0.
I20260808 14:34:02.597642 18328 leader_election.cc:302] T f9d3d4b40ea54d8bb77f05bb5d812bab P e9e7cbfa3b2d4964a9b8f3af55ec1e00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 64477cf11fa54e8faeadb07b00437fbe, d7fb2bd04f864c30992b153203be8f79, e9e7cbfa3b2d4964a9b8f3af55ec1e00; no voters:
I20260808 14:34:02.597993 18931 raft_consensus.cc:2781] T f9d3d4b40ea54d8bb77f05bb5d812bab P e9e7cbfa3b2d4964a9b8f3af55ec1e00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:34:02.598104 18931 raft_consensus.cc:482] T f9d3d4b40ea54d8bb77f05bb5d812bab P e9e7cbfa3b2d4964a9b8f3af55ec1e00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:34:02.598187 18931 raft_consensus.cc:3037] T f9d3d4b40ea54d8bb77f05bb5d812bab P e9e7cbfa3b2d4964a9b8f3af55ec1e00 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:34:02.599483 18931 raft_consensus.cc:504] T f9d3d4b40ea54d8bb77f05bb5d812bab P e9e7cbfa3b2d4964a9b8f3af55ec1e00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64477cf11fa54e8faeadb07b00437fbe" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 38377 } } peers { permanent_uuid: "e9e7cbfa3b2d4964a9b8f3af55ec1e00" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 40999 } } peers { permanent_uuid: "d7fb2bd04f864c30992b153203be8f79" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 36487 } }
I20260808 14:34:02.599920 18931 leader_election.cc:288] T f9d3d4b40ea54d8bb77f05bb5d812bab P e9e7cbfa3b2d4964a9b8f3af55ec1e00 [CANDIDATE]: Term 1 election: Requested vote from peers 64477cf11fa54e8faeadb07b00437fbe (127.11.131.194:38377), d7fb2bd04f864c30992b153203be8f79 (127.11.131.195:36487)
I20260808 14:34:02.600399 18631 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9d3d4b40ea54d8bb77f05bb5d812bab" candidate_uuid: "e9e7cbfa3b2d4964a9b8f3af55ec1e00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64477cf11fa54e8faeadb07b00437fbe"
I20260808 14:34:02.600405 18835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9d3d4b40ea54d8bb77f05bb5d812bab" candidate_uuid: "e9e7cbfa3b2d4964a9b8f3af55ec1e00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fb2bd04f864c30992b153203be8f79"
I20260808 14:34:02.600544 18631 raft_consensus.cc:3037] T f9d3d4b40ea54d8bb77f05bb5d812bab P 64477cf11fa54e8faeadb07b00437fbe [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:34:02.600560 18835 raft_consensus.cc:3037] T f9d3d4b40ea54d8bb77f05bb5d812bab P d7fb2bd04f864c30992b153203be8f79 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:34:02.601624 18631 raft_consensus.cc:2454] T f9d3d4b40ea54d8bb77f05bb5d812bab P 64477cf11fa54e8faeadb07b00437fbe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9e7cbfa3b2d4964a9b8f3af55ec1e00 in term 1.
I20260808 14:34:02.601648 18835 raft_consensus.cc:2454] T f9d3d4b40ea54d8bb77f05bb5d812bab P d7fb2bd04f864c30992b153203be8f79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9e7cbfa3b2d4964a9b8f3af55ec1e00 in term 1.
I20260808 14:34:02.601998 18332 leader_election.cc:302] T f9d3d4b40ea54d8bb77f05bb5d812bab P e9e7cbfa3b2d4964a9b8f3af55ec1e00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7fb2bd04f864c30992b153203be8f79, e9e7cbfa3b2d4964a9b8f3af55ec1e00; no voters:
I20260808 14:34:02.602190 18931 raft_consensus.cc:2781] T f9d3d4b40ea54d8bb77f05bb5d812bab P e9e7cbfa3b2d4964a9b8f3af55ec1e00 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:34:02.602456 18931 raft_consensus.cc:686] T f9d3d4b40ea54d8bb77f05bb5d812bab P e9e7cbfa3b2d4964a9b8f3af55ec1e00 [term 1 LEADER]: Becoming Leader. State: Replica: e9e7cbfa3b2d4964a9b8f3af55ec1e00, State: Running, Role: LEADER
I20260808 14:34:02.602849 18931 consensus_queue.cc:237] T f9d3d4b40ea54d8bb77f05bb5d812bab P e9e7cbfa3b2d4964a9b8f3af55ec1e00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64477cf11fa54e8faeadb07b00437fbe" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 38377 } } peers { permanent_uuid: "e9e7cbfa3b2d4964a9b8f3af55ec1e00" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 40999 } } peers { permanent_uuid: "d7fb2bd04f864c30992b153203be8f79" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 36487 } }
I20260808 14:34:02.606375 18216 catalog_manager.cc:5495] T f9d3d4b40ea54d8bb77f05bb5d812bab P e9e7cbfa3b2d4964a9b8f3af55ec1e00 reported cstate change: term changed from 0 to 1, leader changed from <none> to e9e7cbfa3b2d4964a9b8f3af55ec1e00 (127.11.131.193). New cstate: current_term: 1 leader_uuid: "e9e7cbfa3b2d4964a9b8f3af55ec1e00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64477cf11fa54e8faeadb07b00437fbe" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 38377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e9e7cbfa3b2d4964a9b8f3af55ec1e00" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 40999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7fb2bd04f864c30992b153203be8f79" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 36487 } health_report { overall_health: UNKNOWN } } }
I20260808 14:34:02.642725 18921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:02.639220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36886 (local address 127.11.131.193:40999)
0808 14:34:02.639367 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:02.639370 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:02.639384 (+ 14us) server_negotiation.cc:407] Connection header received
0808 14:34:02.639479 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:02.639481 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:02.639538 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:02.639627 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:34:02.639875 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:02.640373 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:02.641177 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:02.641383 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:02.641466 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:02.641750 (+ 284us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:34:02.642237 (+ 487us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:34:02.642335 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:02.642469 (+ 134us) server_negotiation.cc:299] Negotiation successful
0808 14:34:02.642522 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 14:34:02.649144 18835 raft_consensus.cc:1261] T f9d3d4b40ea54d8bb77f05bb5d812bab P d7fb2bd04f864c30992b153203be8f79 [term 1 FOLLOWER]: Refusing update from remote peer e9e7cbfa3b2d4964a9b8f3af55ec1e00: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:34:02.649144 18631 raft_consensus.cc:1261] T f9d3d4b40ea54d8bb77f05bb5d812bab P 64477cf11fa54e8faeadb07b00437fbe [term 1 FOLLOWER]: Refusing update from remote peer e9e7cbfa3b2d4964a9b8f3af55ec1e00: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:34:02.650015 18931 consensus_queue.cc:1035] T f9d3d4b40ea54d8bb77f05bb5d812bab P e9e7cbfa3b2d4964a9b8f3af55ec1e00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64477cf11fa54e8faeadb07b00437fbe" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:34:02.650316 18937 consensus_queue.cc:1035] T f9d3d4b40ea54d8bb77f05bb5d812bab P e9e7cbfa3b2d4964a9b8f3af55ec1e00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fb2bd04f864c30992b153203be8f79" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 36487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:34:02.659360 18942 mvcc.cc:205] Tried to move back new op lower bound from 7316273736282857472 to 7316273736104337408. Current Snapshot: MvccSnapshot[applied={T|T < 7316273736282857472}]
I20260808 14:34:02.659754 18943 mvcc.cc:205] Tried to move back new op lower bound from 7316273736282857472 to 7316273736104337408. Current Snapshot: MvccSnapshot[applied={T|T < 7316273736282857472}]
I20260808 14:34:02.666422 18217 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50230:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:34:02.666568 18217 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50230:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:34:02.668910 18217 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 945688fa9a8a4ea2a27567cb55c107b1: Sending DeleteTablet for 3 replicas of tablet f9d3d4b40ea54d8bb77f05bb5d812bab
I20260808 14:34:02.669658 18601 tablet_service.cc:1514] Processing DeleteTablet for tablet f9d3d4b40ea54d8bb77f05bb5d812bab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:34:02 UTC) from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:33446
I20260808 14:34:02.669750 18800 tablet_service.cc:1514] Processing DeleteTablet for tablet f9d3d4b40ea54d8bb77f05bb5d812bab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:34:02 UTC) from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:49524
I20260808 14:34:02.669744 18382 tablet_service.cc:1514] Processing DeleteTablet for tablet f9d3d4b40ea54d8bb77f05bb5d812bab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:34:02 UTC) from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:36874
I20260808 14:34:02.670326 18953 tablet_replica.cc:330] T f9d3d4b40ea54d8bb77f05bb5d812bab P 64477cf11fa54e8faeadb07b00437fbe: stopping tablet replica
I20260808 14:34:02.670869 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 18308
I20260808 14:34:02.670686 18953 raft_consensus.cc:2229] T f9d3d4b40ea54d8bb77f05bb5d812bab P 64477cf11fa54e8faeadb07b00437fbe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:34:02.683648 18953 raft_consensus.cc:2258] T f9d3d4b40ea54d8bb77f05bb5d812bab P 64477cf11fa54e8faeadb07b00437fbe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:34:02.686581 18954 tablet_replica.cc:330] T f9d3d4b40ea54d8bb77f05bb5d812bab P d7fb2bd04f864c30992b153203be8f79: stopping tablet replica
I20260808 14:34:02.687073 18953 ts_tablet_manager.cc:1905] T f9d3d4b40ea54d8bb77f05bb5d812bab P 64477cf11fa54e8faeadb07b00437fbe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:34:02.687062 18954 raft_consensus.cc:2229] T f9d3d4b40ea54d8bb77f05bb5d812bab P d7fb2bd04f864c30992b153203be8f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:34:02.687467 18954 raft_consensus.cc:2258] T f9d3d4b40ea54d8bb77f05bb5d812bab P d7fb2bd04f864c30992b153203be8f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:34:02.689021 18954 ts_tablet_manager.cc:1905] T f9d3d4b40ea54d8bb77f05bb5d812bab P d7fb2bd04f864c30992b153203be8f79: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:34:02.689786 18953 ts_tablet_manager.cc:1918] T f9d3d4b40ea54d8bb77f05bb5d812bab P 64477cf11fa54e8faeadb07b00437fbe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:34:02.689908 18953 log.cc:1196] T f9d3d4b40ea54d8bb77f05bb5d812bab P 64477cf11fa54e8faeadb07b00437fbe: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/ts-1/wal/wals/f9d3d4b40ea54d8bb77f05bb5d812bab
I20260808 14:34:02.690199 18953 ts_tablet_manager.cc:1939] T f9d3d4b40ea54d8bb77f05bb5d812bab P 64477cf11fa54e8faeadb07b00437fbe: Deleting consensus metadata
I20260808 14:34:02.691605 18188 catalog_manager.cc:4841] TS 64477cf11fa54e8faeadb07b00437fbe (127.11.131.194:38377): tablet f9d3d4b40ea54d8bb77f05bb5d812bab (table test-table [id=b78b82cc85614f65bbd04b1805c09625]) successfully deleted
I20260808 14:34:02.692577 18954 ts_tablet_manager.cc:1918] T f9d3d4b40ea54d8bb77f05bb5d812bab P d7fb2bd04f864c30992b153203be8f79: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:34:02.692708 18954 log.cc:1196] T f9d3d4b40ea54d8bb77f05bb5d812bab P d7fb2bd04f864c30992b153203be8f79: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786199615258783-11791-0/minicluster-data/ts-2/wal/wals/f9d3d4b40ea54d8bb77f05bb5d812bab
I20260808 14:34:02.693068 18954 ts_tablet_manager.cc:1939] T f9d3d4b40ea54d8bb77f05bb5d812bab P d7fb2bd04f864c30992b153203be8f79: Deleting consensus metadata
I20260808 14:34:02.694389 18191 catalog_manager.cc:4841] TS d7fb2bd04f864c30992b153203be8f79 (127.11.131.195:36487): tablet f9d3d4b40ea54d8bb77f05bb5d812bab (table test-table [id=b78b82cc85614f65bbd04b1805c09625]) successfully deleted
I20260808 14:34:02.695693 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 18508
W20260808 14:34:02.695683 18191 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.131.193:40999 (error 108)
I20260808 14:34:02.701179 18919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:02.700803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:40999 (local address 127.0.0.1:36888)
0808 14:34:02.700978 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:02.701070 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.193:40999: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260808 14:34:02.701362 18191 catalog_manager.cc:4584] TS e9e7cbfa3b2d4964a9b8f3af55ec1e00 (127.11.131.193:40999): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f9d3d4b40ea54d8bb77f05bb5d812bab: Network error: Client connection negotiation failed: client connection to 127.11.131.193:40999: connect: Connection refused (error 111)
I20260808 14:34:02.711826 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 18707
I20260808 14:34:02.725757 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 18165
2026-08-08T14:34:02Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2688 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-08T14:34:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:34:02Z Disabled control of system clock
I20260808 14:34:02.767537 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:46521
--webserver_interface=127.11.131.254
--webserver_port=0
--builtin_ntp_servers=127.11.131.212:38161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:46521
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 14:34:02.888062 18962 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:34:02.888343 18962 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:34:02.888384 18962 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:34:02.892509 18962 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:34:02.892575 18962 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:34:02.892591 18962 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:34:02.892609 18962 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:34:02.892624 18962 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:34:02.897584 18962 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:38161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:46521
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:46521
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.131.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18962
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:34:02.898783 18962 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:34:02.900193 18962 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:34:02.909111 18971 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:02.909111 18968 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:02.909121 18973 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:02.909458 18962 server_base.cc:1034] running on GCE node
I20260808 14:34:02.910048 18962 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:34:02.911319 18962 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:34:02.912523 18962 hybrid_clock.cc:648] HybridClock initialized: now 1786199642912496 us; error 44 us; skew 500 ppm
I20260808 14:34:02.914593 18962 webserver.cc:460] Webserver started at http://127.11.131.254:41491/ using document root <none> and password file <none>
I20260808 14:34:02.915299 18962 fs_manager.cc:359] Metadata directory not provided
I20260808 14:34:02.915409 18962 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:34:02.915665 18962 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:34:02.917919 18962 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/master-0/data/instance:
uuid: "43212106981e455faf3a0195a802d1be"
format_stamp: "Formatted at 2026-08-08 14:34:02 on dist-test-slave-twwt"
server_key: "3f4d0e800c83e38488651b722f5997be"
server_key_iv: "a47a80a8098564497a4629e9fff0f18a"
server_key_version: "encryptionkey@0"
I20260808 14:34:02.918533 18962 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/master-0/wal/instance:
uuid: "43212106981e455faf3a0195a802d1be"
format_stamp: "Formatted at 2026-08-08 14:34:02 on dist-test-slave-twwt"
server_key: "3f4d0e800c83e38488651b722f5997be"
server_key_iv: "a47a80a8098564497a4629e9fff0f18a"
server_key_version: "encryptionkey@0"
I20260808 14:34:02.922551 18962 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260808 14:34:02.925273 18982 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:02.926575 18962 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 14:34:02.926841 18962 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "43212106981e455faf3a0195a802d1be"
format_stamp: "Formatted at 2026-08-08 14:34:02 on dist-test-slave-twwt"
server_key: "3f4d0e800c83e38488651b722f5997be"
server_key_iv: "a47a80a8098564497a4629e9fff0f18a"
server_key_version: "encryptionkey@0"
I20260808 14:34:02.926972 18962 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:34:02.931803 18962 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:34:02.932425 18962 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:34:02.932613 18962 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:34:02.939760 18962 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.254:46521
I20260808 14:34:02.939771 19064 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.254:46521 every 8 connection(s)
I20260808 14:34:02.940697 18962 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:34:02.943863 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 18962
I20260808 14:34:02.944010 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/master-0/wal/instance
I20260808 14:34:02.944057 19067 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:34:02.944340 11791 external_mini_cluster.cc:1428] Setting key 156724aa26a9c9aea24f31580573bd94
I20260808 14:34:02.950812 19071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:02.945737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54190 (local address 127.11.131.254:46521)
0808 14:34:02.946412 (+ 675us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:02.946427 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:02.946464 (+ 37us) server_negotiation.cc:407] Connection header received
0808 14:34:02.947312 (+ 848us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:02.947332 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:02.947832 (+ 500us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:02.948255 (+ 423us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:02.949285 (+ 1030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:02.949290 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:02.949301 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:34:02.949312 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:02.949368 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:34:02.949384 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:02.949501 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:02.949643 (+ 142us) server_negotiation.cc:299] Negotiation successful
0808 14:34:02.950024 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":319,"thread_start_us":160,"threads_started":1}
I20260808 14:34:02.951452 19067 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 43212106981e455faf3a0195a802d1be: Bootstrap starting.
I20260808 14:34:02.953924 19067 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 43212106981e455faf3a0195a802d1be: Neither blocks nor log segments found. Creating new log.
I20260808 14:34:02.954741 19067 log.cc:824] T 00000000000000000000000000000000 P 43212106981e455faf3a0195a802d1be: Log is configured to *not* fsync() on all Append() calls
I20260808 14:34:02.956604 19067 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 43212106981e455faf3a0195a802d1be: No bootstrap required, opened a new log
I20260808 14:34:02.960179 19067 raft_consensus.cc:348] T 00000000000000000000000000000000 P 43212106981e455faf3a0195a802d1be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43212106981e455faf3a0195a802d1be" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46521 } }
I20260808 14:34:02.960427 19067 raft_consensus.cc:374] T 00000000000000000000000000000000 P 43212106981e455faf3a0195a802d1be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:34:02.960505 19067 raft_consensus.cc:729] T 00000000000000000000000000000000 P 43212106981e455faf3a0195a802d1be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43212106981e455faf3a0195a802d1be, State: Initialized, Role: FOLLOWER
I20260808 14:34:02.960928 19067 consensus_queue.cc:260] T 00000000000000000000000000000000 P 43212106981e455faf3a0195a802d1be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43212106981e455faf3a0195a802d1be" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46521 } }
I20260808 14:34:02.961093 19067 raft_consensus.cc:388] T 00000000000000000000000000000000 P 43212106981e455faf3a0195a802d1be [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:34:02.961179 19067 raft_consensus.cc:482] T 00000000000000000000000000000000 P 43212106981e455faf3a0195a802d1be [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:34:02.961300 19067 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 43212106981e455faf3a0195a802d1be [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:34:02.962190 19067 raft_consensus.cc:504] T 00000000000000000000000000000000 P 43212106981e455faf3a0195a802d1be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43212106981e455faf3a0195a802d1be" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46521 } }
I20260808 14:34:02.962538 19067 leader_election.cc:302] T 00000000000000000000000000000000 P 43212106981e455faf3a0195a802d1be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 43212106981e455faf3a0195a802d1be; no voters:
I20260808 14:34:02.962872 19067 leader_election.cc:288] T 00000000000000000000000000000000 P 43212106981e455faf3a0195a802d1be [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:34:02.963001 19073 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 43212106981e455faf3a0195a802d1be [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:34:02.963274 19073 raft_consensus.cc:686] T 00000000000000000000000000000000 P 43212106981e455faf3a0195a802d1be [term 1 LEADER]: Becoming Leader. State: Replica: 43212106981e455faf3a0195a802d1be, State: Running, Role: LEADER
I20260808 14:34:02.963625 19073 consensus_queue.cc:237] T 00000000000000000000000000000000 P 43212106981e455faf3a0195a802d1be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43212106981e455faf3a0195a802d1be" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46521 } }
I20260808 14:34:02.964239 19067 sys_catalog.cc:564] T 00000000000000000000000000000000 P 43212106981e455faf3a0195a802d1be [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:34:02.965529 19075 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43212106981e455faf3a0195a802d1be [sys.catalog]: SysCatalogTable state changed. Reason: New leader 43212106981e455faf3a0195a802d1be. Latest consensus state: current_term: 1 leader_uuid: "43212106981e455faf3a0195a802d1be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43212106981e455faf3a0195a802d1be" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46521 } } }
I20260808 14:34:02.965531 19074 sys_catalog.cc:455] T 00000000000000000000000000000000 P 43212106981e455faf3a0195a802d1be [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "43212106981e455faf3a0195a802d1be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "43212106981e455faf3a0195a802d1be" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46521 } } }
I20260808 14:34:02.965672 19075 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43212106981e455faf3a0195a802d1be [sys.catalog]: This master's current role is: LEADER
I20260808 14:34:02.965677 19074 sys_catalog.cc:458] T 00000000000000000000000000000000 P 43212106981e455faf3a0195a802d1be [sys.catalog]: This master's current role is: LEADER
I20260808 14:34:02.966061 19084 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:34:02.969327 19084 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:34:02.975173 19084 catalog_manager.cc:1347] Generated new cluster ID: bb90785de41647e08fd93930c38133ba
I20260808 14:34:02.975244 19084 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:34:02.991183 19084 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:34:02.991549 19084 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:34:02.999356 19084 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 43212106981e455faf3a0195a802d1be: Generated new TSK 0
I20260808 14:34:03.000209 19084 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:34:03.005537 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.193:0
--local_ip_for_outbound_sockets=127.11.131.193
--webserver_interface=127.11.131.193
--webserver_port=0
--tserver_master_addrs=127.11.131.254:46521
--builtin_ntp_servers=127.11.131.212:38161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 14:34:03.126296 19100 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:34:03.126642 19100 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:34:03.126729 19100 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:34:03.130900 19100 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:34:03.130988 19100 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:34:03.131083 19100 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.193
I20260808 14:34:03.136067 19100 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:38161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.131.193
--webserver_port=0
--tserver_master_addrs=127.11.131.254:46521
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19100
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.193
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:34:03.137233 19100 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:34:03.138758 19100 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:34:03.148615 19108 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:03.148633 19107 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:03.148638 19114 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:03.148837 19100 server_base.cc:1034] running on GCE node
I20260808 14:34:03.149359 19100 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:34:03.150080 19100 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:34:03.151307 19100 hybrid_clock.cc:648] HybridClock initialized: now 1786199643151282 us; error 32 us; skew 500 ppm
I20260808 14:34:03.153548 19100 webserver.cc:460] Webserver started at http://127.11.131.193:46017/ using document root <none> and password file <none>
I20260808 14:34:03.154237 19100 fs_manager.cc:359] Metadata directory not provided
I20260808 14:34:03.154350 19100 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:34:03.154664 19100 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:34:03.156994 19100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/ts-0/data/instance:
uuid: "2f6bfdac4d424c9d8aee730e637c54fb"
format_stamp: "Formatted at 2026-08-08 14:34:03 on dist-test-slave-twwt"
server_key: "14405d5020ca64e63c8f3ddabbc57585"
server_key_iv: "47fa1eca592c6253e2cb50a2805caa1a"
server_key_version: "encryptionkey@0"
I20260808 14:34:03.157701 19100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/ts-0/wal/instance:
uuid: "2f6bfdac4d424c9d8aee730e637c54fb"
format_stamp: "Formatted at 2026-08-08 14:34:03 on dist-test-slave-twwt"
server_key: "14405d5020ca64e63c8f3ddabbc57585"
server_key_iv: "47fa1eca592c6253e2cb50a2805caa1a"
server_key_version: "encryptionkey@0"
I20260808 14:34:03.161918 19100 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260808 14:34:03.164927 19121 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:03.166481 19100 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 14:34:03.166667 19100 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/ts-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/ts-0/wal
uuid: "2f6bfdac4d424c9d8aee730e637c54fb"
format_stamp: "Formatted at 2026-08-08 14:34:03 on dist-test-slave-twwt"
server_key: "14405d5020ca64e63c8f3ddabbc57585"
server_key_iv: "47fa1eca592c6253e2cb50a2805caa1a"
server_key_version: "encryptionkey@0"
I20260808 14:34:03.166821 19100 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:34:03.171799 19100 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:34:03.172509 19100 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:34:03.172749 19100 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:34:03.173367 19100 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:34:03.174394 19100 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:34:03.174476 19100 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:03.174551 19100 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:34:03.174592 19100 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:03.183852 19100 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.193:38139
I20260808 14:34:03.183900 19289 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.193:38139 every 8 connection(s)
I20260808 14:34:03.184880 19100 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
I20260808 14:34:03.191809 19071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:03.187122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:54539 (local address 127.11.131.254:46521)
0808 14:34:03.187269 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:03.187273 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:03.188358 (+ 1085us) server_negotiation.cc:407] Connection header received
0808 14:34:03.189865 (+ 1507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:03.189868 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:03.189918 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:03.190031 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:03.191293 (+ 1262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:03.191297 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:03.191300 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:34:03.191313 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:03.191336 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:34:03.191352 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:03.191454 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:03.191606 (+ 152us) server_negotiation.cc:299] Negotiation successful
0808 14:34:03.191656 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 14:34:03.192696 19294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:03.187472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:46521 (local address 127.11.131.193:54539)
0808 14:34:03.188177 (+ 705us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:03.188236 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:03.189612 (+ 1376us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:03.190227 (+ 615us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:03.190234 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:03.190326 (+ 92us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:03.191004 (+ 678us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:34:03.191005 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:03.191049 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:34:03.191124 (+ 75us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:03.191435 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:03.191446 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:03.191452 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 14:34:03.191641 (+ 189us) client_negotiation.cc:240] Negotiation successful
0808 14:34:03.191893 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":121,"threads_started":1}
I20260808 14:34:03.193732 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 19100
I20260808 14:34:03.193879 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/ts-0/wal/instance
I20260808 14:34:03.194144 19292 heartbeater.cc:347] Connected to a master server at 127.11.131.254:46521
I20260808 14:34:03.194193 11791 external_mini_cluster.cc:1428] Setting key 3e6a777a0ae04ecc16a517f091ef5faf
I20260808 14:34:03.194408 19292 heartbeater.cc:464] Registering TS with master...
I20260808 14:34:03.194988 19292 heartbeater.cc:511] Master 127.11.131.254:46521 requested a full tablet report, sending...
I20260808 14:34:03.196370 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.194:0
--local_ip_for_outbound_sockets=127.11.131.194
--webserver_interface=127.11.131.194
--webserver_port=0
--tserver_master_addrs=127.11.131.254:46521
--builtin_ntp_servers=127.11.131.212:38161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260808 14:34:03.196708 19003 ts_manager.cc:194] Registered new tserver with Master: 2f6bfdac4d424c9d8aee730e637c54fb (127.11.131.193:38139)
W20260808 14:34:03.315090 19295 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:34:03.315353 19295 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:34:03.315393 19295 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:34:03.319350 19295 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:34:03.319404 19295 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:34:03.319458 19295 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.194
I20260808 14:34:03.324210 19295 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:38161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.131.194
--webserver_port=0
--tserver_master_addrs=127.11.131.254:46521
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19295
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.194
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:34:03.325234 19295 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:34:03.326587 19295 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:34:03.336824 19301 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:03.336944 19295 server_base.cc:1034] running on GCE node
W20260808 14:34:03.336817 19300 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:03.336817 19305 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:03.337430 19295 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:34:03.338032 19295 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:34:03.339229 19295 hybrid_clock.cc:648] HybridClock initialized: now 1786199643339185 us; error 52 us; skew 500 ppm
I20260808 14:34:03.341060 19295 webserver.cc:460] Webserver started at http://127.11.131.194:33907/ using document root <none> and password file <none>
I20260808 14:34:03.341655 19295 fs_manager.cc:359] Metadata directory not provided
I20260808 14:34:03.341718 19295 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:34:03.341987 19295 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:34:03.344146 19295 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/ts-1/data/instance:
uuid: "2a4ca70e154143c19475e20180a62ace"
format_stamp: "Formatted at 2026-08-08 14:34:03 on dist-test-slave-twwt"
server_key: "f0dffa28576125d7800f052d6eedb477"
server_key_iv: "c528273cc3ae0900ad625f94477a7e6f"
server_key_version: "encryptionkey@0"
I20260808 14:34:03.344735 19295 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/ts-1/wal/instance:
uuid: "2a4ca70e154143c19475e20180a62ace"
format_stamp: "Formatted at 2026-08-08 14:34:03 on dist-test-slave-twwt"
server_key: "f0dffa28576125d7800f052d6eedb477"
server_key_iv: "c528273cc3ae0900ad625f94477a7e6f"
server_key_version: "encryptionkey@0"
I20260808 14:34:03.348469 19295 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260808 14:34:03.351032 19314 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:03.352351 19295 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 14:34:03.352504 19295 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/ts-1/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/ts-1/wal
uuid: "2a4ca70e154143c19475e20180a62ace"
format_stamp: "Formatted at 2026-08-08 14:34:03 on dist-test-slave-twwt"
server_key: "f0dffa28576125d7800f052d6eedb477"
server_key_iv: "c528273cc3ae0900ad625f94477a7e6f"
server_key_version: "encryptionkey@0"
I20260808 14:34:03.352635 19295 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:34:03.357493 19295 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:34:03.358108 19295 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:34:03.358300 19295 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:34:03.358925 19295 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:34:03.359856 19295 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:34:03.359927 19295 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:03.359994 19295 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:34:03.360047 19295 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:03.369659 19295 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.194:37313
I20260808 14:34:03.369685 19474 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.194:37313 every 8 connection(s)
I20260808 14:34:03.370674 19295 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
I20260808 14:34:03.374292 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 19295
I20260808 14:34:03.374446 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/ts-1/wal/instance
I20260808 14:34:03.374816 11791 external_mini_cluster.cc:1428] Setting key daf5d0027d4b0ffdaa252f0744c79e5d
I20260808 14:34:03.377421 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.195:0
--local_ip_for_outbound_sockets=127.11.131.195
--webserver_interface=127.11.131.195
--webserver_port=0
--tserver_master_addrs=127.11.131.254:46521
--builtin_ntp_servers=127.11.131.212:38161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260808 14:34:03.377529 19071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:03.372607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:51199 (local address 127.11.131.254:46521)
0808 14:34:03.372764 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:03.372768 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:03.373838 (+ 1070us) server_negotiation.cc:407] Connection header received
0808 14:34:03.375681 (+ 1843us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:03.375685 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:03.375731 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:03.375819 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:03.377050 (+ 1231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:03.377054 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:03.377056 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:34:03.377067 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:03.377086 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:34:03.377094 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:03.377165 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:03.377353 (+ 188us) server_negotiation.cc:299] Negotiation successful
0808 14:34:03.377392 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 14:34:03.378701 19477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:03.372979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:46521 (local address 127.11.131.194:51199)
0808 14:34:03.373657 (+ 678us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:03.373700 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:03.375400 (+ 1700us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:03.375962 (+ 562us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:03.375969 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:03.376058 (+ 89us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:03.376734 (+ 676us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:34:03.376736 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:03.376790 (+ 54us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:34:03.376893 (+ 103us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:03.377183 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:03.377195 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:03.377205 (+ 10us) client_negotiation.cc:769] Sending connection context
0808 14:34:03.377398 (+ 193us) client_negotiation.cc:240] Negotiation successful
0808 14:34:03.377656 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":127,"threads_started":1}
I20260808 14:34:03.379796 19475 heartbeater.cc:347] Connected to a master server at 127.11.131.254:46521
I20260808 14:34:03.380033 19475 heartbeater.cc:464] Registering TS with master...
I20260808 14:34:03.380456 19475 heartbeater.cc:511] Master 127.11.131.254:46521 requested a full tablet report, sending...
I20260808 14:34:03.381493 19003 ts_manager.cc:194] Registered new tserver with Master: 2a4ca70e154143c19475e20180a62ace (127.11.131.194:37313)
W20260808 14:34:03.496729 19480 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:34:03.497041 19480 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:34:03.497119 19480 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:34:03.501570 19480 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:34:03.501654 19480 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:34:03.501742 19480 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.195
I20260808 14:34:03.506713 19480 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:38161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.131.195
--webserver_port=0
--tserver_master_addrs=127.11.131.254:46521
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19480
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.195
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:34:03.507938 19480 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:34:03.509445 19480 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:34:03.520100 19493 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:03.520174 19480 server_base.cc:1034] running on GCE node
W20260808 14:34:03.520156 19485 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:03.520399 19486 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:03.520843 19480 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:34:03.521535 19480 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:34:03.522691 19480 hybrid_clock.cc:648] HybridClock initialized: now 1786199643522673 us; error 30 us; skew 500 ppm
I20260808 14:34:03.524654 19480 webserver.cc:460] Webserver started at http://127.11.131.195:35601/ using document root <none> and password file <none>
I20260808 14:34:03.525272 19480 fs_manager.cc:359] Metadata directory not provided
I20260808 14:34:03.525337 19480 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:34:03.525584 19480 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:34:03.527796 19480 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/ts-2/data/instance:
uuid: "43f83637b71d4846b952122c481c9ff9"
format_stamp: "Formatted at 2026-08-08 14:34:03 on dist-test-slave-twwt"
server_key: "67a2350d5f52499efe3b804eb23e7e2e"
server_key_iv: "171ac4570bc254d6545eeef252221a04"
server_key_version: "encryptionkey@0"
I20260808 14:34:03.528375 19480 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/ts-2/wal/instance:
uuid: "43f83637b71d4846b952122c481c9ff9"
format_stamp: "Formatted at 2026-08-08 14:34:03 on dist-test-slave-twwt"
server_key: "67a2350d5f52499efe3b804eb23e7e2e"
server_key_iv: "171ac4570bc254d6545eeef252221a04"
server_key_version: "encryptionkey@0"
I20260808 14:34:03.532438 19480 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 14:34:03.535066 19499 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:03.536341 19480 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 14:34:03.536485 19480 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/ts-2/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/ts-2/wal
uuid: "43f83637b71d4846b952122c481c9ff9"
format_stamp: "Formatted at 2026-08-08 14:34:03 on dist-test-slave-twwt"
server_key: "67a2350d5f52499efe3b804eb23e7e2e"
server_key_iv: "171ac4570bc254d6545eeef252221a04"
server_key_version: "encryptionkey@0"
I20260808 14:34:03.536602 19480 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:34:03.541237 19480 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:34:03.541879 19480 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:34:03.542071 19480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:34:03.542672 19480 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:34:03.543589 19480 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:34:03.543659 19480 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:03.543728 19480 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:34:03.543781 19480 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:03.552657 19480 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.195:46067
I20260808 14:34:03.552696 19676 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.195:46067 every 8 connection(s)
I20260808 14:34:03.553620 19480 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
I20260808 14:34:03.555207 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 19480
I20260808 14:34:03.555336 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/ts-2/wal/instance
I20260808 14:34:03.555665 11791 external_mini_cluster.cc:1428] Setting key 4d881f27757863b4d411aa6498145404
I20260808 14:34:03.560729 19071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:03.555624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:37413 (local address 127.11.131.254:46521)
0808 14:34:03.555788 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:03.555794 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:03.557375 (+ 1581us) server_negotiation.cc:407] Connection header received
0808 14:34:03.558931 (+ 1556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:03.558934 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:03.558978 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:03.559057 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:03.560237 (+ 1180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:03.560241 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:03.560244 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:34:03.560257 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:03.560279 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:34:03.560288 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:03.560391 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:03.560546 (+ 155us) server_negotiation.cc:299] Negotiation successful
0808 14:34:03.560593 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 14:34:03.561659 19679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:03.556252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:46521 (local address 127.11.131.195:37413)
0808 14:34:03.557228 (+ 976us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:03.557271 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:03.558718 (+ 1447us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:03.559235 (+ 517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:03.559242 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:03.559341 (+ 99us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:03.559967 (+ 626us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:34:03.559969 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:03.560010 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:34:03.560080 (+ 70us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:03.560380 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:03.560390 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:03.560396 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 14:34:03.560595 (+ 199us) client_negotiation.cc:240] Negotiation successful
0808 14:34:03.560846 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":184,"threads_started":1}
I20260808 14:34:03.562808 19677 heartbeater.cc:347] Connected to a master server at 127.11.131.254:46521
I20260808 14:34:03.563045 19677 heartbeater.cc:464] Registering TS with master...
I20260808 14:34:03.563442 19677 heartbeater.cc:511] Master 127.11.131.254:46521 requested a full tablet report, sending...
I20260808 14:34:03.564392 19003 ts_manager.cc:194] Registered new tserver with Master: 43f83637b71d4846b952122c481c9ff9 (127.11.131.195:46067)
I20260808 14:34:03.569730 11791 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:34:03.573450 19071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:03.571849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54192 (local address 127.11.131.254:46521)
0808 14:34:03.572004 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:03.572009 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:03.572175 (+ 166us) server_negotiation.cc:407] Connection header received
0808 14:34:03.572261 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:03.572263 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:03.572297 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:03.572364 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:03.573060 (+ 696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:03.573063 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:03.573065 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:34:03.573076 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:03.573094 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:34:03.573101 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:03.573170 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:03.573244 (+ 74us) server_negotiation.cc:299] Negotiation successful
0808 14:34:03.573278 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 14:34:03.576265 19003 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54192:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:34:03.579373 19003 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:34:03.592185 19703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:03.588475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.194:37313 (local address 127.0.0.1:43548)
0808 14:34:03.590100 (+ 1625us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:03.590114 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:03.590229 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:03.590806 (+ 577us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:03.590809 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:03.590826 (+ 17us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:03.591373 (+ 547us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:34:03.591375 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:03.591399 (+ 24us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:34:03.591478 (+ 79us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:03.591799 (+ 321us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:03.591810 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:03.591817 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 14:34:03.591941 (+ 124us) client_negotiation.cc:240] Negotiation successful
0808 14:34:03.592020 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1566,"thread_start_us":134,"threads_started":1}
I20260808 14:34:03.592204 19706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:03.589599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43548 (local address 127.11.131.194:37313)
0808 14:34:03.590046 (+ 447us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:03.590059 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:03.590229 (+ 170us) server_negotiation.cc:407] Connection header received
0808 14:34:03.590370 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:03.590376 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:03.590552 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:03.590823 (+ 271us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:03.591601 (+ 778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:03.591607 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:03.591620 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:34:03.591631 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:03.591678 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:34:03.591698 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:03.591828 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:03.591955 (+ 127us) server_negotiation.cc:299] Negotiation successful
0808 14:34:03.592059 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":105,"threads_started":1}
I20260808 14:34:03.592468 19696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:03.588253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:38139 (local address 127.0.0.1:47366)
0808 14:34:03.588774 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:03.588823 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:03.589031 (+ 208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:03.590413 (+ 1382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:03.590420 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:03.590499 (+ 79us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:03.591380 (+ 881us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:34:03.591382 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:03.591400 (+ 18us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:34:03.591476 (+ 76us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:03.592203 (+ 727us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:03.592207 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:03.592212 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:34:03.592289 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 14:34:03.592326 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":105,"threads_started":1}
I20260808 14:34:03.592854 19700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:03.588477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47366 (local address 127.11.131.193:38139)
0808 14:34:03.589093 (+ 616us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:03.589108 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:03.589137 (+ 29us) server_negotiation.cc:407] Connection header received
0808 14:34:03.589202 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:03.589209 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:03.589438 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:03.589594 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:03.591637 (+ 2043us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:03.591644 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:03.591656 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:34:03.591669 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:03.591730 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:34:03.592043 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:03.592155 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:03.592565 (+ 410us) server_negotiation.cc:299] Negotiation successful
0808 14:34:03.592639 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":490,"thread_start_us":150,"threads_started":1}
I20260808 14:34:03.593539 19698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:03.589119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.195:46067 (local address 127.0.0.1:33156)
0808 14:34:03.590192 (+ 1073us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:03.590216 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:03.590303 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:03.591590 (+ 1287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:03.591594 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:03.591609 (+ 15us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:03.592885 (+ 1276us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:34:03.592887 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:03.592900 (+ 13us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:34:03.592930 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:03.593274 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:03.593278 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:03.593281 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:34:03.593387 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 14:34:03.593426 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1009,"thread_start_us":145,"threads_started":1}
I20260808 14:34:03.593958 19704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:03.589309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33156 (local address 127.11.131.195:46067)
0808 14:34:03.589871 (+ 562us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:03.589886 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:03.590408 (+ 522us) server_negotiation.cc:407] Connection header received
0808 14:34:03.590469 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:03.590473 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:03.590694 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:03.590838 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:03.593078 (+ 2240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:03.593084 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:03.593103 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:34:03.593114 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:03.593151 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:34:03.593177 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:03.593300 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:03.593759 (+ 459us) server_negotiation.cc:299] Negotiation successful
0808 14:34:03.593839 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":386,"thread_start_us":126,"threads_started":1}
I20260808 14:34:03.596328 19378 tablet_service.cc:1467] Processing CreateTablet for tablet 5048912d9b53400faf0254afd94eb365 (DEFAULT_TABLE table=test-table [id=e8c8184b83a745f0a4ae8b9b78a7efc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:34:03.596328 19190 tablet_service.cc:1467] Processing CreateTablet for tablet 5048912d9b53400faf0254afd94eb365 (DEFAULT_TABLE table=test-table [id=e8c8184b83a745f0a4ae8b9b78a7efc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:34:03.596587 19578 tablet_service.cc:1467] Processing CreateTablet for tablet 5048912d9b53400faf0254afd94eb365 (DEFAULT_TABLE table=test-table [id=e8c8184b83a745f0a4ae8b9b78a7efc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:34:03.597548 19578 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5048912d9b53400faf0254afd94eb365. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:34:03.597590 19378 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5048912d9b53400faf0254afd94eb365. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:34:03.597589 19190 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5048912d9b53400faf0254afd94eb365. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:34:03.604722 19707 tablet_bootstrap.cc:492] T 5048912d9b53400faf0254afd94eb365 P 43f83637b71d4846b952122c481c9ff9: Bootstrap starting.
I20260808 14:34:03.605401 19710 tablet_bootstrap.cc:492] T 5048912d9b53400faf0254afd94eb365 P 2a4ca70e154143c19475e20180a62ace: Bootstrap starting.
I20260808 14:34:03.606962 19709 tablet_bootstrap.cc:492] T 5048912d9b53400faf0254afd94eb365 P 2f6bfdac4d424c9d8aee730e637c54fb: Bootstrap starting.
I20260808 14:34:03.607290 19707 tablet_bootstrap.cc:654] T 5048912d9b53400faf0254afd94eb365 P 43f83637b71d4846b952122c481c9ff9: Neither blocks nor log segments found. Creating new log.
I20260808 14:34:03.607555 19710 tablet_bootstrap.cc:654] T 5048912d9b53400faf0254afd94eb365 P 2a4ca70e154143c19475e20180a62ace: Neither blocks nor log segments found. Creating new log.
I20260808 14:34:03.608258 19707 log.cc:824] T 5048912d9b53400faf0254afd94eb365 P 43f83637b71d4846b952122c481c9ff9: Log is configured to *not* fsync() on all Append() calls
I20260808 14:34:03.608294 19710 log.cc:824] T 5048912d9b53400faf0254afd94eb365 P 2a4ca70e154143c19475e20180a62ace: Log is configured to *not* fsync() on all Append() calls
I20260808 14:34:03.609081 19709 tablet_bootstrap.cc:654] T 5048912d9b53400faf0254afd94eb365 P 2f6bfdac4d424c9d8aee730e637c54fb: Neither blocks nor log segments found. Creating new log.
I20260808 14:34:03.610031 19709 log.cc:824] T 5048912d9b53400faf0254afd94eb365 P 2f6bfdac4d424c9d8aee730e637c54fb: Log is configured to *not* fsync() on all Append() calls
I20260808 14:34:03.610512 19707 tablet_bootstrap.cc:492] T 5048912d9b53400faf0254afd94eb365 P 43f83637b71d4846b952122c481c9ff9: No bootstrap required, opened a new log
I20260808 14:34:03.610709 19710 tablet_bootstrap.cc:492] T 5048912d9b53400faf0254afd94eb365 P 2a4ca70e154143c19475e20180a62ace: No bootstrap required, opened a new log
I20260808 14:34:03.610772 19707 ts_tablet_manager.cc:1397] T 5048912d9b53400faf0254afd94eb365 P 43f83637b71d4846b952122c481c9ff9: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260808 14:34:03.610945 19710 ts_tablet_manager.cc:1397] T 5048912d9b53400faf0254afd94eb365 P 2a4ca70e154143c19475e20180a62ace: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 14:34:03.612082 19709 tablet_bootstrap.cc:492] T 5048912d9b53400faf0254afd94eb365 P 2f6bfdac4d424c9d8aee730e637c54fb: No bootstrap required, opened a new log
I20260808 14:34:03.612268 19709 ts_tablet_manager.cc:1397] T 5048912d9b53400faf0254afd94eb365 P 2f6bfdac4d424c9d8aee730e637c54fb: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 14:34:03.614833 19710 raft_consensus.cc:348] T 5048912d9b53400faf0254afd94eb365 P 2a4ca70e154143c19475e20180a62ace [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6bfdac4d424c9d8aee730e637c54fb" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 38139 } } peers { permanent_uuid: "2a4ca70e154143c19475e20180a62ace" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 37313 } } peers { permanent_uuid: "43f83637b71d4846b952122c481c9ff9" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 46067 } }
I20260808 14:34:03.615114 19710 raft_consensus.cc:374] T 5048912d9b53400faf0254afd94eb365 P 2a4ca70e154143c19475e20180a62ace [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:34:03.615175 19710 raft_consensus.cc:729] T 5048912d9b53400faf0254afd94eb365 P 2a4ca70e154143c19475e20180a62ace [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4ca70e154143c19475e20180a62ace, State: Initialized, Role: FOLLOWER
I20260808 14:34:03.615449 19707 raft_consensus.cc:348] T 5048912d9b53400faf0254afd94eb365 P 43f83637b71d4846b952122c481c9ff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6bfdac4d424c9d8aee730e637c54fb" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 38139 } } peers { permanent_uuid: "2a4ca70e154143c19475e20180a62ace" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 37313 } } peers { permanent_uuid: "43f83637b71d4846b952122c481c9ff9" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 46067 } }
I20260808 14:34:03.615752 19707 raft_consensus.cc:374] T 5048912d9b53400faf0254afd94eb365 P 43f83637b71d4846b952122c481c9ff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:34:03.615811 19707 raft_consensus.cc:729] T 5048912d9b53400faf0254afd94eb365 P 43f83637b71d4846b952122c481c9ff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43f83637b71d4846b952122c481c9ff9, State: Initialized, Role: FOLLOWER
I20260808 14:34:03.615692 19710 consensus_queue.cc:260] T 5048912d9b53400faf0254afd94eb365 P 2a4ca70e154143c19475e20180a62ace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6bfdac4d424c9d8aee730e637c54fb" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 38139 } } peers { permanent_uuid: "2a4ca70e154143c19475e20180a62ace" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 37313 } } peers { permanent_uuid: "43f83637b71d4846b952122c481c9ff9" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 46067 } }
I20260808 14:34:03.616261 19707 consensus_queue.cc:260] T 5048912d9b53400faf0254afd94eb365 P 43f83637b71d4846b952122c481c9ff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6bfdac4d424c9d8aee730e637c54fb" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 38139 } } peers { permanent_uuid: "2a4ca70e154143c19475e20180a62ace" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 37313 } } peers { permanent_uuid: "43f83637b71d4846b952122c481c9ff9" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 46067 } }
I20260808 14:34:03.616500 19475 heartbeater.cc:503] Master 127.11.131.254:46521 was elected leader, sending a full tablet report...
I20260808 14:34:03.616906 19710 ts_tablet_manager.cc:1428] T 5048912d9b53400faf0254afd94eb365 P 2a4ca70e154143c19475e20180a62ace: Time spent starting tablet: real 0.006s user 0.002s sys 0.003s
I20260808 14:34:03.617304 19707 ts_tablet_manager.cc:1428] T 5048912d9b53400faf0254afd94eb365 P 43f83637b71d4846b952122c481c9ff9: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 14:34:03.617686 19677 heartbeater.cc:503] Master 127.11.131.254:46521 was elected leader, sending a full tablet report...
I20260808 14:34:03.617877 19709 raft_consensus.cc:348] T 5048912d9b53400faf0254afd94eb365 P 2f6bfdac4d424c9d8aee730e637c54fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6bfdac4d424c9d8aee730e637c54fb" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 38139 } } peers { permanent_uuid: "2a4ca70e154143c19475e20180a62ace" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 37313 } } peers { permanent_uuid: "43f83637b71d4846b952122c481c9ff9" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 46067 } }
I20260808 14:34:03.618834 19709 raft_consensus.cc:374] T 5048912d9b53400faf0254afd94eb365 P 2f6bfdac4d424c9d8aee730e637c54fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:34:03.618911 19709 raft_consensus.cc:729] T 5048912d9b53400faf0254afd94eb365 P 2f6bfdac4d424c9d8aee730e637c54fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f6bfdac4d424c9d8aee730e637c54fb, State: Initialized, Role: FOLLOWER
I20260808 14:34:03.619407 19709 consensus_queue.cc:260] T 5048912d9b53400faf0254afd94eb365 P 2f6bfdac4d424c9d8aee730e637c54fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6bfdac4d424c9d8aee730e637c54fb" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 38139 } } peers { permanent_uuid: "2a4ca70e154143c19475e20180a62ace" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 37313 } } peers { permanent_uuid: "43f83637b71d4846b952122c481c9ff9" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 46067 } }
I20260808 14:34:03.620131 19292 heartbeater.cc:503] Master 127.11.131.254:46521 was elected leader, sending a full tablet report...
I20260808 14:34:03.620553 19709 ts_tablet_manager.cc:1428] T 5048912d9b53400faf0254afd94eb365 P 2f6bfdac4d424c9d8aee730e637c54fb: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
W20260808 14:34:03.621762 19476 tablet.cc:2369] T 5048912d9b53400faf0254afd94eb365 P 2a4ca70e154143c19475e20180a62ace: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:34:03.686275 19293 tablet.cc:2369] T 5048912d9b53400faf0254afd94eb365 P 2f6bfdac4d424c9d8aee730e637c54fb: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:34:03.804689 19678 tablet.cc:2369] T 5048912d9b53400faf0254afd94eb365 P 43f83637b71d4846b952122c481c9ff9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:34:03.825059 19717 raft_consensus.cc:482] T 5048912d9b53400faf0254afd94eb365 P 2f6bfdac4d424c9d8aee730e637c54fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:34:03.825354 19717 raft_consensus.cc:504] T 5048912d9b53400faf0254afd94eb365 P 2f6bfdac4d424c9d8aee730e637c54fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6bfdac4d424c9d8aee730e637c54fb" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 38139 } } peers { permanent_uuid: "2a4ca70e154143c19475e20180a62ace" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 37313 } } peers { permanent_uuid: "43f83637b71d4846b952122c481c9ff9" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 46067 } }
I20260808 14:34:03.826659 19717 leader_election.cc:288] T 5048912d9b53400faf0254afd94eb365 P 2f6bfdac4d424c9d8aee730e637c54fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2a4ca70e154143c19475e20180a62ace (127.11.131.194:37313), 43f83637b71d4846b952122c481c9ff9 (127.11.131.195:46067)
I20260808 14:34:03.828900 19706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:03.827039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:47637 (local address 127.11.131.194:37313)
0808 14:34:03.827191 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:03.827195 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:03.827373 (+ 178us) server_negotiation.cc:407] Connection header received
0808 14:34:03.827509 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:03.827516 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:03.827567 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:03.827669 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:03.828498 (+ 829us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:03.828501 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:03.828503 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:34:03.828515 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:03.828533 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:34:03.828542 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:03.828641 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:03.828729 (+ 88us) server_negotiation.cc:299] Negotiation successful
0808 14:34:03.828771 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 14:34:03.828934 19721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:03.826956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.194:37313 (local address 127.11.131.193:47637)
0808 14:34:03.827256 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:03.827274 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:03.827394 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:03.827714 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:03.827718 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:03.827738 (+ 20us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:03.828317 (+ 579us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:34:03.828319 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:03.828332 (+ 13us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:34:03.828358 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:03.828625 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:03.828628 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:03.828631 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 14:34:03.828720 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 14:34:03.828764 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":129,"threads_started":1}
I20260808 14:34:03.829088 19704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:03.827627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:36027 (local address 127.11.131.195:46067)
0808 14:34:03.827814 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:03.827819 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:03.827855 (+ 36us) server_negotiation.cc:407] Connection header received
0808 14:34:03.827913 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:03.827917 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:03.827961 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:03.828029 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:03.828694 (+ 665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:03.828698 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:03.828700 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:34:03.828713 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:03.828739 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:34:03.828747 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:03.828847 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:03.828931 (+ 84us) server_negotiation.cc:299] Negotiation successful
0808 14:34:03.828970 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 14:34:03.829104 19723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:03.827394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.195:46067 (local address 127.11.131.193:36027)
0808 14:34:03.827696 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:03.827711 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:03.827794 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:03.828074 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:03.828078 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:03.828094 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:03.828512 (+ 418us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:34:03.828514 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:03.828525 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:34:03.828561 (+ 36us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:03.828831 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:03.828834 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:03.828836 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 14:34:03.828912 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 14:34:03.828952 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":78,"threads_started":1}
I20260808 14:34:03.829641 19410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5048912d9b53400faf0254afd94eb365" candidate_uuid: "2f6bfdac4d424c9d8aee730e637c54fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ca70e154143c19475e20180a62ace" is_pre_election: true
I20260808 14:34:03.829870 19613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5048912d9b53400faf0254afd94eb365" candidate_uuid: "2f6bfdac4d424c9d8aee730e637c54fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43f83637b71d4846b952122c481c9ff9" is_pre_election: true
I20260808 14:34:03.830054 19410 raft_consensus.cc:2454] T 5048912d9b53400faf0254afd94eb365 P 2a4ca70e154143c19475e20180a62ace [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6bfdac4d424c9d8aee730e637c54fb in term 0.
I20260808 14:34:03.830137 19613 raft_consensus.cc:2454] T 5048912d9b53400faf0254afd94eb365 P 43f83637b71d4846b952122c481c9ff9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f6bfdac4d424c9d8aee730e637c54fb in term 0.
I20260808 14:34:03.830636 19124 leader_election.cc:302] T 5048912d9b53400faf0254afd94eb365 P 2f6bfdac4d424c9d8aee730e637c54fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a4ca70e154143c19475e20180a62ace, 2f6bfdac4d424c9d8aee730e637c54fb; no voters:
I20260808 14:34:03.830988 19717 raft_consensus.cc:2781] T 5048912d9b53400faf0254afd94eb365 P 2f6bfdac4d424c9d8aee730e637c54fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:34:03.831089 19717 raft_consensus.cc:482] T 5048912d9b53400faf0254afd94eb365 P 2f6bfdac4d424c9d8aee730e637c54fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:34:03.831142 19717 raft_consensus.cc:3037] T 5048912d9b53400faf0254afd94eb365 P 2f6bfdac4d424c9d8aee730e637c54fb [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:34:03.832267 19717 raft_consensus.cc:504] T 5048912d9b53400faf0254afd94eb365 P 2f6bfdac4d424c9d8aee730e637c54fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6bfdac4d424c9d8aee730e637c54fb" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 38139 } } peers { permanent_uuid: "2a4ca70e154143c19475e20180a62ace" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 37313 } } peers { permanent_uuid: "43f83637b71d4846b952122c481c9ff9" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 46067 } }
I20260808 14:34:03.832628 19717 leader_election.cc:288] T 5048912d9b53400faf0254afd94eb365 P 2f6bfdac4d424c9d8aee730e637c54fb [CANDIDATE]: Term 1 election: Requested vote from peers 2a4ca70e154143c19475e20180a62ace (127.11.131.194:37313), 43f83637b71d4846b952122c481c9ff9 (127.11.131.195:46067)
I20260808 14:34:03.833074 19410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5048912d9b53400faf0254afd94eb365" candidate_uuid: "2f6bfdac4d424c9d8aee730e637c54fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a4ca70e154143c19475e20180a62ace"
I20260808 14:34:03.833091 19613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5048912d9b53400faf0254afd94eb365" candidate_uuid: "2f6bfdac4d424c9d8aee730e637c54fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43f83637b71d4846b952122c481c9ff9"
I20260808 14:34:03.833215 19410 raft_consensus.cc:3037] T 5048912d9b53400faf0254afd94eb365 P 2a4ca70e154143c19475e20180a62ace [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:34:03.833215 19613 raft_consensus.cc:3037] T 5048912d9b53400faf0254afd94eb365 P 43f83637b71d4846b952122c481c9ff9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:34:03.834561 19613 raft_consensus.cc:2454] T 5048912d9b53400faf0254afd94eb365 P 43f83637b71d4846b952122c481c9ff9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6bfdac4d424c9d8aee730e637c54fb in term 1.
I20260808 14:34:03.834561 19410 raft_consensus.cc:2454] T 5048912d9b53400faf0254afd94eb365 P 2a4ca70e154143c19475e20180a62ace [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f6bfdac4d424c9d8aee730e637c54fb in term 1.
I20260808 14:34:03.834885 19124 leader_election.cc:302] T 5048912d9b53400faf0254afd94eb365 P 2f6bfdac4d424c9d8aee730e637c54fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f6bfdac4d424c9d8aee730e637c54fb, 43f83637b71d4846b952122c481c9ff9; no voters:
I20260808 14:34:03.835058 19717 raft_consensus.cc:2781] T 5048912d9b53400faf0254afd94eb365 P 2f6bfdac4d424c9d8aee730e637c54fb [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:34:03.835280 19717 raft_consensus.cc:686] T 5048912d9b53400faf0254afd94eb365 P 2f6bfdac4d424c9d8aee730e637c54fb [term 1 LEADER]: Becoming Leader. State: Replica: 2f6bfdac4d424c9d8aee730e637c54fb, State: Running, Role: LEADER
I20260808 14:34:03.835646 19717 consensus_queue.cc:237] T 5048912d9b53400faf0254afd94eb365 P 2f6bfdac4d424c9d8aee730e637c54fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6bfdac4d424c9d8aee730e637c54fb" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 38139 } } peers { permanent_uuid: "2a4ca70e154143c19475e20180a62ace" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 37313 } } peers { permanent_uuid: "43f83637b71d4846b952122c481c9ff9" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 46067 } }
I20260808 14:34:03.839025 19003 catalog_manager.cc:5495] T 5048912d9b53400faf0254afd94eb365 P 2f6bfdac4d424c9d8aee730e637c54fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f6bfdac4d424c9d8aee730e637c54fb (127.11.131.193). New cstate: current_term: 1 leader_uuid: "2f6bfdac4d424c9d8aee730e637c54fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2f6bfdac4d424c9d8aee730e637c54fb" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 38139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a4ca70e154143c19475e20180a62ace" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 37313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43f83637b71d4846b952122c481c9ff9" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 46067 } health_report { overall_health: UNKNOWN } } }
I20260808 14:34:03.885007 19700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:03.883377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47382 (local address 127.11.131.193:38139)
0808 14:34:03.883537 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:03.883544 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:03.883562 (+ 18us) server_negotiation.cc:407] Connection header received
0808 14:34:03.883762 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:03.883766 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:03.883845 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:03.883941 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:03.884587 (+ 646us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:03.884591 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:03.884593 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:34:03.884605 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:03.884631 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:34:03.884639 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:03.884736 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:03.884805 (+ 69us) server_negotiation.cc:299] Negotiation successful
0808 14:34:03.884855 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 14:34:03.891629 19613 raft_consensus.cc:1261] T 5048912d9b53400faf0254afd94eb365 P 43f83637b71d4846b952122c481c9ff9 [term 1 FOLLOWER]: Refusing update from remote peer 2f6bfdac4d424c9d8aee730e637c54fb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:34:03.891629 19410 raft_consensus.cc:1261] T 5048912d9b53400faf0254afd94eb365 P 2a4ca70e154143c19475e20180a62ace [term 1 FOLLOWER]: Refusing update from remote peer 2f6bfdac4d424c9d8aee730e637c54fb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:34:03.892441 19717 consensus_queue.cc:1035] T 5048912d9b53400faf0254afd94eb365 P 2f6bfdac4d424c9d8aee730e637c54fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "43f83637b71d4846b952122c481c9ff9" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 46067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:34:03.892720 19724 consensus_queue.cc:1035] T 5048912d9b53400faf0254afd94eb365 P 2f6bfdac4d424c9d8aee730e637c54fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a4ca70e154143c19475e20180a62ace" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 37313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:34:03.904476 19731 mvcc.cc:205] Tried to move back new op lower bound from 7316273741371781120 to 7316273741153579008. Current Snapshot: MvccSnapshot[applied={T|T < 7316273741371781120 or (T in {7316273741371781120})}]
I20260808 14:34:03.911957 19003 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:54192:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:34:03.912148 19003 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:54192:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:34:03.914669 19003 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 43212106981e455faf3a0195a802d1be: Sending DeleteTablet for 3 replicas of tablet 5048912d9b53400faf0254afd94eb365
I20260808 14:34:03.915684 19190 tablet_service.cc:1514] Processing DeleteTablet for tablet 5048912d9b53400faf0254afd94eb365 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:34:03 UTC) from {username='slave'} at 127.0.0.1:47366
I20260808 14:34:03.915773 19578 tablet_service.cc:1514] Processing DeleteTablet for tablet 5048912d9b53400faf0254afd94eb365 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:34:03 UTC) from {username='slave'} at 127.0.0.1:33156
I20260808 14:34:03.916288 19378 tablet_service.cc:1514] Processing DeleteTablet for tablet 5048912d9b53400faf0254afd94eb365 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:34:03 UTC) from {username='slave'} at 127.0.0.1:43548
I20260808 14:34:03.916852 19743 tablet_replica.cc:330] T 5048912d9b53400faf0254afd94eb365 P 43f83637b71d4846b952122c481c9ff9: stopping tablet replica
I20260808 14:34:03.916978 19742 tablet_replica.cc:330] T 5048912d9b53400faf0254afd94eb365 P 2f6bfdac4d424c9d8aee730e637c54fb: stopping tablet replica
I20260808 14:34:03.917213 19742 raft_consensus.cc:2229] T 5048912d9b53400faf0254afd94eb365 P 2f6bfdac4d424c9d8aee730e637c54fb [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:34:03.917215 19743 raft_consensus.cc:2229] T 5048912d9b53400faf0254afd94eb365 P 43f83637b71d4846b952122c481c9ff9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:34:03.917258 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 19100
I20260808 14:34:03.917541 19743 raft_consensus.cc:2258] T 5048912d9b53400faf0254afd94eb365 P 43f83637b71d4846b952122c481c9ff9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:34:03.918030 19744 tablet_replica.cc:330] T 5048912d9b53400faf0254afd94eb365 P 2a4ca70e154143c19475e20180a62ace: stopping tablet replica
I20260808 14:34:03.918301 19744 raft_consensus.cc:2229] T 5048912d9b53400faf0254afd94eb365 P 2a4ca70e154143c19475e20180a62ace [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:34:03.918543 19744 raft_consensus.cc:2258] T 5048912d9b53400faf0254afd94eb365 P 2a4ca70e154143c19475e20180a62ace [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:34:03.923204 19743 ts_tablet_manager.cc:1905] T 5048912d9b53400faf0254afd94eb365 P 43f83637b71d4846b952122c481c9ff9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:34:03.927901 19743 ts_tablet_manager.cc:1918] T 5048912d9b53400faf0254afd94eb365 P 43f83637b71d4846b952122c481c9ff9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:34:03.928059 19743 log.cc:1196] T 5048912d9b53400faf0254afd94eb365 P 43f83637b71d4846b952122c481c9ff9: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/ts-2/wal/wals/5048912d9b53400faf0254afd94eb365
I20260808 14:34:03.928515 19743 ts_tablet_manager.cc:1939] T 5048912d9b53400faf0254afd94eb365 P 43f83637b71d4846b952122c481c9ff9: Deleting consensus metadata
I20260808 14:34:03.930357 18984 catalog_manager.cc:4841] TS 43f83637b71d4846b952122c481c9ff9 (127.11.131.195:46067): tablet 5048912d9b53400faf0254afd94eb365 (table test-table [id=e8c8184b83a745f0a4ae8b9b78a7efc3]) successfully deleted
I20260808 14:34:03.933339 19744 ts_tablet_manager.cc:1905] T 5048912d9b53400faf0254afd94eb365 P 2a4ca70e154143c19475e20180a62ace: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:34:03.937135 19744 ts_tablet_manager.cc:1918] T 5048912d9b53400faf0254afd94eb365 P 2a4ca70e154143c19475e20180a62ace: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:34:03.937291 19744 log.cc:1196] T 5048912d9b53400faf0254afd94eb365 P 2a4ca70e154143c19475e20180a62ace: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786199615258783-11791-0/minicluster-data/ts-1/wal/wals/5048912d9b53400faf0254afd94eb365
I20260808 14:34:03.937695 19744 ts_tablet_manager.cc:1939] T 5048912d9b53400faf0254afd94eb365 P 2a4ca70e154143c19475e20180a62ace: Deleting consensus metadata
I20260808 14:34:03.939334 18984 catalog_manager.cc:4841] TS 2a4ca70e154143c19475e20180a62ace (127.11.131.194:37313): tablet 5048912d9b53400faf0254afd94eb365 (table test-table [id=e8c8184b83a745f0a4ae8b9b78a7efc3]) successfully deleted
W20260808 14:34:03.940845 18983 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.131.193:38139 (error 108)
I20260808 14:34:03.940910 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 19295
I20260808 14:34:03.952337 19698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:03.945900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:38139 (local address 127.0.0.1:47386)
0808 14:34:03.952082 (+ 6182us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:03.952208 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.193:38139: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":6025}
W20260808 14:34:03.952633 18983 catalog_manager.cc:4584] TS 2f6bfdac4d424c9d8aee730e637c54fb (127.11.131.193:38139): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 5048912d9b53400faf0254afd94eb365: Network error: Client connection negotiation failed: client connection to 127.11.131.193:38139: connect: Connection refused (error 111)
I20260808 14:34:03.961199 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 19480
I20260808 14:34:03.976951 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 18962
2026-08-08T14:34:03Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (1250 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260808 14:34:04.008536 11791 mini_oidc.cc:152] Starting JWKS server
I20260808 14:34:04.010341 11791 webserver.cc:460] Webserver started at https://127.0.0.1:41863/ using document root <none> and password file <none>
I20260808 14:34:04.010527 11791 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 14:34:04.010911 11791 webserver.cc:460] Webserver started at http://127.0.0.1:41997/ using document root <none> and password file <none>
2026-08-08T14:34:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:34:04Z Disabled control of system clock
I20260808 14:34:04.022679 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:45261
--webserver_interface=127.11.131.254
--webserver_port=0
--builtin_ntp_servers=127.11.131.212:39145
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:45261
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41863/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786199615258783-11791-0/testchainca.cert with env {}
W20260808 14:34:04.141361 19757 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:34:04.141664 19757 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:34:04.141705 19757 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:34:04.145745 19757 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:34:04.145815 19757 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:34:04.145831 19757 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:34:04.145848 19757 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:34:04.145864 19757 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 14:34:04.145880 19757 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 14:34:04.145895 19757 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:41863/jwks.json
I20260808 14:34:04.151628 19757 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:39145
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786199615258783-11791-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:45261
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:45261
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41863/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.131.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786199615258783-11791-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19757
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:34:04.152803 19757 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:34:04.153846 19757 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:34:04.162708 19764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:04.162758 19757 server_base.cc:1034] running on GCE node
W20260808 14:34:04.162735 19766 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:04.162708 19768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:04.163532 19757 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:34:04.164680 19757 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:34:04.165876 19757 hybrid_clock.cc:648] HybridClock initialized: now 1786199644165862 us; error 27 us; skew 500 ppm
I20260808 14:34:04.167925 19757 webserver.cc:460] Webserver started at http://127.11.131.254:34025/ using document root <none> and password file <none>
I20260808 14:34:04.168569 19757 fs_manager.cc:359] Metadata directory not provided
I20260808 14:34:04.168669 19757 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:34:04.168934 19757 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:34:04.171180 19757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786199615258783-11791-0/minicluster-data/master-0/data/instance:
uuid: "8adc5a780b154aeda842e541998b8652"
format_stamp: "Formatted at 2026-08-08 14:34:04 on dist-test-slave-twwt"
server_key: "f6901f9cf26481277410429be5f5012a"
server_key_iv: "83b414591f59f51cf7667c5c82eac236"
server_key_version: "encryptionkey@0"
I20260808 14:34:04.171803 19757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786199615258783-11791-0/minicluster-data/master-0/wal/instance:
uuid: "8adc5a780b154aeda842e541998b8652"
format_stamp: "Formatted at 2026-08-08 14:34:04 on dist-test-slave-twwt"
server_key: "f6901f9cf26481277410429be5f5012a"
server_key_iv: "83b414591f59f51cf7667c5c82eac236"
server_key_version: "encryptionkey@0"
I20260808 14:34:04.175678 19757 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 14:34:04.178224 19776 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:04.179632 19757 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 14:34:04.179785 19757 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "8adc5a780b154aeda842e541998b8652"
format_stamp: "Formatted at 2026-08-08 14:34:04 on dist-test-slave-twwt"
server_key: "f6901f9cf26481277410429be5f5012a"
server_key_iv: "83b414591f59f51cf7667c5c82eac236"
server_key_version: "encryptionkey@0"
I20260808 14:34:04.179910 19757 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:34:04.195569 19757 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:34:04.196332 19757 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:34:04.196550 19757 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:34:04.203878 19757 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.254:45261
I20260808 14:34:04.203890 19865 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.254:45261 every 8 connection(s)
I20260808 14:34:04.204886 19757 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:34:04.208259 19866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:34:04.209686 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 19757
I20260808 14:34:04.209841 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786199615258783-11791-0/minicluster-data/master-0/wal/instance
I20260808 14:34:04.210141 11791 external_mini_cluster.cc:1428] Setting key dcba35b6d84eab0d5e3a68b1cfdf2b00
I20260808 14:34:04.214923 19866 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8adc5a780b154aeda842e541998b8652: Bootstrap starting.
I20260808 14:34:04.217439 19866 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8adc5a780b154aeda842e541998b8652: Neither blocks nor log segments found. Creating new log.
I20260808 14:34:04.218482 19866 log.cc:824] T 00000000000000000000000000000000 P 8adc5a780b154aeda842e541998b8652: Log is configured to *not* fsync() on all Append() calls
I20260808 14:34:04.220130 19871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:04.211736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36484 (local address 127.11.131.254:45261)
0808 14:34:04.212474 (+ 738us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:04.212491 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:04.212529 (+ 38us) server_negotiation.cc:407] Connection header received
0808 14:34:04.213222 (+ 693us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:04.213241 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:04.213653 (+ 412us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:04.214008 (+ 355us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:04.214451 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:04.215542 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:04.216454 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:04.216942 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:04.217120 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:04.218093 (+ 973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:04.218100 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:04.218117 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:34:04.218756 (+ 639us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:04.218820 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:34:04.218843 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:04.218960 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:04.219092 (+ 132us) server_negotiation.cc:299] Negotiation successful
0808 14:34:04.219384 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":148,"threads_started":1}
I20260808 14:34:04.220588 19866 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8adc5a780b154aeda842e541998b8652: No bootstrap required, opened a new log
I20260808 14:34:04.223234 11791 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:34:04.225185 19866 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8adc5a780b154aeda842e541998b8652 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8adc5a780b154aeda842e541998b8652" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 45261 } }
I20260808 14:34:04.225440 19866 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8adc5a780b154aeda842e541998b8652 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:34:04.225521 19866 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8adc5a780b154aeda842e541998b8652 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8adc5a780b154aeda842e541998b8652, State: Initialized, Role: FOLLOWER
I20260808 14:34:04.225957 19866 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8adc5a780b154aeda842e541998b8652 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8adc5a780b154aeda842e541998b8652" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 45261 } }
I20260808 14:34:04.226111 19866 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8adc5a780b154aeda842e541998b8652 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:34:04.226202 19866 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8adc5a780b154aeda842e541998b8652 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:34:04.226302 19866 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8adc5a780b154aeda842e541998b8652 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:34:04.227361 19866 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8adc5a780b154aeda842e541998b8652 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8adc5a780b154aeda842e541998b8652" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 45261 } }
I20260808 14:34:04.227701 19866 leader_election.cc:302] T 00000000000000000000000000000000 P 8adc5a780b154aeda842e541998b8652 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8adc5a780b154aeda842e541998b8652; no voters:
I20260808 14:34:04.228025 19866 leader_election.cc:288] T 00000000000000000000000000000000 P 8adc5a780b154aeda842e541998b8652 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:34:04.228181 19873 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8adc5a780b154aeda842e541998b8652 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:34:04.228431 19873 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8adc5a780b154aeda842e541998b8652 [term 1 LEADER]: Becoming Leader. State: Replica: 8adc5a780b154aeda842e541998b8652, State: Running, Role: LEADER
I20260808 14:34:04.228754 19873 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8adc5a780b154aeda842e541998b8652 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8adc5a780b154aeda842e541998b8652" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 45261 } }
I20260808 14:34:04.229367 19866 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8adc5a780b154aeda842e541998b8652 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:34:04.230459 19875 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8adc5a780b154aeda842e541998b8652 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8adc5a780b154aeda842e541998b8652. Latest consensus state: current_term: 1 leader_uuid: "8adc5a780b154aeda842e541998b8652" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8adc5a780b154aeda842e541998b8652" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 45261 } } }
I20260808 14:34:04.230635 19875 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8adc5a780b154aeda842e541998b8652 [sys.catalog]: This master's current role is: LEADER
I20260808 14:34:04.230942 19874 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8adc5a780b154aeda842e541998b8652 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8adc5a780b154aeda842e541998b8652" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8adc5a780b154aeda842e541998b8652" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 45261 } } }
I20260808 14:34:04.231040 19874 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8adc5a780b154aeda842e541998b8652 [sys.catalog]: This master's current role is: LEADER
I20260808 14:34:04.231146 19885 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:34:04.233907 19885 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:34:04.239734 19885 catalog_manager.cc:1347] Generated new cluster ID: 050653f9d5534b1ca83050fce580991e
I20260808 14:34:04.239809 19885 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:34:04.248059 19885 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:34:04.249334 19885 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:34:04.253767 19885 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8adc5a780b154aeda842e541998b8652: Generated new TSK 0
I20260808 14:34:04.254498 19885 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 14:34:04.297623 19911 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260808 14:34:04.297796 19911 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 14:34:04.298297 19871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:04.273330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36498 (local address 127.11.131.254:45261)
0808 14:34:04.273491 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:04.273495 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:04.273653 (+ 158us) server_negotiation.cc:407] Connection header received
0808 14:34:04.273886 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:04.273889 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:04.273952 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:04.274043 (+ 91us) server_negotiation.cc:226] Negotiated authn=JWT
0808 14:34:04.274352 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:04.274976 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:04.276234 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:04.276455 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:04.276526 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:04.276948 (+ 422us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 14:34:04.297784 (+ 20836us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41863/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 14:34:04.298165 (+ 381us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:36498: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41863/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":74}
W20260808 14:34:04.298385 19871 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:36498: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41863/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260808 14:34:04.299935 19910 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:04.273154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45261 (local address 127.0.0.1:36498)
0808 14:34:04.273552 (+ 398us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:04.273569 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:04.273716 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:04.274090 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:04.274093 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:04.274102 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0808 14:34:04.274243 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:04.274249 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:04.275094 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:04.275099 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:04.276109 (+ 1010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:04.276119 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:04.276573 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:04.276577 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:04.276677 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:04.276737 (+ 60us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 14:34:04.298135 (+ 21398us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41863/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 14:34:04.298415 (+ 280us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.131.254:45261: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41863/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":117,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.11.131.254:45261: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41863/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260808 14:34:04.300861 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 19757
2026-08-08T14:34:04Z chronyd exiting
I20260808 14:34:04.356166 11791 test_util.cc:175] -----------------------------------------------
I20260808 14:34:04.356261 11791 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786199615258783-11791-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (349 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260808 14:34:04.357296 11791 mini_oidc.cc:152] Starting JWKS server
I20260808 14:34:04.358141 11791 webserver.cc:460] Webserver started at https://127.0.0.1:40325/ using document root <none> and password file <none>
I20260808 14:34:04.358222 11791 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 14:34:04.358480 11791 webserver.cc:460] Webserver started at http://127.0.0.1:46737/ using document root <none> and password file <none>
2026-08-08T14:34:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:34:04Z Disabled control of system clock
I20260808 14:34:04.369194 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:46685
--webserver_interface=127.11.131.254
--webserver_port=0
--builtin_ntp_servers=127.11.131.212:41539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:46685
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40325/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786199615258783-11791-0/testchainca.cert with env {}
W20260808 14:34:04.487211 19923 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:34:04.487501 19923 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:34:04.487548 19923 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:34:04.491880 19923 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:34:04.491945 19923 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:34:04.491961 19923 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:34:04.491978 19923 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:34:04.491994 19923 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 14:34:04.492010 19923 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 14:34:04.492023 19923 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:40325/jwks.json
I20260808 14:34:04.497601 19923 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:41539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786199615258783-11791-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:46685
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:46685
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40325/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.131.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786199615258783-11791-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19923
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:34:04.498723 19923 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:34:04.499747 19923 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:34:04.508641 19936 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:04.508791 19923 server_base.cc:1034] running on GCE node
W20260808 14:34:04.508641 19940 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:04.508641 19937 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:04.509563 19923 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:34:04.510775 19923 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:34:04.511977 19923 hybrid_clock.cc:648] HybridClock initialized: now 1786199644511964 us; error 27 us; skew 500 ppm
I20260808 14:34:04.513960 19923 webserver.cc:460] Webserver started at http://127.11.131.254:46121/ using document root <none> and password file <none>
I20260808 14:34:04.514569 19923 fs_manager.cc:359] Metadata directory not provided
I20260808 14:34:04.514696 19923 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:34:04.514941 19923 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:34:04.517014 19923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786199615258783-11791-0/minicluster-data/master-0/data/instance:
uuid: "87b1aa886695473e9693b226c4eecd52"
format_stamp: "Formatted at 2026-08-08 14:34:04 on dist-test-slave-twwt"
server_key: "c9ae61d99a7b3806137d8fb31eaabe44"
server_key_iv: "3977597a543fad951fe97edc8f3d39bc"
server_key_version: "encryptionkey@0"
I20260808 14:34:04.517555 19923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786199615258783-11791-0/minicluster-data/master-0/wal/instance:
uuid: "87b1aa886695473e9693b226c4eecd52"
format_stamp: "Formatted at 2026-08-08 14:34:04 on dist-test-slave-twwt"
server_key: "c9ae61d99a7b3806137d8fb31eaabe44"
server_key_iv: "3977597a543fad951fe97edc8f3d39bc"
server_key_version: "encryptionkey@0"
I20260808 14:34:04.521307 19923 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 14:34:04.523824 19955 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:04.525192 19923 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 14:34:04.525336 19923 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "87b1aa886695473e9693b226c4eecd52"
format_stamp: "Formatted at 2026-08-08 14:34:04 on dist-test-slave-twwt"
server_key: "c9ae61d99a7b3806137d8fb31eaabe44"
server_key_iv: "3977597a543fad951fe97edc8f3d39bc"
server_key_version: "encryptionkey@0"
I20260808 14:34:04.525456 19923 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:34:04.539871 19923 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:34:04.540603 19923 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:34:04.540804 19923 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:34:04.548039 19923 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.254:46685
I20260808 14:34:04.548058 20024 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.254:46685 every 8 connection(s)
I20260808 14:34:04.549263 19923 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:34:04.552934 20025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:34:04.555593 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 19923
I20260808 14:34:04.555747 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786199615258783-11791-0/minicluster-data/master-0/wal/instance
I20260808 14:34:04.556047 11791 external_mini_cluster.cc:1428] Setting key e3844bf3b051122c3957a5993480946e
I20260808 14:34:04.559751 20025 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87b1aa886695473e9693b226c4eecd52: Bootstrap starting.
I20260808 14:34:04.562168 20025 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 87b1aa886695473e9693b226c4eecd52: Neither blocks nor log segments found. Creating new log.
I20260808 14:34:04.563130 20025 log.cc:824] T 00000000000000000000000000000000 P 87b1aa886695473e9693b226c4eecd52: Log is configured to *not* fsync() on all Append() calls
I20260808 14:34:04.565546 20025 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 87b1aa886695473e9693b226c4eecd52: No bootstrap required, opened a new log
I20260808 14:34:04.566275 20030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:04.557549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43060 (local address 127.11.131.254:46685)
0808 14:34:04.558372 (+ 823us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:04.558392 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:04.558434 (+ 42us) server_negotiation.cc:407] Connection header received
0808 14:34:04.559164 (+ 730us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:04.559209 (+ 45us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:04.559677 (+ 468us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:04.560098 (+ 421us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:04.560586 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:04.561596 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:04.562583 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:04.563135 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:04.563355 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:04.564322 (+ 967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:04.564327 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:04.564342 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:34:04.564779 (+ 437us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:04.564844 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:34:04.564871 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:04.564991 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:04.565151 (+ 160us) server_negotiation.cc:299] Negotiation successful
0808 14:34:04.565437 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":354,"thread_start_us":164,"threads_started":1}
I20260808 14:34:04.569442 11791 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:34:04.569921 20025 raft_consensus.cc:348] T 00000000000000000000000000000000 P 87b1aa886695473e9693b226c4eecd52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87b1aa886695473e9693b226c4eecd52" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46685 } }
I20260808 14:34:04.570199 20025 raft_consensus.cc:374] T 00000000000000000000000000000000 P 87b1aa886695473e9693b226c4eecd52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:34:04.570278 20025 raft_consensus.cc:729] T 00000000000000000000000000000000 P 87b1aa886695473e9693b226c4eecd52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b1aa886695473e9693b226c4eecd52, State: Initialized, Role: FOLLOWER
I20260808 14:34:04.570824 20025 consensus_queue.cc:260] T 00000000000000000000000000000000 P 87b1aa886695473e9693b226c4eecd52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87b1aa886695473e9693b226c4eecd52" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46685 } }
I20260808 14:34:04.570996 20025 raft_consensus.cc:388] T 00000000000000000000000000000000 P 87b1aa886695473e9693b226c4eecd52 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:34:04.571087 20025 raft_consensus.cc:482] T 00000000000000000000000000000000 P 87b1aa886695473e9693b226c4eecd52 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:34:04.571204 20025 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 87b1aa886695473e9693b226c4eecd52 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:34:04.572324 20025 raft_consensus.cc:504] T 00000000000000000000000000000000 P 87b1aa886695473e9693b226c4eecd52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87b1aa886695473e9693b226c4eecd52" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46685 } }
I20260808 14:34:04.572719 20025 leader_election.cc:302] T 00000000000000000000000000000000 P 87b1aa886695473e9693b226c4eecd52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 87b1aa886695473e9693b226c4eecd52; no voters:
I20260808 14:34:04.573112 20025 leader_election.cc:288] T 00000000000000000000000000000000 P 87b1aa886695473e9693b226c4eecd52 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:34:04.573251 20032 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 87b1aa886695473e9693b226c4eecd52 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:34:04.573518 20032 raft_consensus.cc:686] T 00000000000000000000000000000000 P 87b1aa886695473e9693b226c4eecd52 [term 1 LEADER]: Becoming Leader. State: Replica: 87b1aa886695473e9693b226c4eecd52, State: Running, Role: LEADER
I20260808 14:34:04.573874 20032 consensus_queue.cc:237] T 00000000000000000000000000000000 P 87b1aa886695473e9693b226c4eecd52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87b1aa886695473e9693b226c4eecd52" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46685 } }
I20260808 14:34:04.574502 20025 sys_catalog.cc:564] T 00000000000000000000000000000000 P 87b1aa886695473e9693b226c4eecd52 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:34:04.575820 20035 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87b1aa886695473e9693b226c4eecd52 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 87b1aa886695473e9693b226c4eecd52. Latest consensus state: current_term: 1 leader_uuid: "87b1aa886695473e9693b226c4eecd52" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87b1aa886695473e9693b226c4eecd52" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46685 } } }
I20260808 14:34:04.575955 20035 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87b1aa886695473e9693b226c4eecd52 [sys.catalog]: This master's current role is: LEADER
I20260808 14:34:04.576377 20051 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:34:04.576345 20033 sys_catalog.cc:455] T 00000000000000000000000000000000 P 87b1aa886695473e9693b226c4eecd52 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "87b1aa886695473e9693b226c4eecd52" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "87b1aa886695473e9693b226c4eecd52" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46685 } } }
I20260808 14:34:04.577059 20033 sys_catalog.cc:458] T 00000000000000000000000000000000 P 87b1aa886695473e9693b226c4eecd52 [sys.catalog]: This master's current role is: LEADER
I20260808 14:34:04.579846 20051 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:34:04.586226 20051 catalog_manager.cc:1347] Generated new cluster ID: d02f1a7c2f9a4e1b8b67a005c296e4c1
I20260808 14:34:04.586320 20051 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:34:04.612100 20051 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:34:04.613161 20051 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:34:04.619540 20051 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 87b1aa886695473e9693b226c4eecd52: Generated new TSK 0
I20260808 14:34:04.620353 20051 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 14:34:04.650322 20074 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260808 14:34:04.650449 20074 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 14:34:04.651297 20030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:04.634918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43068 (local address 127.11.131.254:46685)
0808 14:34:04.635074 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:04.635079 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:04.635282 (+ 203us) server_negotiation.cc:407] Connection header received
0808 14:34:04.635436 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:04.635440 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:04.635502 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:04.635631 (+ 129us) server_negotiation.cc:226] Negotiated authn=JWT
0808 14:34:04.635865 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:04.636726 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:04.637606 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:04.637963 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:04.638066 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:04.638399 (+ 333us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 14:34:04.650793 (+ 12394us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40325/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 14:34:04.651129 (+ 336us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:43068: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40325/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":60}
W20260808 14:34:04.651383 20030 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:43068: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40325/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260808 14:34:04.651539 20073 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:04.634819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:46685 (local address 127.0.0.1:43068)
0808 14:34:04.635186 (+ 367us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:04.635200 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:04.635311 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:04.635635 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:04.635637 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:04.635643 (+ 6us) client_negotiation.cc:189] Negotiated authn=JWT
0808 14:34:04.635755 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:04.635760 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:04.636838 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:04.636840 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:04.637491 (+ 651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:04.637499 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:04.638091 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:04.638095 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:04.638171 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:04.638196 (+ 25us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 14:34:04.651035 (+ 12839us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40325/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 14:34:04.651305 (+ 270us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.131.254:46685: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40325/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":144,"threads_started":1}
I20260808 14:34:04.652367 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 19923
2026-08-08T14:34:04Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (343 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260808 14:34:04.700384 11791 mini_oidc.cc:152] Starting JWKS server
I20260808 14:34:04.701223 11791 webserver.cc:460] Webserver started at https://127.0.0.1:35825/ using document root <none> and password file <none>
I20260808 14:34:04.701304 11791 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 14:34:04.701524 11791 webserver.cc:460] Webserver started at http://127.0.0.1:43811/ using document root <none> and password file <none>
2026-08-08T14:34:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:34:04Z Disabled control of system clock
I20260808 14:34:04.712090 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:45821
--webserver_interface=127.11.131.254
--webserver_port=0
--builtin_ntp_servers=127.11.131.212:42539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:45821
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35825/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 14:34:04.829303 20082 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:34:04.829618 20082 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:34:04.829660 20082 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:34:04.833786 20082 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:34:04.833865 20082 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:34:04.833881 20082 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:34:04.833899 20082 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:34:04.833915 20082 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 14:34:04.833932 20082 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 14:34:04.833948 20082 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:35825/jwks.json
I20260808 14:34:04.838871 20082 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:42539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786199615258783-11791-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:45821
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:45821
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35825/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.131.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20082
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:34:04.840039 20082 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:34:04.841475 20082 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:34:04.850425 20093 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:04.850409 20089 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:04.850414 20090 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:04.850741 20082 server_base.cc:1034] running on GCE node
I20260808 14:34:04.851456 20082 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:34:04.852591 20082 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:34:04.853806 20082 hybrid_clock.cc:648] HybridClock initialized: now 1786199644853776 us; error 40 us; skew 500 ppm
I20260808 14:34:04.855779 20082 webserver.cc:460] Webserver started at http://127.11.131.254:36751/ using document root <none> and password file <none>
I20260808 14:34:04.856352 20082 fs_manager.cc:359] Metadata directory not provided
I20260808 14:34:04.856412 20082 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:34:04.856623 20082 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:34:04.858808 20082 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786199615258783-11791-0/minicluster-data/master-0/data/instance:
uuid: "fb0d7ee3ed924790a5f9e19f8ba1af39"
format_stamp: "Formatted at 2026-08-08 14:34:04 on dist-test-slave-twwt"
server_key: "06617b0bfcd45ffc81985e3067ab089e"
server_key_iv: "890dfc9866267da621674aecb7bd9442"
server_key_version: "encryptionkey@0"
I20260808 14:34:04.859341 20082 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786199615258783-11791-0/minicluster-data/master-0/wal/instance:
uuid: "fb0d7ee3ed924790a5f9e19f8ba1af39"
format_stamp: "Formatted at 2026-08-08 14:34:04 on dist-test-slave-twwt"
server_key: "06617b0bfcd45ffc81985e3067ab089e"
server_key_iv: "890dfc9866267da621674aecb7bd9442"
server_key_version: "encryptionkey@0"
I20260808 14:34:04.863065 20082 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.003s
I20260808 14:34:04.865552 20105 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:04.866879 20082 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 14:34:04.866997 20082 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "fb0d7ee3ed924790a5f9e19f8ba1af39"
format_stamp: "Formatted at 2026-08-08 14:34:04 on dist-test-slave-twwt"
server_key: "06617b0bfcd45ffc81985e3067ab089e"
server_key_iv: "890dfc9866267da621674aecb7bd9442"
server_key_version: "encryptionkey@0"
I20260808 14:34:04.867084 20082 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:34:04.878710 20082 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:34:04.879374 20082 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:34:04.879523 20082 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:34:04.887694 20082 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.254:45821
I20260808 14:34:04.887698 20178 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.254:45821 every 8 connection(s)
I20260808 14:34:04.888739 20082 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:34:04.889029 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 20082
I20260808 14:34:04.889176 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786199615258783-11791-0/minicluster-data/master-0/wal/instance
I20260808 14:34:04.889544 11791 external_mini_cluster.cc:1428] Setting key 2c4b5121d6fe75d6abb2741a4d8122b4
I20260808 14:34:04.892326 20179 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:34:04.898239 20179 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb0d7ee3ed924790a5f9e19f8ba1af39: Bootstrap starting.
I20260808 14:34:04.899420 20182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:04.891033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49866 (local address 127.11.131.254:45821)
0808 14:34:04.891727 (+ 694us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:04.891742 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:04.891780 (+ 38us) server_negotiation.cc:407] Connection header received
0808 14:34:04.892522 (+ 742us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:04.892543 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:04.892976 (+ 433us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:04.893342 (+ 366us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:04.893794 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:04.894957 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:04.895882 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:04.896375 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:04.896556 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:04.897497 (+ 941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:04.897502 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:04.897515 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:34:04.897944 (+ 429us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:04.898003 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:34:04.898025 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:04.898141 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:04.898259 (+ 118us) server_negotiation.cc:299] Negotiation successful
0808 14:34:04.898563 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":330,"thread_start_us":156,"threads_started":1}
I20260808 14:34:04.900908 20179 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fb0d7ee3ed924790a5f9e19f8ba1af39: Neither blocks nor log segments found. Creating new log.
I20260808 14:34:04.901829 20179 log.cc:824] T 00000000000000000000000000000000 P fb0d7ee3ed924790a5f9e19f8ba1af39: Log is configured to *not* fsync() on all Append() calls
I20260808 14:34:04.902567 11791 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:34:04.904125 20179 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb0d7ee3ed924790a5f9e19f8ba1af39: No bootstrap required, opened a new log
I20260808 14:34:04.908007 20179 raft_consensus.cc:348] T 00000000000000000000000000000000 P fb0d7ee3ed924790a5f9e19f8ba1af39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb0d7ee3ed924790a5f9e19f8ba1af39" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 45821 } }
I20260808 14:34:04.908238 20179 raft_consensus.cc:374] T 00000000000000000000000000000000 P fb0d7ee3ed924790a5f9e19f8ba1af39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:34:04.908274 20179 raft_consensus.cc:729] T 00000000000000000000000000000000 P fb0d7ee3ed924790a5f9e19f8ba1af39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb0d7ee3ed924790a5f9e19f8ba1af39, State: Initialized, Role: FOLLOWER
I20260808 14:34:04.908703 20179 consensus_queue.cc:260] T 00000000000000000000000000000000 P fb0d7ee3ed924790a5f9e19f8ba1af39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb0d7ee3ed924790a5f9e19f8ba1af39" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 45821 } }
I20260808 14:34:04.908842 20179 raft_consensus.cc:388] T 00000000000000000000000000000000 P fb0d7ee3ed924790a5f9e19f8ba1af39 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:34:04.908891 20179 raft_consensus.cc:482] T 00000000000000000000000000000000 P fb0d7ee3ed924790a5f9e19f8ba1af39 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:34:04.908969 20179 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fb0d7ee3ed924790a5f9e19f8ba1af39 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:34:04.909866 20179 raft_consensus.cc:504] T 00000000000000000000000000000000 P fb0d7ee3ed924790a5f9e19f8ba1af39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb0d7ee3ed924790a5f9e19f8ba1af39" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 45821 } }
I20260808 14:34:04.910166 20179 leader_election.cc:302] T 00000000000000000000000000000000 P fb0d7ee3ed924790a5f9e19f8ba1af39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fb0d7ee3ed924790a5f9e19f8ba1af39; no voters:
I20260808 14:34:04.910449 20179 leader_election.cc:288] T 00000000000000000000000000000000 P fb0d7ee3ed924790a5f9e19f8ba1af39 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:34:04.910637 20184 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fb0d7ee3ed924790a5f9e19f8ba1af39 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:34:04.910890 20184 raft_consensus.cc:686] T 00000000000000000000000000000000 P fb0d7ee3ed924790a5f9e19f8ba1af39 [term 1 LEADER]: Becoming Leader. State: Replica: fb0d7ee3ed924790a5f9e19f8ba1af39, State: Running, Role: LEADER
I20260808 14:34:04.911226 20184 consensus_queue.cc:237] T 00000000000000000000000000000000 P fb0d7ee3ed924790a5f9e19f8ba1af39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb0d7ee3ed924790a5f9e19f8ba1af39" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 45821 } }
I20260808 14:34:04.911793 20179 sys_catalog.cc:564] T 00000000000000000000000000000000 P fb0d7ee3ed924790a5f9e19f8ba1af39 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:34:04.913081 20186 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb0d7ee3ed924790a5f9e19f8ba1af39 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fb0d7ee3ed924790a5f9e19f8ba1af39. Latest consensus state: current_term: 1 leader_uuid: "fb0d7ee3ed924790a5f9e19f8ba1af39" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb0d7ee3ed924790a5f9e19f8ba1af39" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 45821 } } }
I20260808 14:34:04.913228 20186 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb0d7ee3ed924790a5f9e19f8ba1af39 [sys.catalog]: This master's current role is: LEADER
I20260808 14:34:04.913516 20185 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb0d7ee3ed924790a5f9e19f8ba1af39 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fb0d7ee3ed924790a5f9e19f8ba1af39" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb0d7ee3ed924790a5f9e19f8ba1af39" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 45821 } } }
I20260808 14:34:04.913622 20185 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb0d7ee3ed924790a5f9e19f8ba1af39 [sys.catalog]: This master's current role is: LEADER
I20260808 14:34:04.913766 20196 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:34:04.917550 20196 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:34:04.927616 20196 catalog_manager.cc:1347] Generated new cluster ID: 8e4456cfc2964c55aeb7d7b29ccfd4e1
I20260808 14:34:04.927726 20196 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:34:04.939556 20196 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:34:04.940915 20196 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:34:04.948987 20196 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fb0d7ee3ed924790a5f9e19f8ba1af39: Generated new TSK 0
I20260808 14:34:04.949904 20196 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:34:04.973374 20182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:04.967252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49872 (local address 127.11.131.254:45821)
0808 14:34:04.967430 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:04.967438 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:04.967816 (+ 378us) server_negotiation.cc:407] Connection header received
0808 14:34:04.968030 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:04.968033 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:04.968123 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:04.968233 (+ 110us) server_negotiation.cc:226] Negotiated authn=JWT
0808 14:34:04.968485 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:04.969340 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:04.970257 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:04.970694 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:04.970797 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:04.971188 (+ 391us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 14:34:04.972985 (+ 1797us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35825/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 14:34:04.973218 (+ 233us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:49872: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35825/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":44}
W20260808 14:34:04.973459 20182 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:49872: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35825/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260808 14:34:04.975284 20220 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:04.967420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45821 (local address 127.0.0.1:49872)
0808 14:34:04.967719 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:04.967731 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:04.967875 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:04.968232 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:04.968236 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:04.968244 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0808 14:34:04.968368 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:04.968374 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:04.969475 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:04.969479 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:04.970131 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:04.970138 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:04.970825 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:04.970829 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:04.970942 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:04.970967 (+ 25us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 14:34:04.973817 (+ 2850us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35825/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 14:34:04.975112 (+ 1295us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.131.254:45821: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35825/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":207,"mutex_wait_us":1098,"thread_start_us":134,"threads_started":1}
I20260808 14:34:04.975641 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 20082
E20260808 14:34:04.994890 20223 webserver.cc:533] Webserver: sslize failed:
E20260808 14:34:04.994978 20223 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-08T14:34:05Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (328 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-08T14:34:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:34:05Z Disabled control of system clock
I20260808 14:34:05.039381 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:44653
--webserver_interface=127.11.131.254
--webserver_port=0
--builtin_ntp_servers=127.11.131.212:43103
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:44653
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786199615258783-11791-0/testchainca.cert with env {}
W20260808 14:34:05.156832 20227 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:34:05.157104 20227 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:34:05.157145 20227 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:34:05.161187 20227 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:34:05.161249 20227 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:34:05.161265 20227 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:34:05.161283 20227 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:34:05.161298 20227 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 14:34:05.161320 20227 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 14:34:05.161334 20227 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260808 14:34:05.166836 20227 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:43103
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786199615258783-11791-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:44653
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:44653
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.131.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786199615258783-11791-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20227
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:34:05.167922 20227 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:34:05.168944 20227 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:34:05.178009 20236 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:05.178092 20237 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:05.178201 20227 server_base.cc:1034] running on GCE node
W20260808 14:34:05.178007 20240 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:05.179020 20227 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:34:05.180182 20227 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:34:05.181381 20227 hybrid_clock.cc:648] HybridClock initialized: now 1786199645181366 us; error 27 us; skew 500 ppm
I20260808 14:34:05.183391 20227 webserver.cc:460] Webserver started at http://127.11.131.254:44407/ using document root <none> and password file <none>
I20260808 14:34:05.184026 20227 fs_manager.cc:359] Metadata directory not provided
I20260808 14:34:05.184120 20227 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:34:05.184363 20227 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:34:05.186585 20227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786199615258783-11791-0/minicluster-data/master-0/data/instance:
uuid: "1a82262edd1c4ea79ee341db4b63e20a"
format_stamp: "Formatted at 2026-08-08 14:34:05 on dist-test-slave-twwt"
server_key: "b34f53b22488c441153a129eb4529e04"
server_key_iv: "f9dff843f2e334fe7adb1405319e3ea4"
server_key_version: "encryptionkey@0"
I20260808 14:34:05.187248 20227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786199615258783-11791-0/minicluster-data/master-0/wal/instance:
uuid: "1a82262edd1c4ea79ee341db4b63e20a"
format_stamp: "Formatted at 2026-08-08 14:34:05 on dist-test-slave-twwt"
server_key: "b34f53b22488c441153a129eb4529e04"
server_key_iv: "f9dff843f2e334fe7adb1405319e3ea4"
server_key_version: "encryptionkey@0"
I20260808 14:34:05.191314 20227 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 14:34:05.193938 20249 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:05.195413 20227 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 14:34:05.195559 20227 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "1a82262edd1c4ea79ee341db4b63e20a"
format_stamp: "Formatted at 2026-08-08 14:34:05 on dist-test-slave-twwt"
server_key: "b34f53b22488c441153a129eb4529e04"
server_key_iv: "f9dff843f2e334fe7adb1405319e3ea4"
server_key_version: "encryptionkey@0"
I20260808 14:34:05.195683 20227 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:34:05.212071 20227 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:34:05.212834 20227 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:34:05.213045 20227 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:34:05.221472 20227 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.254:44653
I20260808 14:34:05.221462 20331 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.254:44653 every 8 connection(s)
I20260808 14:34:05.222496 20227 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:34:05.225488 20332 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:34:05.225941 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 20227
I20260808 14:34:05.226092 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786199615258783-11791-0/minicluster-data/master-0/wal/instance
I20260808 14:34:05.226383 11791 external_mini_cluster.cc:1428] Setting key 996579980ea2ee6b3f1038b49e78b42e
I20260808 14:34:05.231998 20332 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a82262edd1c4ea79ee341db4b63e20a: Bootstrap starting.
I20260808 14:34:05.234598 20332 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1a82262edd1c4ea79ee341db4b63e20a: Neither blocks nor log segments found. Creating new log.
I20260808 14:34:05.235550 20332 log.cc:824] T 00000000000000000000000000000000 P 1a82262edd1c4ea79ee341db4b63e20a: Log is configured to *not* fsync() on all Append() calls
I20260808 14:34:05.236471 20337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:05.227882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53838 (local address 127.11.131.254:44653)
0808 14:34:05.228678 (+ 796us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:05.228695 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:05.228739 (+ 44us) server_negotiation.cc:407] Connection header received
0808 14:34:05.229446 (+ 707us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:05.229465 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:05.229933 (+ 468us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:05.230297 (+ 364us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:05.230810 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:05.231787 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:05.232752 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:05.233257 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:05.233438 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:05.234370 (+ 932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:05.234375 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:05.234389 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:34:05.234914 (+ 525us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:05.234976 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:34:05.234998 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:05.235110 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:05.235266 (+ 156us) server_negotiation.cc:299] Negotiation successful
0808 14:34:05.235535 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":344,"thread_start_us":133,"threads_started":1}
I20260808 14:34:05.237911 20332 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a82262edd1c4ea79ee341db4b63e20a: No bootstrap required, opened a new log
I20260808 14:34:05.239564 11791 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:34:05.242095 20332 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1a82262edd1c4ea79ee341db4b63e20a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a82262edd1c4ea79ee341db4b63e20a" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 44653 } }
I20260808 14:34:05.242364 20332 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1a82262edd1c4ea79ee341db4b63e20a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:34:05.242479 20332 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1a82262edd1c4ea79ee341db4b63e20a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a82262edd1c4ea79ee341db4b63e20a, State: Initialized, Role: FOLLOWER
I20260808 14:34:05.242993 20332 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1a82262edd1c4ea79ee341db4b63e20a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a82262edd1c4ea79ee341db4b63e20a" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 44653 } }
I20260808 14:34:05.243156 20332 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1a82262edd1c4ea79ee341db4b63e20a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:34:05.243247 20332 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1a82262edd1c4ea79ee341db4b63e20a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:34:05.243368 20332 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1a82262edd1c4ea79ee341db4b63e20a [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:34:05.244355 20332 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1a82262edd1c4ea79ee341db4b63e20a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a82262edd1c4ea79ee341db4b63e20a" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 44653 } }
I20260808 14:34:05.244717 20332 leader_election.cc:302] T 00000000000000000000000000000000 P 1a82262edd1c4ea79ee341db4b63e20a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1a82262edd1c4ea79ee341db4b63e20a; no voters:
I20260808 14:34:05.245066 20332 leader_election.cc:288] T 00000000000000000000000000000000 P 1a82262edd1c4ea79ee341db4b63e20a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:34:05.245223 20339 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1a82262edd1c4ea79ee341db4b63e20a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:34:05.245473 20339 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1a82262edd1c4ea79ee341db4b63e20a [term 1 LEADER]: Becoming Leader. State: Replica: 1a82262edd1c4ea79ee341db4b63e20a, State: Running, Role: LEADER
I20260808 14:34:05.245786 20339 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1a82262edd1c4ea79ee341db4b63e20a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a82262edd1c4ea79ee341db4b63e20a" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 44653 } }
I20260808 14:34:05.246411 20332 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1a82262edd1c4ea79ee341db4b63e20a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:34:05.247483 20342 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a82262edd1c4ea79ee341db4b63e20a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1a82262edd1c4ea79ee341db4b63e20a. Latest consensus state: current_term: 1 leader_uuid: "1a82262edd1c4ea79ee341db4b63e20a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a82262edd1c4ea79ee341db4b63e20a" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 44653 } } }
I20260808 14:34:05.247648 20342 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a82262edd1c4ea79ee341db4b63e20a [sys.catalog]: This master's current role is: LEADER
I20260808 14:34:05.247678 20340 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a82262edd1c4ea79ee341db4b63e20a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1a82262edd1c4ea79ee341db4b63e20a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a82262edd1c4ea79ee341db4b63e20a" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 44653 } } }
I20260808 14:34:05.247761 20340 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a82262edd1c4ea79ee341db4b63e20a [sys.catalog]: This master's current role is: LEADER
I20260808 14:34:05.248039 20351 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:34:05.251066 20351 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:34:05.257287 20351 catalog_manager.cc:1347] Generated new cluster ID: 8709ca40fa0d4d41bcad534b4b2516ec
I20260808 14:34:05.257376 20351 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:34:05.285717 20351 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:34:05.286736 20351 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:34:05.292383 20351 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1a82262edd1c4ea79ee341db4b63e20a: Generated new TSK 0
I20260808 14:34:05.293133 20351 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:34:05.370750 20337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:05.301000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53844 (local address 127.11.131.254:44653)
0808 14:34:05.301155 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:05.301162 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:05.301334 (+ 172us) server_negotiation.cc:407] Connection header received
0808 14:34:05.301519 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:05.301521 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:05.301571 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:05.301666 (+ 95us) server_negotiation.cc:226] Negotiated authn=JWT
0808 14:34:05.301957 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:05.302486 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:05.303739 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:05.303968 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:05.304048 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:05.304389 (+ 341us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 14:34:05.370278 (+ 65889us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 14:34:05.370561 (+ 283us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:53844: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":61}
W20260808 14:34:05.370857 20337 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:53844: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260808 14:34:05.371062 20373 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:05.300913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44653 (local address 127.0.0.1:53844)
0808 14:34:05.301236 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:05.301252 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:05.301391 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:05.301700 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:05.301703 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:05.301712 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0808 14:34:05.301838 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:05.301845 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:05.302621 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:05.302625 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:05.303623 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:05.303633 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:05.304093 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:05.304097 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:05.304193 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:05.304222 (+ 29us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 14:34:05.370573 (+ 66351us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 14:34:05.370862 (+ 289us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.131.254:44653: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":115,"threads_started":1}
I20260808 14:34:05.371752 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 20227
2026-08-08T14:34:05Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (376 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (131 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (135 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:34:05 dist-test-slave-twwt krb5kdc[20389](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:34:05 dist-test-slave-twwt krb5kdc[20389](info): set up 2 sockets
Aug 08 14:34:05 dist-test-slave-twwt krb5kdc[20389](info): commencing operation
krb5kdc: starting...
W20260808 14:34:06.914862 11791 mini_kdc.cc:121] Time spent starting KDC: real 1.242s user 0.008s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Aug 08 14:34:07 dist-test-slave-twwt krb5kdc[20389](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199647, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:34:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:34:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.131.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
I20260808 14:34:07.049340 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:37073
--webserver_interface=127.11.131.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:37973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:37073
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:34:07.171758 20408 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:34:07.172055 20408 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:34:07.172129 20408 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:34:07.176234 20408 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:34:07.176339 20408 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:34:07.176380 20408 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:34:07.176419 20408 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:34:07.176458 20408 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:34:07.181787 20408 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:37973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:37073
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:37073
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.131.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20408
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:34:07.183025 20408 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:34:07.184165 20408 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:34:07.193153 20417 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:07.193166 20415 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:07.193171 20414 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:07.193215 20408 server_base.cc:1034] running on GCE node
I20260808 14:34:07.193984 20408 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:34:07.195210 20408 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:34:07.196373 20408 hybrid_clock.cc:648] HybridClock initialized: now 1786199647196341 us; error 42 us; skew 500 ppm
Aug 08 14:34:07 dist-test-slave-twwt krb5kdc[20389](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199647, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:34:07.203358 20408 init.cc:377] Logged in from keytab as kudu/127.11.131.254@KRBTEST.COM (short username kudu)
I20260808 14:34:07.204272 20408 webserver.cc:460] Webserver started at http://127.11.131.254:37187/ using document root <none> and password file <none>
I20260808 14:34:07.204846 20408 fs_manager.cc:359] Metadata directory not provided
I20260808 14:34:07.204955 20408 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:34:07.205205 20408 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:34:07.207407 20408 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/master-0/data/instance:
uuid: "a15a2000beca4567be2c324d8aefa93f"
format_stamp: "Formatted at 2026-08-08 14:34:07 on dist-test-slave-twwt"
server_key: "642f0aa926a572d62e5c90743103cae2"
server_key_iv: "5cf98897b8519ed027882ea91c4bcd79"
server_key_version: "encryptionkey@0"
I20260808 14:34:07.208050 20408 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/master-0/wal/instance:
uuid: "a15a2000beca4567be2c324d8aefa93f"
format_stamp: "Formatted at 2026-08-08 14:34:07 on dist-test-slave-twwt"
server_key: "642f0aa926a572d62e5c90743103cae2"
server_key_iv: "5cf98897b8519ed027882ea91c4bcd79"
server_key_version: "encryptionkey@0"
I20260808 14:34:07.211776 20408 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.004s
I20260808 14:34:07.214110 20427 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:07.215387 20408 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 14:34:07.215529 20408 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "a15a2000beca4567be2c324d8aefa93f"
format_stamp: "Formatted at 2026-08-08 14:34:07 on dist-test-slave-twwt"
server_key: "642f0aa926a572d62e5c90743103cae2"
server_key_iv: "5cf98897b8519ed027882ea91c4bcd79"
server_key_version: "encryptionkey@0"
I20260808 14:34:07.215642 20408 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:34:07.255816 20408 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:34:07.259512 20408 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:34:07.259759 20408 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:34:07.267807 20408 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.254:37073
I20260808 14:34:07.267833 20508 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.254:37073 every 8 connection(s)
I20260808 14:34:07.268851 20408 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:34:07.271701 20509 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:34:07.277676 20509 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a15a2000beca4567be2c324d8aefa93f: Bootstrap starting.
I20260808 14:34:07.277801 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 20408
I20260808 14:34:07.277940 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/master-0/wal/instance
I20260808 14:34:07.278280 11791 external_mini_cluster.cc:1428] Setting key 4e0520830c8f58fc0476ba5e1b29e0c8
I20260808 14:34:07.280551 20509 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a15a2000beca4567be2c324d8aefa93f: Neither blocks nor log segments found. Creating new log.
I20260808 14:34:07.281352 20509 log.cc:824] T 00000000000000000000000000000000 P a15a2000beca4567be2c324d8aefa93f: Log is configured to *not* fsync() on all Append() calls
I20260808 14:34:07.283385 20509 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a15a2000beca4567be2c324d8aefa93f: No bootstrap required, opened a new log
I20260808 14:34:07.287134 20509 raft_consensus.cc:348] T 00000000000000000000000000000000 P a15a2000beca4567be2c324d8aefa93f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a15a2000beca4567be2c324d8aefa93f" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 37073 } }
I20260808 14:34:07.287457 20509 raft_consensus.cc:374] T 00000000000000000000000000000000 P a15a2000beca4567be2c324d8aefa93f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
Aug 08 14:34:07 dist-test-slave-twwt krb5kdc[20389](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199647, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:34:07.287520 20509 raft_consensus.cc:729] T 00000000000000000000000000000000 P a15a2000beca4567be2c324d8aefa93f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a15a2000beca4567be2c324d8aefa93f, State: Initialized, Role: FOLLOWER
I20260808 14:34:07.287997 20509 consensus_queue.cc:260] T 00000000000000000000000000000000 P a15a2000beca4567be2c324d8aefa93f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a15a2000beca4567be2c324d8aefa93f" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 37073 } }
I20260808 14:34:07.288159 20509 raft_consensus.cc:388] T 00000000000000000000000000000000 P a15a2000beca4567be2c324d8aefa93f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:34:07.288249 20509 raft_consensus.cc:482] T 00000000000000000000000000000000 P a15a2000beca4567be2c324d8aefa93f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:34:07.288383 20509 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a15a2000beca4567be2c324d8aefa93f [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:34:07.289306 20509 raft_consensus.cc:504] T 00000000000000000000000000000000 P a15a2000beca4567be2c324d8aefa93f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a15a2000beca4567be2c324d8aefa93f" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 37073 } }
I20260808 14:34:07.289667 20509 leader_election.cc:302] T 00000000000000000000000000000000 P a15a2000beca4567be2c324d8aefa93f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a15a2000beca4567be2c324d8aefa93f; no voters:
I20260808 14:34:07.289994 20509 leader_election.cc:288] T 00000000000000000000000000000000 P a15a2000beca4567be2c324d8aefa93f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:34:07.290118 20514 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a15a2000beca4567be2c324d8aefa93f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:34:07.290344 20514 raft_consensus.cc:686] T 00000000000000000000000000000000 P a15a2000beca4567be2c324d8aefa93f [term 1 LEADER]: Becoming Leader. State: Replica: a15a2000beca4567be2c324d8aefa93f, State: Running, Role: LEADER
I20260808 14:34:07.291163 20514 consensus_queue.cc:237] T 00000000000000000000000000000000 P a15a2000beca4567be2c324d8aefa93f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a15a2000beca4567be2c324d8aefa93f" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 37073 } }
I20260808 14:34:07.291373 20509 sys_catalog.cc:564] T 00000000000000000000000000000000 P a15a2000beca4567be2c324d8aefa93f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:34:07.292891 20516 sys_catalog.cc:455] T 00000000000000000000000000000000 P a15a2000beca4567be2c324d8aefa93f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a15a2000beca4567be2c324d8aefa93f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a15a2000beca4567be2c324d8aefa93f" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 37073 } } }
I20260808 14:34:07.293021 20516 sys_catalog.cc:458] T 00000000000000000000000000000000 P a15a2000beca4567be2c324d8aefa93f [sys.catalog]: This master's current role is: LEADER
I20260808 14:34:07.293545 20527 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:34:07.293797 20517 sys_catalog.cc:455] T 00000000000000000000000000000000 P a15a2000beca4567be2c324d8aefa93f [sys.catalog]: SysCatalogTable state changed. Reason: New leader a15a2000beca4567be2c324d8aefa93f. Latest consensus state: current_term: 1 leader_uuid: "a15a2000beca4567be2c324d8aefa93f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a15a2000beca4567be2c324d8aefa93f" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 37073 } } }
I20260808 14:34:07.293970 20517 sys_catalog.cc:458] T 00000000000000000000000000000000 P a15a2000beca4567be2c324d8aefa93f [sys.catalog]: This master's current role is: LEADER
I20260808 14:34:07.294515 20512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:07.279837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38928 (local address 127.11.131.254:37073)
0808 14:34:07.280305 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:07.280322 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:07.280359 (+ 37us) server_negotiation.cc:407] Connection header received
0808 14:34:07.281074 (+ 715us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:07.281095 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:07.281439 (+ 344us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:07.281840 (+ 401us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:07.282713 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:07.283746 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:07.284619 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:07.285100 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:07.285272 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:07.288179 (+ 2907us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:07.288186 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:07.288204 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:07.288258 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:07.290363 (+ 2105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:07.290896 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:07.290903 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:07.290909 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:07.291051 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:07.291414 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:07.291418 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:07.291419 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:07.291982 (+ 563us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:07.292197 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:07.292861 (+ 664us) server_negotiation.cc:299] Negotiation successful
0808 14:34:07.293166 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":148,"threads_started":1}
I20260808 14:34:07.297225 20527 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:34:07.303520 20527 catalog_manager.cc:1347] Generated new cluster ID: 67c036d121e24eadb3e93aae0350f6e0
I20260808 14:34:07.303602 20527 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:34:07.329169 20527 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:34:07.330240 20527 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:34:07.341430 20527 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a15a2000beca4567be2c324d8aefa93f: Generated new TSK 0
I20260808 14:34:07.342175 20527 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.131.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab.
Entry for principal kudu/127.11.131.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab.
I20260808 14:34:07.379665 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.193:0
--local_ip_for_outbound_sockets=127.11.131.193
--webserver_interface=127.11.131.193
--webserver_port=0
--tserver_master_addrs=127.11.131.254:37073
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab
--principal=kudu/127.11.131.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:37973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:34:07.498346 20551 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:34:07.498672 20551 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:34:07.498741 20551 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:34:07.502950 20551 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:34:07.503010 20551 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:34:07.503069 20551 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.193
I20260808 14:34:07.508481 20551 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:37973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab
--principal=kudu/127.11.131.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.131.193
--webserver_port=0
--tserver_master_addrs=127.11.131.254:37073
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20551
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.193
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:34:07.509542 20551 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:34:07.510649 20551 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:34:07.520562 20561 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:07.520588 20559 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:07.520602 20558 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:07.520902 20551 server_base.cc:1034] running on GCE node
I20260808 14:34:07.521353 20551 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:34:07.522025 20551 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:34:07.523208 20551 hybrid_clock.cc:648] HybridClock initialized: now 1786199647523169 us; error 50 us; skew 500 ppm
Aug 08 14:34:07 dist-test-slave-twwt krb5kdc[20389](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199647, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:34:07.526026 20551 init.cc:377] Logged in from keytab as kudu/127.11.131.193@KRBTEST.COM (short username kudu)
I20260808 14:34:07.527004 20551 webserver.cc:460] Webserver started at http://127.11.131.193:38117/ using document root <none> and password file <none>
I20260808 14:34:07.527582 20551 fs_manager.cc:359] Metadata directory not provided
I20260808 14:34:07.527676 20551 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:34:07.527911 20551 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:34:07.530002 20551 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/ts-0/data/instance:
uuid: "e3f678487084466f95074d83f507fe62"
format_stamp: "Formatted at 2026-08-08 14:34:07 on dist-test-slave-twwt"
server_key: "42fe2b51719afe37a335b8a047a9203b"
server_key_iv: "e7024e8d8ba0fd29759718967943ba7b"
server_key_version: "encryptionkey@0"
I20260808 14:34:07.530659 20551 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/ts-0/wal/instance:
uuid: "e3f678487084466f95074d83f507fe62"
format_stamp: "Formatted at 2026-08-08 14:34:07 on dist-test-slave-twwt"
server_key: "42fe2b51719afe37a335b8a047a9203b"
server_key_iv: "e7024e8d8ba0fd29759718967943ba7b"
server_key_version: "encryptionkey@0"
I20260808 14:34:07.534965 20551 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 14:34:07.537459 20571 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:07.538738 20551 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 14:34:07.538868 20551 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/ts-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/ts-0/wal
uuid: "e3f678487084466f95074d83f507fe62"
format_stamp: "Formatted at 2026-08-08 14:34:07 on dist-test-slave-twwt"
server_key: "42fe2b51719afe37a335b8a047a9203b"
server_key_iv: "e7024e8d8ba0fd29759718967943ba7b"
server_key_version: "encryptionkey@0"
I20260808 14:34:07.538981 20551 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:34:07.551879 20551 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:34:07.555567 20551 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:34:07.555790 20551 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:34:07.556458 20551 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:34:07.557433 20551 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:34:07.557507 20551 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:07.557587 20551 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:34:07.557629 20551 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:07.567217 20551 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.193:33549
I20260808 14:34:07.567262 20750 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.193:33549 every 8 connection(s)
I20260808 14:34:07.568181 20551 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
I20260808 14:34:07.577440 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 20551
I20260808 14:34:07.577579 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/ts-0/wal/instance
I20260808 14:34:07.577903 11791 external_mini_cluster.cc:1428] Setting key 68d4017b5bb0d41d891f928a6d830a11
Aug 08 14:34:07 dist-test-slave-twwt krb5kdc[20389](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199647, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.193@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:34:07.583057 20512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:07.570155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:50147 (local address 127.11.131.254:37073)
0808 14:34:07.570316 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:07.570320 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:07.571271 (+ 951us) server_negotiation.cc:407] Connection header received
0808 14:34:07.572797 (+ 1526us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:07.572800 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:07.572866 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:07.572972 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:07.574214 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:07.574832 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:07.576014 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:07.576257 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:07.576379 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:07.579297 (+ 2918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:07.579301 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:07.579303 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:07.579337 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:07.580823 (+ 1486us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:07.581408 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:07.581412 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:07.581414 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:07.581498 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:07.581848 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:07.581853 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:07.581854 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:07.582055 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:07.582167 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:07.582733 (+ 566us) server_negotiation.cc:299] Negotiation successful
0808 14:34:07.582868 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 14:34:07.583951 20754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:07.570548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:37073 (local address 127.11.131.193:50147)
0808 14:34:07.571091 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:07.571137 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:07.572534 (+ 1397us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:07.573163 (+ 629us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:07.573169 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:07.573547 (+ 378us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:07.574052 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:07.574065 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:07.574969 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:07.574973 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:07.575875 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:07.575885 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:07.576429 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:07.576433 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:07.576608 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:07.577253 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:07.577277 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:07.579119 (+ 1842us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:07.580969 (+ 1850us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:07.580975 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:07.580993 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:07.581291 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:07.581594 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:07.581598 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:07.581600 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:07.581748 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:07.582167 (+ 419us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:07.582176 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:07.582453 (+ 277us) client_negotiation.cc:769] Sending connection context
0808 14:34:07.582675 (+ 222us) client_negotiation.cc:240] Negotiation successful
0808 14:34:07.583029 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":114,"threads_started":1}
I20260808 14:34:07.585307 20751 heartbeater.cc:347] Connected to a master server at 127.11.131.254:37073
I20260808 14:34:07.585572 20751 heartbeater.cc:464] Registering TS with master...
I20260808 14:34:07.586110 20751 heartbeater.cc:511] Master 127.11.131.254:37073 requested a full tablet report, sending...
I20260808 14:34:07.587735 20452 ts_manager.cc:194] Registered new tserver with Master: e3f678487084466f95074d83f507fe62 (127.11.131.193:33549)
WARNING: no policy specified for kudu/127.11.131.194@KRBTEST.COM; defaulting to no policy
I20260808 14:34:07.588949 20452 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.193@KRBTEST.COM'} at 127.11.131.193:50147
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab.
Entry for principal kudu/127.11.131.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab.
I20260808 14:34:07.607721 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.194:0
--local_ip_for_outbound_sockets=127.11.131.194
--webserver_interface=127.11.131.194
--webserver_port=0
--tserver_master_addrs=127.11.131.254:37073
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab
--principal=kudu/127.11.131.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:37973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:34:07.726836 20757 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:34:07.727088 20757 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:34:07.727130 20757 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:34:07.731191 20757 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:34:07.731251 20757 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:34:07.731309 20757 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.194
I20260808 14:34:07.736574 20757 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:37973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab
--principal=kudu/127.11.131.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.131.194
--webserver_port=0
--tserver_master_addrs=127.11.131.254:37073
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20757
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.194
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:34:07.737543 20757 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:34:07.738546 20757 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:34:07.748771 20764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:07.748823 20767 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:07.748739 20765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:07.749017 20757 server_base.cc:1034] running on GCE node
I20260808 14:34:07.749436 20757 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:34:07.750090 20757 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:34:07.751283 20757 hybrid_clock.cc:648] HybridClock initialized: now 1786199647751264 us; error 34 us; skew 500 ppm
Aug 08 14:34:07 dist-test-slave-twwt krb5kdc[20389](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199647, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:34:07.754208 20757 init.cc:377] Logged in from keytab as kudu/127.11.131.194@KRBTEST.COM (short username kudu)
I20260808 14:34:07.755132 20757 webserver.cc:460] Webserver started at http://127.11.131.194:35887/ using document root <none> and password file <none>
I20260808 14:34:07.755661 20757 fs_manager.cc:359] Metadata directory not provided
I20260808 14:34:07.755719 20757 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:34:07.755889 20757 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:34:07.757913 20757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/ts-1/data/instance:
uuid: "ac12771458ca42e68ec8dc5af7864266"
format_stamp: "Formatted at 2026-08-08 14:34:07 on dist-test-slave-twwt"
server_key: "e4b1766458960b24f279459a63a9632a"
server_key_iv: "5bb6416c7ab26656af86aaa7293eddfe"
server_key_version: "encryptionkey@0"
I20260808 14:34:07.758447 20757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/ts-1/wal/instance:
uuid: "ac12771458ca42e68ec8dc5af7864266"
format_stamp: "Formatted at 2026-08-08 14:34:07 on dist-test-slave-twwt"
server_key: "e4b1766458960b24f279459a63a9632a"
server_key_iv: "5bb6416c7ab26656af86aaa7293eddfe"
server_key_version: "encryptionkey@0"
I20260808 14:34:07.762243 20757 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260808 14:34:07.764891 20778 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:07.766119 20757 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 14:34:07.766275 20757 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/ts-1/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/ts-1/wal
uuid: "ac12771458ca42e68ec8dc5af7864266"
format_stamp: "Formatted at 2026-08-08 14:34:07 on dist-test-slave-twwt"
server_key: "e4b1766458960b24f279459a63a9632a"
server_key_iv: "5bb6416c7ab26656af86aaa7293eddfe"
server_key_version: "encryptionkey@0"
I20260808 14:34:07.766382 20757 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:34:07.785290 20757 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:34:07.788728 20757 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:34:07.788939 20757 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:34:07.789558 20757 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:34:07.790513 20757 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:34:07.790560 20757 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:07.790649 20757 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:34:07.790689 20757 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:07.800711 20757 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.194:40479
I20260808 14:34:07.800743 20948 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.194:40479 every 8 connection(s)
I20260808 14:34:07.801609 20757 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
I20260808 14:34:07.805631 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 20757
I20260808 14:34:07.805729 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/ts-1/wal/instance
I20260808 14:34:07.806034 11791 external_mini_cluster.cc:1428] Setting key ce9b5c4e72bc210ed8536fb049834900
Aug 08 14:34:07 dist-test-slave-twwt krb5kdc[20389](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199647, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.194@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:34:07.816444 20512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:07.803481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:36775 (local address 127.11.131.254:37073)
0808 14:34:07.803621 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:07.803625 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:07.804513 (+ 888us) server_negotiation.cc:407] Connection header received
0808 14:34:07.806047 (+ 1534us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:07.806050 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:07.806110 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:07.806218 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:07.807644 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:07.808175 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:07.809337 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:07.809576 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:07.809692 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:07.812582 (+ 2890us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:07.812586 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:07.812588 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:07.812613 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:07.814085 (+ 1472us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:07.814799 (+ 714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:07.814802 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:07.814803 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:07.814877 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:07.815286 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:07.815289 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:07.815290 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:07.815463 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:07.815535 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:07.816197 (+ 662us) server_negotiation.cc:299] Negotiation successful
0808 14:34:07.816318 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
WARNING: no policy specified for kudu/127.11.131.195@KRBTEST.COM; defaulting to no policy
I20260808 14:34:07.817678 20954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:07.803877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:37073 (local address 127.11.131.194:36775)
0808 14:34:07.804345 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:07.804390 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:07.805823 (+ 1433us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:07.806436 (+ 613us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:07.806446 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:07.806905 (+ 459us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:07.807482 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:07.807505 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:07.808304 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:07.808307 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:07.809206 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:07.809216 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:07.809741 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:07.809746 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:07.809936 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:07.810558 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:07.810575 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:07.812376 (+ 1801us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:07.814214 (+ 1838us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:07.814223 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:07.814244 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:07.814697 (+ 453us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:07.814976 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:07.814982 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:07.814986 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:07.815179 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:07.815571 (+ 392us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:07.815578 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:07.815919 (+ 341us) client_negotiation.cc:769] Sending connection context
0808 14:34:07.816153 (+ 234us) client_negotiation.cc:240] Negotiation successful
0808 14:34:07.816539 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":125,"threads_started":1}
I20260808 14:34:07.819022 20949 heartbeater.cc:347] Connected to a master server at 127.11.131.254:37073
I20260808 14:34:07.819298 20949 heartbeater.cc:464] Registering TS with master...
I20260808 14:34:07.819994 20949 heartbeater.cc:511] Master 127.11.131.254:37073 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.195@KRBTEST.COM" created.
I20260808 14:34:07.821204 20452 ts_manager.cc:194] Registered new tserver with Master: ac12771458ca42e68ec8dc5af7864266 (127.11.131.194:40479)
I20260808 14:34:07.822355 20452 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.194@KRBTEST.COM'} at 127.11.131.194:36775
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab.
Entry for principal kudu/127.11.131.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab.
I20260808 14:34:07.837884 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.195:0
--local_ip_for_outbound_sockets=127.11.131.195
--webserver_interface=127.11.131.195
--webserver_port=0
--tserver_master_addrs=127.11.131.254:37073
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab
--principal=kudu/127.11.131.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:37973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:34:07.967108 20958 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:34:07.967404 20958 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:34:07.967450 20958 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:34:07.975617 20958 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:34:07.975695 20958 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:34:07.975800 20958 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.195
I20260808 14:34:07.984929 20958 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:37973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab
--principal=kudu/127.11.131.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.131.195
--webserver_port=0
--tserver_master_addrs=127.11.131.254:37073
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20958
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.195
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:34:07.986933 20958 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:34:07.988471 20958 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:34:07.998910 20970 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:07.998936 20965 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:07.999060 20966 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:07.998984 20958 server_base.cc:1034] running on GCE node
I20260808 14:34:07.999750 20958 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:34:08.000480 20958 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:34:08.001670 20958 hybrid_clock.cc:648] HybridClock initialized: now 1786199648001649 us; error 33 us; skew 500 ppm
Aug 08 14:34:08 dist-test-slave-twwt krb5kdc[20389](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199648, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:34:08.004624 20958 init.cc:377] Logged in from keytab as kudu/127.11.131.195@KRBTEST.COM (short username kudu)
I20260808 14:34:08.005543 20958 webserver.cc:460] Webserver started at http://127.11.131.195:45851/ using document root <none> and password file <none>
I20260808 14:34:08.006079 20958 fs_manager.cc:359] Metadata directory not provided
I20260808 14:34:08.006150 20958 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:34:08.006323 20958 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:34:08.008442 20958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/ts-2/data/instance:
uuid: "1ab240867164425d85b51126283fed72"
format_stamp: "Formatted at 2026-08-08 14:34:08 on dist-test-slave-twwt"
server_key: "7117c95883cf9c67d140585a0e6899d9"
server_key_iv: "c7a7476332b5943601a1c2d37719e22c"
server_key_version: "encryptionkey@0"
I20260808 14:34:08.008960 20958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/ts-2/wal/instance:
uuid: "1ab240867164425d85b51126283fed72"
format_stamp: "Formatted at 2026-08-08 14:34:08 on dist-test-slave-twwt"
server_key: "7117c95883cf9c67d140585a0e6899d9"
server_key_iv: "c7a7476332b5943601a1c2d37719e22c"
server_key_version: "encryptionkey@0"
I20260808 14:34:08.012774 20958 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 14:34:08.015138 20979 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:08.016372 20958 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 14:34:08.016494 20958 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/ts-2/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/ts-2/wal
uuid: "1ab240867164425d85b51126283fed72"
format_stamp: "Formatted at 2026-08-08 14:34:08 on dist-test-slave-twwt"
server_key: "7117c95883cf9c67d140585a0e6899d9"
server_key_iv: "c7a7476332b5943601a1c2d37719e22c"
server_key_version: "encryptionkey@0"
I20260808 14:34:08.016602 20958 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:34:08.040879 20958 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:34:08.044193 20958 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:34:08.044410 20958 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:34:08.045048 20958 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:34:08.045925 20958 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:34:08.045972 20958 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:08.046015 20958 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:34:08.046072 20958 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:08.056041 20958 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.195:42935
I20260808 14:34:08.056066 21160 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.195:42935 every 8 connection(s)
I20260808 14:34:08.056978 20958 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
I20260808 14:34:08.057385 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 20958
I20260808 14:34:08.057518 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/minicluster-data/ts-2/wal/instance
I20260808 14:34:08.057914 11791 external_mini_cluster.cc:1428] Setting key 5b3de372a9e5b64dfb6a72702442b3f3
Aug 08 14:34:08 dist-test-slave-twwt krb5kdc[20389](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199648, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.195@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:34:08.070710 20512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:08.059021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:48689 (local address 127.11.131.254:37073)
0808 14:34:08.059153 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:08.059158 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:08.060287 (+ 1129us) server_negotiation.cc:407] Connection header received
0808 14:34:08.061663 (+ 1376us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:08.061666 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:08.061743 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:08.061829 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:08.063044 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:08.063574 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:08.064656 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:08.064888 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:08.064968 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:08.067326 (+ 2358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:08.067329 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:08.067331 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:08.067358 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:08.068620 (+ 1262us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:08.069069 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:08.069071 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:08.069073 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:08.069146 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:08.069652 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:08.069655 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:08.069656 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:08.069829 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:08.069928 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:08.070377 (+ 449us) server_negotiation.cc:299] Negotiation successful
0808 14:34:08.070484 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 14:34:08.071768 21164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:08.059574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:37073 (local address 127.11.131.195:48689)
0808 14:34:08.060093 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:08.060179 (+ 86us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:08.061478 (+ 1299us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:08.062040 (+ 562us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:08.062047 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:08.062411 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:08.062918 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:08.062933 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:08.063680 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:08.063683 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:08.064548 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:08.064557 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:08.065018 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:08.065021 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:08.065157 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:08.065688 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:08.065705 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:08.067174 (+ 1469us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:08.068722 (+ 1548us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:08.068727 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:08.068738 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:08.068983 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:08.069253 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:08.069256 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:08.069257 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:08.069447 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:08.069943 (+ 496us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:08.069948 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:08.070171 (+ 223us) client_negotiation.cc:769] Sending connection context
0808 14:34:08.070323 (+ 152us) client_negotiation.cc:240] Negotiation successful
0808 14:34:08.070691 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":124,"threads_started":1}
I20260808 14:34:08.072891 21161 heartbeater.cc:347] Connected to a master server at 127.11.131.254:37073
I20260808 14:34:08.073141 21161 heartbeater.cc:464] Registering TS with master...
I20260808 14:34:08.073642 21161 heartbeater.cc:511] Master 127.11.131.254:37073 requested a full tablet report, sending...
I20260808 14:34:08.074693 20452 ts_manager.cc:194] Registered new tserver with Master: 1ab240867164425d85b51126283fed72 (127.11.131.195:42935)
I20260808 14:34:08.075268 20452 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.195@KRBTEST.COM'} at 127.11.131.195:48689
I20260808 14:34:08.083999 11791 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/krb5kdc/test-admin.keytab.
Aug 08 14:34:08 dist-test-slave-twwt krb5kdc[20389](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199648, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:34:08.101200 11791 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260808 14:34:08.104094 21177 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:08.102750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38156 (local address 127.11.131.193:33549)
0808 14:34:08.103060 (+ 310us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:08.103066 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:08.103091 (+ 25us) server_negotiation.cc:407] Connection header received
0808 14:34:08.103143 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:08.103148 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:08.103325 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:08.103449 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:08.103869 (+ 420us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38156: BlockingRecv error: recv got EOF from 127.0.0.1:38156 (error 108)
Metrics: {"server-negotiator.queue_time_us":204,"thread_start_us":100,"threads_started":1}
W20260808 14:34:08.104344 11791 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/krb5kdc/krb5cc)
Aug 08 14:34:08 dist-test-slave-twwt krb5kdc[20389](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199648, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:34:08.105394 11791 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 14:34:08 dist-test-slave-twwt krb5kdc[20389](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199648, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:34:08.106323 11791 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 14:34:08 dist-test-slave-twwt krb5kdc[20389](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199648, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.131.193@KRBTEST.COM
I20260808 14:34:08.116201 21177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:08.107292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38162 (local address 127.11.131.193:33549)
0808 14:34:08.107437 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:08.107441 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:08.107456 (+ 15us) server_negotiation.cc:407] Connection header received
0808 14:34:08.107574 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:08.107576 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:08.107618 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:08.107686 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:08.108175 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:08.108952 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:08.109758 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:08.110129 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:08.110222 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:08.112729 (+ 2507us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:08.112739 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:08.112753 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:08.112777 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:08.114263 (+ 1486us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:08.114760 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:08.114766 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:08.114767 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:08.114858 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:08.115109 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:08.115111 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:08.115112 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:08.115386 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:08.115560 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:08.115810 (+ 250us) server_negotiation.cc:299] Negotiation successful
0808 14:34:08.116041 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
W20260808 14:34:08.120198 21177 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:08.119344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38168 (local address 127.11.131.193:33549)
0808 14:34:08.119459 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:08.119463 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:08.119541 (+ 78us) server_negotiation.cc:407] Connection header received
0808 14:34:08.119637 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:08.119639 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:08.119675 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:08.119742 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:08.120088 (+ 346us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38168: BlockingRecv error: recv got EOF from 127.0.0.1:38168 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
W20260808 14:34:08.120522 11791 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/krb5kdc/krb5cc' of type FILE
Aug 08 14:34:08 dist-test-slave-twwt krb5kdc[20389](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199648, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:34:08.121629 11791 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 14:34:08 dist-test-slave-twwt krb5kdc[20389](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199648, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:34:08.122532 11791 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 14:34:08 dist-test-slave-twwt krb5kdc[20389](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199648, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.131.193@KRBTEST.COM
I20260808 14:34:08.130977 21177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:08.123430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38184 (local address 127.11.131.193:33549)
0808 14:34:08.123583 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:08.123587 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:08.123602 (+ 15us) server_negotiation.cc:407] Connection header received
0808 14:34:08.123717 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:08.123720 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:08.123757 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:08.123825 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:08.124277 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:08.124792 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:08.125552 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:08.125763 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:08.125837 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:08.128109 (+ 2272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:08.128112 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:08.128114 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:08.128138 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:08.129446 (+ 1308us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:08.129827 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:08.129830 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:08.129831 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:08.129903 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:08.130134 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:08.130137 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:08.130138 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:08.130293 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:08.130419 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:08.130602 (+ 183us) server_negotiation.cc:299] Negotiation successful
0808 14:34:08.130784 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
W20260808 14:34:08.133993 21177 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:08.132905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38198 (local address 127.11.131.193:33549)
0808 14:34:08.133024 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:08.133027 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:08.133139 (+ 112us) server_negotiation.cc:407] Connection header received
0808 14:34:08.133234 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:08.133236 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:08.133270 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:08.133358 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:08.133864 (+ 506us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38198: BlockingRecv error: recv got EOF from 127.0.0.1:38198 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260808 14:34:08.134126 11791 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786199615258783-11791-0/krb5kdc/krb5cc' of type FILE
Aug 08 14:34:08 dist-test-slave-twwt krb5kdc[20389](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199648, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:34:08.135192 11791 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 14:34:08 dist-test-slave-twwt krb5kdc[20389](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199648, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:34:08.136067 11791 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 14:34:08 dist-test-slave-twwt krb5kdc[20389](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199648, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.131.193@KRBTEST.COM
I20260808 14:34:08.144345 21177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:08.136908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38208 (local address 127.11.131.193:33549)
0808 14:34:08.137041 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:08.137044 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:08.137102 (+ 58us) server_negotiation.cc:407] Connection header received
0808 14:34:08.137196 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:08.137198 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:08.137233 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:08.137297 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:08.137744 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:08.138235 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:08.139075 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:08.139282 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:08.139358 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:08.141475 (+ 2117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:08.141478 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:08.141480 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:08.141503 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:08.142869 (+ 1366us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:08.143258 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:08.143261 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:08.143262 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:08.143338 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:08.143596 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:08.143600 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:08.143601 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:08.143771 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:08.143890 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:08.144044 (+ 154us) server_negotiation.cc:299] Negotiation successful
0808 14:34:08.144130 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 14:34:08.145394 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 20551
I20260808 14:34:08.158461 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 20757
I20260808 14:34:08.168609 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 20958
I20260808 14:34:08.194128 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 20408
2026-08-08T14:34:08Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2550 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:34:08 dist-test-slave-twwt krb5kdc[21195](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:34:08 dist-test-slave-twwt krb5kdc[21195](info): set up 2 sockets
Aug 08 14:34:08 dist-test-slave-twwt krb5kdc[21195](info): commencing operation
krb5kdc: starting...
W20260808 14:34:09.432838 11791 mini_kdc.cc:121] Time spent starting KDC: real 1.210s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Aug 08 14:34:09 dist-test-slave-twwt krb5kdc[21195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199649, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:34:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:34:09Z Disabled control of system clock
WARNING: no policy specified for oryx/127.11.131.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.131.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.131.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.254.keytab.
Entry for principal oryx/127.11.131.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.254.keytab.
I20260808 14:34:09.562908 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:38851
--webserver_interface=127.11.131.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.254.keytab
--principal=oryx/127.11.131.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:46739
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:38851
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:34:09.680797 21217 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:34:09.681139 21217 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:34:09.681221 21217 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:34:09.685257 21217 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:34:09.685374 21217 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:34:09.685412 21217 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:34:09.685452 21217 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:34:09.685483 21217 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:34:09.691052 21217 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:46739
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:38851
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.254.keytab
--principal=oryx/127.11.131.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:38851
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.131.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21217
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:34:09.692250 21217 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:34:09.693382 21217 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:34:09.702399 21223 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:09.702399 21228 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:09.702420 21225 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:09.703111 21217 server_base.cc:1034] running on GCE node
I20260808 14:34:09.703761 21217 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:34:09.704897 21217 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:34:09.706120 21217 hybrid_clock.cc:648] HybridClock initialized: now 1786199649706105 us; error 54 us; skew 500 ppm
Aug 08 14:34:09 dist-test-slave-twwt krb5kdc[21195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199649, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.131.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:34:09.709141 21217 init.cc:377] Logged in from keytab as oryx/127.11.131.254@KRBTEST.COM (short username oryx)
I20260808 14:34:09.710172 21217 webserver.cc:460] Webserver started at http://127.11.131.254:34107/ using document root <none> and password file <none>
I20260808 14:34:09.710853 21217 fs_manager.cc:359] Metadata directory not provided
I20260808 14:34:09.710947 21217 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:34:09.711197 21217 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:34:09.713383 21217 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-0/data/instance:
uuid: "18af051302ab4a05a7b6b26e56688462"
format_stamp: "Formatted at 2026-08-08 14:34:09 on dist-test-slave-twwt"
server_key: "540a4087ef331dc895f593eef1a3347e"
server_key_iv: "ef9359a1dd8adf707fd50a322e627959"
server_key_version: "encryptionkey@0"
I20260808 14:34:09.713994 21217 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-0/wal/instance:
uuid: "18af051302ab4a05a7b6b26e56688462"
format_stamp: "Formatted at 2026-08-08 14:34:09 on dist-test-slave-twwt"
server_key: "540a4087ef331dc895f593eef1a3347e"
server_key_iv: "ef9359a1dd8adf707fd50a322e627959"
server_key_version: "encryptionkey@0"
I20260808 14:34:09.717921 21217 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 14:34:09.720597 21238 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:09.721886 21217 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 14:34:09.722045 21217 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "18af051302ab4a05a7b6b26e56688462"
format_stamp: "Formatted at 2026-08-08 14:34:09 on dist-test-slave-twwt"
server_key: "540a4087ef331dc895f593eef1a3347e"
server_key_iv: "ef9359a1dd8adf707fd50a322e627959"
server_key_version: "encryptionkey@0"
I20260808 14:34:09.722174 21217 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:34:09.737872 21217 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:34:09.741168 21217 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:34:09.741344 21217 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:34:09.749197 21217 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.254:38851
I20260808 14:34:09.749545 21313 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.254:38851 every 8 connection(s)
I20260808 14:34:09.750419 21217 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:34:09.753394 21315 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:34:09.759122 21315 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462: Bootstrap starting.
I20260808 14:34:09.760524 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 21217
I20260808 14:34:09.760676 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-0/wal/instance
I20260808 14:34:09.760990 11791 external_mini_cluster.cc:1428] Setting key 7e206aadc51937e2bfdfb9c4db891e54
I20260808 14:34:09.761972 21315 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462: Neither blocks nor log segments found. Creating new log.
I20260808 14:34:09.762934 21315 log.cc:824] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462: Log is configured to *not* fsync() on all Append() calls
I20260808 14:34:09.765323 21315 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462: No bootstrap required, opened a new log
I20260808 14:34:09.769347 21315 raft_consensus.cc:348] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } }
I20260808 14:34:09.769673 21315 raft_consensus.cc:374] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:34:09.769757 21315 raft_consensus.cc:729] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18af051302ab4a05a7b6b26e56688462, State: Initialized, Role: FOLLOWER
I20260808 14:34:09.770304 21315 consensus_queue.cc:260] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } }
I20260808 14:34:09.770470 21315 raft_consensus.cc:388] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:34:09.770565 21315 raft_consensus.cc:482] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:34:09.770694 21315 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462 [term 0 FOLLOWER]: Advancing to term 1
Aug 08 14:34:09 dist-test-slave-twwt krb5kdc[21195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199649, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM
I20260808 14:34:09.772017 21315 raft_consensus.cc:504] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } }
I20260808 14:34:09.772404 21315 leader_election.cc:302] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 18af051302ab4a05a7b6b26e56688462; no voters:
I20260808 14:34:09.772763 21315 leader_election.cc:288] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:34:09.772960 21320 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:34:09.773212 21320 raft_consensus.cc:686] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462 [term 1 LEADER]: Becoming Leader. State: Replica: 18af051302ab4a05a7b6b26e56688462, State: Running, Role: LEADER
I20260808 14:34:09.773618 21320 consensus_queue.cc:237] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } }
I20260808 14:34:09.774296 21315 sys_catalog.cc:564] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:34:09.775534 21322 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "18af051302ab4a05a7b6b26e56688462" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } }
I20260808 14:34:09.775534 21323 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 18af051302ab4a05a7b6b26e56688462. Latest consensus state: current_term: 1 leader_uuid: "18af051302ab4a05a7b6b26e56688462" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } }
I20260808 14:34:09.775688 21323 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462 [sys.catalog]: This master's current role is: LEADER
I20260808 14:34:09.775688 21322 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462 [sys.catalog]: This master's current role is: LEADER
I20260808 14:34:09.776170 21332 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:34:09.778892 21318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:09.762213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57676 (local address 127.11.131.254:38851)
0808 14:34:09.762746 (+ 533us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:09.762769 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:09.762818 (+ 49us) server_negotiation.cc:407] Connection header received
0808 14:34:09.763637 (+ 819us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:09.763658 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:09.764083 (+ 425us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:09.764446 (+ 363us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:09.765124 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:09.766601 (+ 1477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:09.767510 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:09.768978 (+ 1468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:09.769146 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:09.772281 (+ 3135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:09.772287 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:09.772301 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:09.772338 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:09.774524 (+ 2186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:09.775133 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:09.775139 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:09.775149 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:09.775320 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:09.775693 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:09.775696 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:09.775698 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:09.776514 (+ 816us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:09.777357 (+ 843us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:09.777522 (+ 165us) server_negotiation.cc:299] Negotiation successful
0808 14:34:09.777852 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":340,"thread_start_us":148,"threads_started":1}
I20260808 14:34:09.779853 21332 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:34:09.785660 21332 catalog_manager.cc:1347] Generated new cluster ID: 54a60cc90df341f0b548154a83c2ced5
I20260808 14:34:09.785723 21332 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:34:09.798807 21332 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:34:09.799714 21332 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:34:09.808861 21332 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462: Generated new TSK 0
I20260808 14:34:09.809561 21332 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.11.131.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.131.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.131.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.193.keytab.
Entry for principal oryx/127.11.131.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.193.keytab.
I20260808 14:34:09.845621 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.193:0
--local_ip_for_outbound_sockets=127.11.131.193
--webserver_interface=127.11.131.193
--webserver_port=0
--tserver_master_addrs=127.11.131.254:38851
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.193.keytab
--principal=oryx/127.11.131.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:46739
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:34:09.983464 21347 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:34:09.983734 21347 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:34:09.983778 21347 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:34:09.987753 21347 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:34:09.987818 21347 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:34:09.987879 21347 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.193
I20260808 14:34:09.993122 21347 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:46739
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.193.keytab
--principal=oryx/127.11.131.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.131.193
--webserver_port=0
--tserver_master_addrs=127.11.131.254:38851
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21347
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.193
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:34:09.994199 21347 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:34:09.995270 21347 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:34:10.005357 21355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:10.005357 21357 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:10.005333 21359 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:10.005657 21347 server_base.cc:1034] running on GCE node
I20260808 14:34:10.006204 21347 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:34:10.006889 21347 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:34:10.008055 21347 hybrid_clock.cc:648] HybridClock initialized: now 1786199650008020 us; error 47 us; skew 500 ppm
Aug 08 14:34:10 dist-test-slave-twwt krb5kdc[21195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199650, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.131.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:34:10.010941 21347 init.cc:377] Logged in from keytab as oryx/127.11.131.193@KRBTEST.COM (short username oryx)
I20260808 14:34:10.011883 21347 webserver.cc:460] Webserver started at http://127.11.131.193:45281/ using document root <none> and password file <none>
I20260808 14:34:10.012470 21347 fs_manager.cc:359] Metadata directory not provided
I20260808 14:34:10.012532 21347 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:34:10.012795 21347 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:34:10.015023 21347 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-0/data/instance:
uuid: "85aaf6b6511e44698d5245b172f71008"
format_stamp: "Formatted at 2026-08-08 14:34:10 on dist-test-slave-twwt"
server_key: "e64e0a55f6ae4a3b6170379aaa57fa1a"
server_key_iv: "292e3c00e41f6ccc92174825a3d8db18"
server_key_version: "encryptionkey@0"
I20260808 14:34:10.015622 21347 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-0/wal/instance:
uuid: "85aaf6b6511e44698d5245b172f71008"
format_stamp: "Formatted at 2026-08-08 14:34:10 on dist-test-slave-twwt"
server_key: "e64e0a55f6ae4a3b6170379aaa57fa1a"
server_key_iv: "292e3c00e41f6ccc92174825a3d8db18"
server_key_version: "encryptionkey@0"
I20260808 14:34:10.019475 21347 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 14:34:10.022015 21369 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:10.023444 21347 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:34:10.023594 21347 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-0/wal
uuid: "85aaf6b6511e44698d5245b172f71008"
format_stamp: "Formatted at 2026-08-08 14:34:10 on dist-test-slave-twwt"
server_key: "e64e0a55f6ae4a3b6170379aaa57fa1a"
server_key_iv: "292e3c00e41f6ccc92174825a3d8db18"
server_key_version: "encryptionkey@0"
I20260808 14:34:10.023763 21347 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:34:10.041920 21347 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:34:10.045233 21347 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:34:10.045452 21347 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:34:10.046137 21347 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:34:10.047080 21347 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:34:10.047151 21347 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:10.047222 21347 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:34:10.047269 21347 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:10.057128 21347 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.193:42373
I20260808 14:34:10.057157 21532 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.193:42373 every 8 connection(s)
I20260808 14:34:10.058092 21347 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
I20260808 14:34:10.064769 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 21347
I20260808 14:34:10.064924 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-0/wal/instance
I20260808 14:34:10.065230 11791 external_mini_cluster.cc:1428] Setting key cc64207fdc8460114b5a1db0807dd030
Aug 08 14:34:10 dist-test-slave-twwt krb5kdc[21195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199650, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.131.193@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM
I20260808 14:34:10.073653 21318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:10.060099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:57729 (local address 127.11.131.254:38851)
0808 14:34:10.060245 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:10.060248 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:10.061070 (+ 822us) server_negotiation.cc:407] Connection header received
0808 14:34:10.062507 (+ 1437us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:10.062511 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:10.062575 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:10.062726 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:10.063975 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:10.064560 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:10.065981 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:10.066228 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:10.066311 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:10.069356 (+ 3045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:10.069360 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:10.069362 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:10.069387 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:10.071178 (+ 1791us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:10.071795 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:10.071800 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:10.071802 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:10.071902 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:10.072320 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:10.072323 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:10.072325 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:10.072545 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:10.072673 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:10.073309 (+ 636us) server_negotiation.cc:299] Negotiation successful
0808 14:34:10.073462 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 14:34:10.074805 21539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:10.060430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:38851 (local address 127.11.131.193:57729)
0808 14:34:10.060902 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:10.060947 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:10.062260 (+ 1313us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:10.062922 (+ 662us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:10.062930 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:10.063301 (+ 371us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:10.063809 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:10.063824 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:10.064714 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:10.064718 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:10.065850 (+ 1132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:10.065862 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:10.066389 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:10.066393 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:10.066655 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:10.067331 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:10.067349 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:10.069147 (+ 1798us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:10.071331 (+ 2184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:10.071338 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:10.071359 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:10.071669 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:10.072012 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:10.072016 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:10.072018 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:10.072191 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:10.072674 (+ 483us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:10.072698 (+ 24us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:10.073013 (+ 315us) client_negotiation.cc:769] Sending connection context
0808 14:34:10.073262 (+ 249us) client_negotiation.cc:240] Negotiation successful
0808 14:34:10.073660 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":111,"threads_started":1}
I20260808 14:34:10.076414 21534 heartbeater.cc:347] Connected to a master server at 127.11.131.254:38851
I20260808 14:34:10.076802 21534 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for oryx/127.11.131.194@KRBTEST.COM; defaulting to no policy
I20260808 14:34:10.077396 21534 heartbeater.cc:511] Master 127.11.131.254:38851 requested a full tablet report, sending...
I20260808 14:34:10.079459 21262 ts_manager.cc:194] Registered new tserver with Master: 85aaf6b6511e44698d5245b172f71008 (127.11.131.193:42373)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.131.194@KRBTEST.COM" created.
I20260808 14:34:10.080806 21262 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.131.193@KRBTEST.COM'} at 127.11.131.193:57729
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.131.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.194.keytab.
Entry for principal oryx/127.11.131.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.194.keytab.
I20260808 14:34:10.097450 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.194:0
--local_ip_for_outbound_sockets=127.11.131.194
--webserver_interface=127.11.131.194
--webserver_port=0
--tserver_master_addrs=127.11.131.254:38851
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.194.keytab
--principal=oryx/127.11.131.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:46739
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:34:10.217386 21542 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:34:10.217658 21542 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:34:10.217711 21542 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:34:10.221688 21542 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:34:10.221745 21542 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:34:10.221804 21542 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.194
I20260808 14:34:10.227530 21542 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:46739
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.194.keytab
--principal=oryx/127.11.131.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.131.194
--webserver_port=0
--tserver_master_addrs=127.11.131.254:38851
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21542
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.194
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:34:10.228637 21542 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:34:10.229667 21542 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:34:10.240679 21551 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:10.240770 21542 server_base.cc:1034] running on GCE node
W20260808 14:34:10.240727 21553 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:10.240679 21550 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:10.241406 21542 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:34:10.242075 21542 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:34:10.243287 21542 hybrid_clock.cc:648] HybridClock initialized: now 1786199650243266 us; error 35 us; skew 500 ppm
Aug 08 14:34:10 dist-test-slave-twwt krb5kdc[21195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199650, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.131.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:34:10.246474 21542 init.cc:377] Logged in from keytab as oryx/127.11.131.194@KRBTEST.COM (short username oryx)
I20260808 14:34:10.247502 21542 webserver.cc:460] Webserver started at http://127.11.131.194:45195/ using document root <none> and password file <none>
I20260808 14:34:10.248057 21542 fs_manager.cc:359] Metadata directory not provided
I20260808 14:34:10.248118 21542 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:34:10.248291 21542 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:34:10.250399 21542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-1/data/instance:
uuid: "3e8ddfc3c5534dbd88bb4d10b61eef3c"
format_stamp: "Formatted at 2026-08-08 14:34:10 on dist-test-slave-twwt"
server_key: "117dbc527c5062d0d5e98905e669122a"
server_key_iv: "32f36f0698b43aec9f38b3a302368f56"
server_key_version: "encryptionkey@0"
I20260808 14:34:10.251019 21542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-1/wal/instance:
uuid: "3e8ddfc3c5534dbd88bb4d10b61eef3c"
format_stamp: "Formatted at 2026-08-08 14:34:10 on dist-test-slave-twwt"
server_key: "117dbc527c5062d0d5e98905e669122a"
server_key_iv: "32f36f0698b43aec9f38b3a302368f56"
server_key_version: "encryptionkey@0"
I20260808 14:34:10.255008 21542 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 14:34:10.257511 21564 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:10.258956 21542 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:34:10.259059 21542 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-1/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-1/wal
uuid: "3e8ddfc3c5534dbd88bb4d10b61eef3c"
format_stamp: "Formatted at 2026-08-08 14:34:10 on dist-test-slave-twwt"
server_key: "117dbc527c5062d0d5e98905e669122a"
server_key_iv: "32f36f0698b43aec9f38b3a302368f56"
server_key_version: "encryptionkey@0"
I20260808 14:34:10.259150 21542 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:34:10.277570 21542 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:34:10.281169 21542 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:34:10.281348 21542 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:34:10.281939 21542 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:34:10.282850 21542 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:34:10.282902 21542 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:10.282944 21542 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:34:10.282960 21542 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:10.292935 21542 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.194:40983
I20260808 14:34:10.292960 21728 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.194:40983 every 8 connection(s)
I20260808 14:34:10.293915 21542 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
I20260808 14:34:10.294867 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 21542
I20260808 14:34:10.294992 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-1/wal/instance
I20260808 14:34:10.295295 11791 external_mini_cluster.cc:1428] Setting key 3b579678567a48faffc3a32fcc433800
Aug 08 14:34:10 dist-test-slave-twwt krb5kdc[21195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199650, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.131.194@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM
WARNING: no policy specified for oryx/127.11.131.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.131.195@KRBTEST.COM" created.
I20260808 14:34:10.309609 21318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:10.295963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:50899 (local address 127.11.131.254:38851)
0808 14:34:10.296104 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:10.296114 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:10.297119 (+ 1005us) server_negotiation.cc:407] Connection header received
0808 14:34:10.298521 (+ 1402us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:10.298524 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:10.298578 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:10.298683 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:10.300386 (+ 1703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:10.300940 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:10.302133 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:10.302390 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:10.302497 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:10.305453 (+ 2956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:10.305457 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:10.305459 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:10.305482 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:10.307121 (+ 1639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:10.307748 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:10.307753 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:10.307755 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:10.307850 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:10.308214 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:10.308217 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:10.308219 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:10.308417 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:10.308528 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:10.309314 (+ 786us) server_negotiation.cc:299] Negotiation successful
0808 14:34:10.309444 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 14:34:10.310441 21731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:10.296448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:38851 (local address 127.11.131.194:50899)
0808 14:34:10.296975 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:10.297021 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:10.298300 (+ 1279us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:10.298887 (+ 587us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:10.298899 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:10.299474 (+ 575us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:10.300205 (+ 731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:10.300229 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:10.301084 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:10.301088 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:10.301995 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:10.302006 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:10.302573 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:10.302581 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:10.302856 (+ 275us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:10.303519 (+ 663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:10.303547 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:10.305281 (+ 1734us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:10.307242 (+ 1961us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:10.307247 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:10.307270 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:10.307636 (+ 366us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:10.307948 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:10.307951 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:10.307953 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:10.308097 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:10.308528 (+ 431us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:10.308536 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:10.308991 (+ 455us) client_negotiation.cc:769] Sending connection context
0808 14:34:10.309293 (+ 302us) client_negotiation.cc:240] Negotiation successful
0808 14:34:10.309624 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":123,"threads_started":1}
I20260808 14:34:10.311775 21729 heartbeater.cc:347] Connected to a master server at 127.11.131.254:38851
I20260808 14:34:10.312055 21729 heartbeater.cc:464] Registering TS with master...
I20260808 14:34:10.312558 21729 heartbeater.cc:511] Master 127.11.131.254:38851 requested a full tablet report, sending...
I20260808 14:34:10.313687 21262 ts_manager.cc:194] Registered new tserver with Master: 3e8ddfc3c5534dbd88bb4d10b61eef3c (127.11.131.194:40983)
I20260808 14:34:10.314283 21262 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.131.194@KRBTEST.COM'} at 127.11.131.194:50899
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.131.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.195.keytab.
Entry for principal oryx/127.11.131.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.195.keytab.
I20260808 14:34:10.326330 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.195:0
--local_ip_for_outbound_sockets=127.11.131.195
--webserver_interface=127.11.131.195
--webserver_port=0
--tserver_master_addrs=127.11.131.254:38851
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.195.keytab
--principal=oryx/127.11.131.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:46739
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:34:10.447305 21736 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:34:10.447568 21736 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:34:10.447613 21736 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:34:10.451582 21736 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:34:10.451638 21736 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:34:10.451701 21736 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.195
I20260808 14:34:10.456929 21736 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:46739
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.195.keytab
--principal=oryx/127.11.131.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.131.195
--webserver_port=0
--tserver_master_addrs=127.11.131.254:38851
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21736
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.195
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:34:10.457955 21736 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:34:10.459064 21736 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:34:10.469736 21749 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:10.469743 21746 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:10.469838 21736 server_base.cc:1034] running on GCE node
W20260808 14:34:10.469743 21753 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:10.470490 21736 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:34:10.471238 21736 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:34:10.472421 21736 hybrid_clock.cc:648] HybridClock initialized: now 1786199650472405 us; error 27 us; skew 500 ppm
Aug 08 14:34:10 dist-test-slave-twwt krb5kdc[21195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199650, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.131.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:34:10.475970 21736 init.cc:377] Logged in from keytab as oryx/127.11.131.195@KRBTEST.COM (short username oryx)
I20260808 14:34:10.477013 21736 webserver.cc:460] Webserver started at http://127.11.131.195:42377/ using document root <none> and password file <none>
I20260808 14:34:10.477643 21736 fs_manager.cc:359] Metadata directory not provided
I20260808 14:34:10.477747 21736 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:34:10.478017 21736 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:34:10.480393 21736 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-2/data/instance:
uuid: "58a435968eb440fe9e5e17a994e9e721"
format_stamp: "Formatted at 2026-08-08 14:34:10 on dist-test-slave-twwt"
server_key: "1a9e698abe4fa183f82ddec70a0a4805"
server_key_iv: "e982570779ec01af7cfc137675e4297f"
server_key_version: "encryptionkey@0"
I20260808 14:34:10.481055 21736 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-2/wal/instance:
uuid: "58a435968eb440fe9e5e17a994e9e721"
format_stamp: "Formatted at 2026-08-08 14:34:10 on dist-test-slave-twwt"
server_key: "1a9e698abe4fa183f82ddec70a0a4805"
server_key_iv: "e982570779ec01af7cfc137675e4297f"
server_key_version: "encryptionkey@0"
I20260808 14:34:10.485400 21736 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260808 14:34:10.488287 21762 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:10.489616 21736 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 14:34:10.489820 21736 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-2/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-2/wal
uuid: "58a435968eb440fe9e5e17a994e9e721"
format_stamp: "Formatted at 2026-08-08 14:34:10 on dist-test-slave-twwt"
server_key: "1a9e698abe4fa183f82ddec70a0a4805"
server_key_iv: "e982570779ec01af7cfc137675e4297f"
server_key_version: "encryptionkey@0"
I20260808 14:34:10.489948 21736 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:34:10.511535 21736 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:34:10.515146 21736 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:34:10.515368 21736 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:34:10.516072 21736 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:34:10.516980 21736 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:34:10.517052 21736 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:10.517127 21736 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:34:10.517179 21736 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:10.526425 21736 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.195:42891
I20260808 14:34:10.526476 21928 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.195:42891 every 8 connection(s)
I20260808 14:34:10.527446 21736 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
I20260808 14:34:10.534777 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 21736
I20260808 14:34:10.534900 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-2/wal/instance
I20260808 14:34:10.535250 11791 external_mini_cluster.cc:1428] Setting key 30b443a094658ba9d207f4ed2020622f
Aug 08 14:34:10 dist-test-slave-twwt krb5kdc[21195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199650, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.131.195@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM
I20260808 14:34:10.541898 21318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:10.529340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:38691 (local address 127.11.131.254:38851)
0808 14:34:10.529485 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:10.529489 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:10.530310 (+ 821us) server_negotiation.cc:407] Connection header received
0808 14:34:10.531763 (+ 1453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:10.531766 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:10.531829 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:10.531919 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:10.533155 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:10.533705 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:10.535140 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:10.535463 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:10.535565 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:10.538572 (+ 3007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:10.538575 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:10.538583 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:10.538657 (+ 74us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:10.539987 (+ 1330us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:10.540496 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:10.540499 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:10.540500 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:10.540575 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:10.540949 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:10.540951 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:10.540952 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:10.541120 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:10.541195 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:10.541686 (+ 491us) server_negotiation.cc:299] Negotiation successful
0808 14:34:10.541779 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 14:34:10.542917 21932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:10.529676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:38851 (local address 127.11.131.195:38691)
0808 14:34:10.530161 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:10.530203 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:10.531546 (+ 1343us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:10.532109 (+ 563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:10.532116 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:10.532473 (+ 357us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:10.533003 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:10.533018 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:10.533854 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:10.533857 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:10.535006 (+ 1149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:10.535018 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:10.535634 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:10.535638 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:10.535780 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:10.536571 (+ 791us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:10.536589 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:10.538402 (+ 1813us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:10.540107 (+ 1705us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:10.540112 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:10.540125 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:10.540400 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:10.540658 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:10.540661 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:10.540662 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:10.540861 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:10.541219 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:10.541224 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:10.541471 (+ 247us) client_negotiation.cc:769] Sending connection context
0808 14:34:10.541640 (+ 169us) client_negotiation.cc:240] Negotiation successful
0808 14:34:10.541979 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":126,"threads_started":1}
I20260808 14:34:10.544167 21929 heartbeater.cc:347] Connected to a master server at 127.11.131.254:38851
I20260808 14:34:10.544427 21929 heartbeater.cc:464] Registering TS with master...
I20260808 14:34:10.544960 21929 heartbeater.cc:511] Master 127.11.131.254:38851 requested a full tablet report, sending...
I20260808 14:34:10.546094 21262 ts_manager.cc:194] Registered new tserver with Master: 58a435968eb440fe9e5e17a994e9e721 (127.11.131.195:42891)
I20260808 14:34:10.546788 21262 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.131.195@KRBTEST.COM'} at 127.11.131.195:38691
I20260808 14:34:10.549827 11791 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.11.131.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.131.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.131.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.253.keytab.
Entry for principal oryx/127.11.131.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.253.keytab.
I20260808 14:34:10.582158 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.253:36145
--webserver_interface=127.11.131.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.253.keytab
--principal=oryx/127.11.131.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:46739
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:38851,127.11.131.253:36145
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:34:10.700464 21935 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:34:10.700721 21935 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:34:10.700762 21935 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:34:10.704958 21935 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:34:10.705018 21935 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:34:10.705039 21935 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:34:10.705055 21935 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:34:10.705096 21935 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:34:10.710484 21935 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:46739
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:38851,127.11.131.253:36145
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.253.keytab
--principal=oryx/127.11.131.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.253:36145
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.131.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21935
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
W20260808 14:34:10.710775 21935 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.11.131.254:38851,127.11.131.253:36145'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260808 14:34:10.711728 21935 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:34:10.712833 21935 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:34:10.721835 21946 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:10.721936 21935 server_base.cc:1034] running on GCE node
W20260808 14:34:10.721850 21943 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:10.721818 21942 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:10.722733 21935 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:34:10.723824 21935 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:34:10.724995 21935 hybrid_clock.cc:648] HybridClock initialized: now 1786199650724974 us; error 30 us; skew 500 ppm
Aug 08 14:34:10 dist-test-slave-twwt krb5kdc[21195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199650, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.131.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:34:10.728021 21935 init.cc:377] Logged in from keytab as oryx/127.11.131.253@KRBTEST.COM (short username oryx)
I20260808 14:34:10.729104 21935 webserver.cc:460] Webserver started at http://127.11.131.253:39747/ using document root <none> and password file <none>
I20260808 14:34:10.729691 21935 fs_manager.cc:359] Metadata directory not provided
I20260808 14:34:10.729782 21935 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:34:10.730031 21935 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:34:10.732209 21935 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-1/data/instance:
uuid: "f8a29b80ba4b4376b671b2f015f6c5f9"
format_stamp: "Formatted at 2026-08-08 14:34:10 on dist-test-slave-twwt"
server_key: "a1a33030af42de8abccced0c412a3155"
server_key_iv: "40463b1e4c8c3ae2fdde99eebb77ff3f"
server_key_version: "encryptionkey@0"
I20260808 14:34:10.732822 21935 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-1/wal/instance:
uuid: "f8a29b80ba4b4376b671b2f015f6c5f9"
format_stamp: "Formatted at 2026-08-08 14:34:10 on dist-test-slave-twwt"
server_key: "a1a33030af42de8abccced0c412a3155"
server_key_iv: "40463b1e4c8c3ae2fdde99eebb77ff3f"
server_key_version: "encryptionkey@0"
I20260808 14:34:10.736785 21935 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 14:34:10.739339 21960 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:10.740574 21935 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 14:34:10.740724 21935 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-1/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-1/wal
uuid: "f8a29b80ba4b4376b671b2f015f6c5f9"
format_stamp: "Formatted at 2026-08-08 14:34:10 on dist-test-slave-twwt"
server_key: "a1a33030af42de8abccced0c412a3155"
server_key_iv: "40463b1e4c8c3ae2fdde99eebb77ff3f"
server_key_version: "encryptionkey@0"
I20260808 14:34:10.740840 21935 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:34:10.766866 21935 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:34:10.770772 21935 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:34:10.771005 21935 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:34:10.779067 21935 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.253:36145
I20260808 14:34:10.779385 22031 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.253:36145 every 8 connection(s)
I20260808 14:34:10.780149 21935 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-1/data/info.pb
I20260808 14:34:10.783124 22032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:34:10.787372 22032 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:34:10.790022 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 21935
Aug 08 14:34:10 dist-test-slave-twwt krb5kdc[21195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199650, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.131.253@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM
Aug 08 14:34:10 dist-test-slave-twwt krb5kdc[21195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199649, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.131.253@KRBTEST.COM
I20260808 14:34:10.802389 21318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:10.789316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57678 (local address 127.11.131.254:38851)
0808 14:34:10.789470 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:10.789473 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:10.790272 (+ 799us) server_negotiation.cc:407] Connection header received
0808 14:34:10.791435 (+ 1163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:10.791441 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:10.791503 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:10.791600 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:10.792976 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:10.793560 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:10.794962 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:10.795203 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:10.795283 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:10.798244 (+ 2961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:10.798247 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:10.798250 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:10.798279 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:10.799963 (+ 1684us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:10.800600 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:10.800604 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:10.800608 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:10.800691 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:10.801045 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:10.801048 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:10.801050 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:10.801283 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:10.801406 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:10.801902 (+ 496us) server_negotiation.cc:299] Negotiation successful
0808 14:34:10.802028 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 14:34:10.803181 22034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:10.789606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:38851 (local address 127.0.0.1:57678)
0808 14:34:10.790095 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:10.790149 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:10.791117 (+ 968us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:10.791761 (+ 644us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:10.791770 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:10.792253 (+ 483us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:10.792788 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:10.792824 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:10.793790 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:10.793793 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:10.794836 (+ 1043us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:10.794846 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:10.795353 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:10.795357 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:10.795580 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:10.796305 (+ 725us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:10.796323 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:10.798059 (+ 1736us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:10.800093 (+ 2034us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:10.800106 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:10.800116 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:10.800481 (+ 365us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:10.800791 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:10.800795 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:10.800797 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:10.800940 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:10.801407 (+ 467us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:10.801415 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:10.801667 (+ 252us) client_negotiation.cc:769] Sending connection context
0808 14:34:10.801859 (+ 192us) client_negotiation.cc:240] Negotiation successful
0808 14:34:10.802493 (+ 634us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"mutex_wait_us":49,"spinlock_wait_cycles":1280,"thread_start_us":135,"threads_started":1}
I20260808 14:34:10.803186 22037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:10.791057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51234 (local address 127.11.131.253:36145)
0808 14:34:10.791429 (+ 372us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:10.791447 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:10.791481 (+ 34us) server_negotiation.cc:407] Connection header received
0808 14:34:10.791734 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:10.791739 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:10.791945 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:10.792132 (+ 187us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:10.792864 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:10.793857 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:10.794836 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:10.795514 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:10.795621 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:10.798765 (+ 3144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:10.798774 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:10.798790 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:10.798822 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:10.800536 (+ 1714us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:10.801011 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:10.801017 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:10.801018 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:10.801095 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:10.801386 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:10.801389 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:10.801391 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:10.801659 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:10.801884 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:10.802059 (+ 175us) server_negotiation.cc:299] Negotiation successful
0808 14:34:10.802239 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":57,"server-negotiator.queue_time_us":270,"spinlock_wait_cycles":7040,"thread_start_us":92,"threads_started":1}
I20260808 14:34:10.805138 22032 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36145 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:34:10 dist-test-slave-twwt krb5kdc[21195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199650, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.131.253@KRBTEST.COM for oryx/127.11.131.253@KRBTEST.COM
I20260808 14:34:10.813086 22037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:10.805716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51244 (local address 127.11.131.253:36145)
0808 14:34:10.805877 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:10.805880 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:10.805893 (+ 13us) server_negotiation.cc:407] Connection header received
0808 14:34:10.805995 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:10.805999 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:10.806036 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:10.806125 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:10.806483 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:10.807058 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:10.807812 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:10.808045 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:10.808153 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:10.810135 (+ 1982us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:10.810139 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:10.810141 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:10.810163 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:10.811516 (+ 1353us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:10.811935 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:10.811941 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:10.811942 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:10.812026 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:10.812290 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:10.812294 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:10.812295 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:10.812461 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:10.812566 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:10.812816 (+ 250us) server_negotiation.cc:299] Negotiation successful
0808 14:34:10.812960 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":44,"server-negotiator.queue_time_us":94}
I20260808 14:34:10.813086 22034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:10.805661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.253:36145 (local address 127.0.0.1:51244)
0808 14:34:10.805751 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:10.805816 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:10.805896 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:10.806136 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:10.806139 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:10.806294 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:10.806377 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:10.806382 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:10.807178 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:10.807181 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:10.807670 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:10.807677 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:10.808152 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:10.808155 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:10.808247 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:10.808714 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:10.808726 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:10.810004 (+ 1278us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:10.811642 (+ 1638us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:10.811648 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:10.811650 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:10.811842 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:10.812116 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:10.812120 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:10.812122 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:10.812199 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:10.812555 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:10.812558 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:10.812647 (+ 89us) client_negotiation.cc:769] Sending connection context
0808 14:34:10.812763 (+ 116us) client_negotiation.cc:240] Negotiation successful
0808 14:34:10.812903 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260808 14:34:10.816699 22032 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9: Bootstrap starting.
I20260808 14:34:10.819146 22032 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9: Neither blocks nor log segments found. Creating new log.
I20260808 14:34:10.819885 22032 log.cc:824] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9: Log is configured to *not* fsync() on all Append() calls
I20260808 14:34:10.821861 22032 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9: No bootstrap required, opened a new log
I20260808 14:34:10.824965 22032 raft_consensus.cc:348] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36145 } }
I20260808 14:34:10.825202 22032 raft_consensus.cc:374] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:34:10.825239 22032 raft_consensus.cc:729] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a29b80ba4b4376b671b2f015f6c5f9, State: Initialized, Role: FOLLOWER
I20260808 14:34:10.825631 22032 consensus_queue.cc:260] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36145 } }
I20260808 14:34:10.826181 22041 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36145 } } }
I20260808 14:34:10.826335 22041 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:34:10.827080 22032 sys_catalog.cc:564] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [sys.catalog]: configured and running, proceeding with master startup.
W20260808 14:34:10.832321 22056 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:34:10.832440 22056 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:34:10.835012 21935 master_runner.cc:428] Detected that this master f8a29b80ba4b4376b671b2f015f6c5f9 is joining an existing cluster
I20260808 14:34:10.835094 21935 master_runner.cc:432] Initiating AddMaster RPC to add 127.11.131.253:36145
I20260808 14:34:10.846509 22066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:10.837346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.253:36145 (local address 127.0.0.1:51258)
0808 14:34:10.838797 (+ 1451us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:10.838808 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:10.838915 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:10.839159 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:10.839162 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:10.839352 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:10.839443 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:10.839449 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:10.840144 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:10.840149 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:10.840755 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:10.840765 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:10.841331 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:10.841336 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:10.841450 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:10.842086 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:10.842105 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:10.842707 (+ 602us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:10.844858 (+ 2151us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:10.844861 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:10.844863 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:10.845127 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:10.845443 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:10.845447 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:10.845449 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:10.845530 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:10.845939 (+ 409us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:10.845942 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:10.846034 (+ 92us) client_negotiation.cc:769] Sending connection context
0808 14:34:10.846132 (+ 98us) client_negotiation.cc:240] Negotiation successful
0808 14:34:10.846266 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1386,"spinlock_wait_cycles":768,"thread_start_us":108,"threads_started":1}
I20260808 14:34:10.846544 22037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:10.837749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51258 (local address 127.11.131.253:36145)
0808 14:34:10.837872 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:10.837879 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:10.838880 (+ 1001us) server_negotiation.cc:407] Connection header received
0808 14:34:10.838999 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:10.839003 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:10.839046 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:10.839128 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:10.839555 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:10.840036 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:10.840879 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:10.841203 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:10.841316 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:10.842872 (+ 1556us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:10.842876 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:10.842879 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:10.842905 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:10.844719 (+ 1814us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:10.845217 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:10.845220 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:10.845222 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:10.845331 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:10.845635 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:10.845640 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:10.845642 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:10.845859 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:10.845963 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:10.846211 (+ 248us) server_negotiation.cc:299] Negotiation successful
0808 14:34:10.846332 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 14:34:10.846948 21318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:10.837760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57692 (local address 127.11.131.254:38851)
0808 14:34:10.837893 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:10.837898 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:10.837913 (+ 15us) server_negotiation.cc:407] Connection header received
0808 14:34:10.837960 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:10.837963 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:10.838016 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:10.838104 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:10.838587 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:10.839468 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:10.840703 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:10.841006 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:10.841130 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:10.843252 (+ 2122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:10.843255 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:10.843258 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:10.843292 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:10.844873 (+ 1581us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:10.845443 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:10.845447 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:10.845449 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:10.845542 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:10.845892 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:10.845899 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:10.845904 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:10.846150 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:10.846249 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:10.846595 (+ 346us) server_negotiation.cc:299] Negotiation successful
0808 14:34:10.846762 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 14:34:10.847424 22064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:10.837233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:38851 (local address 127.0.0.1:57692)
0808 14:34:10.837536 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:10.837555 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:10.837659 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:10.838136 (+ 477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:10.838138 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:10.838335 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:10.838463 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:10.838470 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:10.839615 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:10.839619 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:10.840564 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:10.840576 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:10.841158 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:10.841162 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:10.841250 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:10.842649 (+ 1399us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:10.842664 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:10.843112 (+ 448us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:10.845012 (+ 1900us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:10.845016 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:10.845018 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:10.845349 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:10.845656 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:10.845659 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:10.845661 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:10.845782 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:10.846296 (+ 514us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:10.846302 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:10.846385 (+ 83us) client_negotiation.cc:769] Sending connection context
0808 14:34:10.847097 (+ 712us) client_negotiation.cc:240] Negotiation successful
0808 14:34:10.847241 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":131,"threads_started":1}
Aug 08 14:34:10 dist-test-slave-twwt krb5kdc[21195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199649, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.131.254@KRBTEST.COM for oryx/127.11.131.253@KRBTEST.COM
I20260808 14:34:10.862047 22067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:10.852100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.253:36145 (local address 127.0.0.1:51268)
0808 14:34:10.852481 (+ 381us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:10.852524 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:10.852696 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:10.853050 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:10.853056 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:10.853435 (+ 379us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:10.853547 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:10.853553 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:10.854293 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:10.854298 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:10.855019 (+ 721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:10.855029 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:10.855499 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:10.855503 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:10.855614 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:10.856200 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:10.856212 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:10.858077 (+ 1865us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:10.859930 (+ 1853us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:10.859939 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:10.859947 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:10.860190 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:10.860508 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:10.860512 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:10.860514 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:10.860650 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:10.861218 (+ 568us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:10.861227 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:10.861381 (+ 154us) client_negotiation.cc:769] Sending connection context
0808 14:34:10.861550 (+ 169us) client_negotiation.cc:240] Negotiation successful
0808 14:34:10.861802 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":115,"threads_started":1}
I20260808 14:34:10.862761 22037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:10.852140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51268 (local address 127.11.131.253:36145)
0808 14:34:10.852270 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:10.852275 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:10.852606 (+ 331us) server_negotiation.cc:407] Connection header received
0808 14:34:10.852859 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:10.852862 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:10.852921 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:10.853010 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:10.853672 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:10.854172 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:10.855147 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:10.855378 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:10.855515 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:10.858223 (+ 2708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:10.858227 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:10.858231 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:10.858259 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:10.859764 (+ 1505us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:10.860322 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:10.860326 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:10.860327 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:10.860408 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:10.860784 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:10.860790 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:10.860793 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:10.861056 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:10.861154 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:10.862294 (+ 1140us) server_negotiation.cc:299] Negotiation successful
0808 14:34:10.862516 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 14:34:10.864209 21262 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.11.131.253:36145: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9"
member_type: NON_VOTER
last_known_addr {
host: "127.11.131.253"
port: 36145
}
attrs {
promote: true
}
}
dest_uuid: "18af051302ab4a05a7b6b26e56688462"
cas_config_opid_index: -1
I20260808 14:34:10.865130 21262 consensus_queue.cc:237] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: NON_VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: true } }
I20260808 14:34:10.867508 22072 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER f8a29b80ba4b4376b671b2f015f6c5f9 (127.11.131.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: NON_VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: true } } }
I20260808 14:34:10.868585 21997 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:34:10.869714 22072 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.11.131.253:36145
WARNING: no policy specified for oryx/127.11.131.252@KRBTEST.COM; defaulting to no policy
I20260808 14:34:10.870239 21997 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [term 1 FOLLOWER]: Refusing update from remote peer 18af051302ab4a05a7b6b26e56688462: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260808 14:34:10.870396 21935 master.cc:537] Master@127.11.131.253:36145 shutting down...
I20260808 14:34:10.870517 22074 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "18af051302ab4a05a7b6b26e56688462" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: NON_VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: true } } }
I20260808 14:34:10.870915 22074 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462 [sys.catalog]: This master's current role is: LEADER
I20260808 14:34:10.871248 22074 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: NON_VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 14:34:10.873234 21244 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260808 14:34:10.874291 21244 consensus_peers.cc:487] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462 -> Peer f8a29b80ba4b4376b671b2f015f6c5f9 (127.11.131.253:36145): Couldn't send request to peer f8a29b80ba4b4376b671b2f015f6c5f9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.131.252@KRBTEST.COM" created.
I20260808 14:34:10.878319 21935 raft_consensus.cc:2229] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:34:10.878715 21935 raft_consensus.cc:2258] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:34:10.878891 21935 tablet_replica.cc:330] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9: stopping tablet replica
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.131.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.252.keytab.
Entry for principal oryx/127.11.131.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.252.keytab.
I20260808 14:34:10.894443 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.252:39635
--webserver_interface=127.11.131.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.252.keytab
--principal=oryx/127.11.131.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:46739
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:38851,127.11.131.253:36145,127.11.131.252:39635
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:34:10.895740 21935 master.cc:552] Master@127.11.131.253:36145 shutdown complete.
I20260808 14:34:10.895807 21935 master_runner.cc:305] Clearing existing system tablet
I20260808 14:34:10.896091 21935 fs_manager.cc:359] Metadata directory not provided
I20260808 14:34:10.896154 21935 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:34:10.897435 21935 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 14:34:10.898324 22083 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:10.898561 21935 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:34:10.898758 21935 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:34:10.898800 21935 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-1/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-1/wal
uuid: "f8a29b80ba4b4376b671b2f015f6c5f9"
format_stamp: "Formatted at 2026-08-08 14:34:10 on dist-test-slave-twwt"
server_key: "a1a33030af42de8abccced0c412a3155"
server_key_iv: "40463b1e4c8c3ae2fdde99eebb77ff3f"
server_key_version: "encryptionkey@0"
I20260808 14:34:10.900720 21935 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:34:10.902777 21935 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 14:34:10.902889 21935 log.cc:1196] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260808 14:34:10.903144 21935 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9: Deleting consensus metadata
I20260808 14:34:10.903362 21935 master_runner.cc:315] Copying system tablet from 127.11.131.254:38851
I20260808 14:34:10.904806 21935 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9: tablet copy: Beginning tablet copy session from remote peer at address 127.11.131.254:38851
I20260808 14:34:10.915879 21318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:10.907667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57694 (local address 127.11.131.254:38851)
0808 14:34:10.907810 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:10.907816 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:10.908083 (+ 267us) server_negotiation.cc:407] Connection header received
0808 14:34:10.908345 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:10.908349 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:10.908410 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:10.908470 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:10.909233 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:10.910058 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:10.911053 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:10.911288 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:10.911401 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:10.912610 (+ 1209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:10.912614 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:10.912617 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:10.912644 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:10.914161 (+ 1517us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:10.914602 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:10.914634 (+ 32us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:10.914636 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:10.914724 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:10.915013 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:10.915018 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:10.915020 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:10.915205 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:10.915319 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:10.915587 (+ 268us) server_negotiation.cc:299] Negotiation successful
0808 14:34:10.915703 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 14:34:10.915889 22091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:10.907130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:38851 (local address 127.0.0.1:57694)
0808 14:34:10.907983 (+ 853us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:10.907997 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:10.908179 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:10.908636 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:10.908639 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:10.908914 (+ 275us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:10.909079 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:10.909088 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:10.910222 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:10.910226 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:10.910922 (+ 696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:10.910931 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:10.911407 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:10.911410 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:10.911506 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:10.912115 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:10.912128 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:10.912467 (+ 339us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:10.914286 (+ 1819us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:10.914290 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:10.914292 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:10.914498 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:10.914823 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:10.914826 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:10.914829 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:10.914920 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:10.915312 (+ 392us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:10.915315 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:10.915421 (+ 106us) client_negotiation.cc:769] Sending connection context
0808 14:34:10.915531 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 14:34:10.915683 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":768,"thread_start_us":91,"threads_started":1}
I20260808 14:34:10.916834 21289 tablet_copy_service.cc:140] P 18af051302ab4a05a7b6b26e56688462: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer f8a29b80ba4b4376b671b2f015f6c5f9 ({username='oryx', principal='oryx/127.11.131.253@KRBTEST.COM'} at 127.0.0.1:57694)
I20260808 14:34:10.917037 21289 tablet_copy_service.cc:161] P 18af051302ab4a05a7b6b26e56688462: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer f8a29b80ba4b4376b671b2f015f6c5f9 at {username='oryx', principal='oryx/127.11.131.253@KRBTEST.COM'} at 127.0.0.1:57694: session id = f8a29b80ba4b4376b671b2f015f6c5f9-00000000000000000000000000000000
I20260808 14:34:10.918948 21289 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 14:34:10.920733 21935 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 14:34:10.922935 21935 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9: tablet copy: Starting download of 0 data blocks...
I20260808 14:34:10.923158 21935 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9: tablet copy: Starting download of 1 WAL segments...
I20260808 14:34:10.925014 21935 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 14:34:10.926873 21289 tablet_copy_service.cc:342] P 18af051302ab4a05a7b6b26e56688462: Request end of tablet copy session f8a29b80ba4b4376b671b2f015f6c5f9-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.11.131.253@KRBTEST.COM'} at 127.0.0.1:57694
I20260808 14:34:10.926996 21289 tablet_copy_service.cc:433] P 18af051302ab4a05a7b6b26e56688462: ending tablet copy session f8a29b80ba4b4376b671b2f015f6c5f9-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer f8a29b80ba4b4376b671b2f015f6c5f9
I20260808 14:34:10.934535 21935 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:34:10.936352 22102 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:10.936329 22092 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:10.936856 22093 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:10.937021 21935 server_base.cc:1034] running on GCE node
I20260808 14:34:10.937223 21935 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:34:10.937556 21935 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:34:10.938658 21935 hybrid_clock.cc:648] HybridClock initialized: now 1786199650938667 us; error 42 us; skew 500 ppm
Aug 08 14:34:10 dist-test-slave-twwt krb5kdc[21195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199650, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.131.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:34:10.940191 21935 init.cc:377] Logged in from keytab as oryx/127.11.131.253@KRBTEST.COM (short username oryx)
I20260808 14:34:10.940734 21935 webserver.cc:460] Webserver started at http://127.11.131.253:35769/ using document root <none> and password file <none>
I20260808 14:34:10.940953 21935 fs_manager.cc:359] Metadata directory not provided
I20260808 14:34:10.941009 21935 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:34:10.942145 21935 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:34:10.943223 22110 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:10.943506 21935 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 14:34:10.943600 21935 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-1/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-1/wal
uuid: "f8a29b80ba4b4376b671b2f015f6c5f9"
format_stamp: "Formatted at 2026-08-08 14:34:10 on dist-test-slave-twwt"
server_key: "a1a33030af42de8abccced0c412a3155"
server_key_iv: "40463b1e4c8c3ae2fdde99eebb77ff3f"
server_key_version: "encryptionkey@0"
I20260808 14:34:10.943713 21935 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:34:10.954998 21935 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:34:10.957001 21935 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:34:10.962044 21935 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.253:36145
I20260808 14:34:10.962883 21935 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-1/data/info.pb
I20260808 14:34:10.964497 22177 sys_catalog.cc:263] Verifying existing consensus state
I20260808 14:34:10.965329 22177 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9: Bootstrap starting.
I20260808 14:34:10.970745 22176 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.253:36145 every 8 connection(s)
I20260808 14:34:10.973469 22177 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:34:10.973783 22177 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9: Bootstrap complete.
I20260808 14:34:10.974458 22177 raft_consensus.cc:348] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: NON_VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: true } }
I20260808 14:34:10.974592 22177 raft_consensus.cc:729] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f8a29b80ba4b4376b671b2f015f6c5f9, State: Initialized, Role: LEARNER
I20260808 14:34:10.974725 22177 consensus_queue.cc:260] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: NON_VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: true } }
I20260808 14:34:10.975212 22177 sys_catalog.cc:564] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:34:10.978331 22198 catalog_manager.cc:1259] Loaded cluster ID: 54a60cc90df341f0b548154a83c2ced5
I20260808 14:34:10.978427 22198 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9: loading cluster ID for follower catalog manager: success
I20260808 14:34:10.980203 22198 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9: acquiring CA information for follower catalog manager: success
I20260808 14:34:10.981448 22198 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 14:34:10.982801 22182 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: NON_VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: true } } }
I20260808 14:34:10.982929 22182 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [sys.catalog]: This master's current role is: LEARNER
W20260808 14:34:11.055101 22081 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:34:11.055382 22081 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:34:11.055423 22081 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:34:11.059484 22081 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:34:11.059572 22081 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:34:11.059608 22081 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:34:11.059639 22081 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:34:11.059659 22081 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:34:11.065088 22081 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:46739
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:38851,127.11.131.253:36145,127.11.131.252:39635
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.252.keytab
--principal=oryx/127.11.131.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.252:39635
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.131.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22081
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:34:11.066165 22081 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:34:11.067242 22081 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:34:11.075948 22205 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:11.075961 22204 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:11.076023 22081 server_base.cc:1034] running on GCE node
W20260808 14:34:11.075963 22209 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:11.076951 22081 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:34:11.078143 22081 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:34:11.079371 22081 hybrid_clock.cc:648] HybridClock initialized: now 1786199651079336 us; error 46 us; skew 500 ppm
Aug 08 14:34:11 dist-test-slave-twwt krb5kdc[21195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199651, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.131.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:34:11.082386 22081 init.cc:377] Logged in from keytab as oryx/127.11.131.252@KRBTEST.COM (short username oryx)
I20260808 14:34:11.083482 21534 heartbeater.cc:503] Master 127.11.131.254:38851 was elected leader, sending a full tablet report...
I20260808 14:34:11.083549 22081 webserver.cc:460] Webserver started at http://127.11.131.252:34343/ using document root <none> and password file <none>
I20260808 14:34:11.084157 22081 fs_manager.cc:359] Metadata directory not provided
I20260808 14:34:11.084281 22081 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:34:11.084522 22081 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:34:11.086894 22081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-2/data/instance:
uuid: "b4a11c28fe8a4334a428d2a865e69e7b"
format_stamp: "Formatted at 2026-08-08 14:34:11 on dist-test-slave-twwt"
server_key: "b95571a785e3f05e4bb2cea9eb8c8a9a"
server_key_iv: "9941a9ddd2569e270c5e31362ec2ba0c"
server_key_version: "encryptionkey@0"
I20260808 14:34:11.087446 22081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-2/wal/instance:
uuid: "b4a11c28fe8a4334a428d2a865e69e7b"
format_stamp: "Formatted at 2026-08-08 14:34:11 on dist-test-slave-twwt"
server_key: "b95571a785e3f05e4bb2cea9eb8c8a9a"
server_key_iv: "9941a9ddd2569e270c5e31362ec2ba0c"
server_key_version: "encryptionkey@0"
I20260808 14:34:11.091289 22081 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 14:34:11.093894 22218 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:11.095247 22081 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 14:34:11.095382 22081 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-2/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-2/wal
uuid: "b4a11c28fe8a4334a428d2a865e69e7b"
format_stamp: "Formatted at 2026-08-08 14:34:11 on dist-test-slave-twwt"
server_key: "b95571a785e3f05e4bb2cea9eb8c8a9a"
server_key_iv: "9941a9ddd2569e270c5e31362ec2ba0c"
server_key_version: "encryptionkey@0"
I20260808 14:34:11.095495 22081 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:34:11.132557 22081 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:34:11.135960 22081 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:34:11.136190 22081 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:34:11.144300 22081 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.252:39635
I20260808 14:34:11.144618 22297 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.252:39635 every 8 connection(s)
I20260808 14:34:11.145429 22081 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-2/data/info.pb
I20260808 14:34:11.148343 22298 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:34:11.152298 22298 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:34:11.154093 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 22081
Aug 08 14:34:11 dist-test-slave-twwt krb5kdc[21195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199651, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.131.252@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM
Aug 08 14:34:11 dist-test-slave-twwt krb5kdc[21195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199649, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.131.252@KRBTEST.COM
I20260808 14:34:11.166641 21318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:11.154504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57698 (local address 127.11.131.254:38851)
0808 14:34:11.154673 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:11.154678 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:11.155605 (+ 927us) server_negotiation.cc:407] Connection header received
0808 14:34:11.156616 (+ 1011us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:11.156619 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:11.156680 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:11.156783 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:11.157693 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.158239 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.159307 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.159538 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.159650 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:11.162466 (+ 2816us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:11.162473 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:11.162478 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:11.162514 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:11.164118 (+ 1604us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:11.164696 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:11.164699 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:11.164700 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:11.164778 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:11.165171 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:11.165178 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:11.165179 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:11.165454 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:11.165547 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:11.166269 (+ 722us) server_negotiation.cc:299] Negotiation successful
0808 14:34:11.166426 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 14:34:11.167752 22300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:11.154917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:38851 (local address 127.0.0.1:57698)
0808 14:34:11.155447 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:11.155507 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:11.156408 (+ 901us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:11.156838 (+ 430us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:11.156848 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:11.157210 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:11.157545 (+ 335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:11.157558 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.158387 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.158389 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:11.159179 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:11.159189 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.159692 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.159696 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:11.159957 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:11.160587 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:11.160612 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:11.162285 (+ 1673us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:11.164234 (+ 1949us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:11.164245 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:11.164265 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:11.164595 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:11.164875 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:11.164879 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:11.164881 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:11.165073 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:11.165569 (+ 496us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:11.165576 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:11.165962 (+ 386us) client_negotiation.cc:769] Sending connection context
0808 14:34:11.166193 (+ 231us) client_negotiation.cc:240] Negotiation successful
0808 14:34:11.166589 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"mutex_wait_us":42,"thread_start_us":139,"threads_started":1}
I20260808 14:34:11.167760 22301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:11.155209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45322 (local address 127.11.131.252:39635)
0808 14:34:11.155628 (+ 419us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:11.155644 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:11.155684 (+ 40us) server_negotiation.cc:407] Connection header received
0808 14:34:11.156437 (+ 753us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:11.156468 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:11.156666 (+ 198us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:11.156922 (+ 256us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:11.157802 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.158731 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.159575 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.160028 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.160148 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:11.162916 (+ 2768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:11.162924 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:11.162941 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:11.162968 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:11.164993 (+ 2025us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:11.165485 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:11.165490 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:11.165491 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:11.165601 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:11.165872 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:11.165876 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:11.165878 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:11.166153 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:11.166340 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:11.166575 (+ 235us) server_negotiation.cc:299] Negotiation successful
0808 14:34:11.166737 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":41,"server-negotiator.queue_time_us":334,"thread_start_us":150,"threads_started":1}
I20260808 14:34:11.169157 22298 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36145 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:34:11 dist-test-slave-twwt krb5kdc[21195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199651, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.131.252@KRBTEST.COM for oryx/127.11.131.253@KRBTEST.COM
I20260808 14:34:11.178459 22300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:11.169674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.253:36145 (local address 127.0.0.1:51270)
0808 14:34:11.169801 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:11.169817 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:11.169894 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:11.170389 (+ 495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:11.170392 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:11.170578 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:11.170750 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:11.170757 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.171679 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.171684 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:11.172260 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:11.172269 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.172763 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.172766 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:11.172873 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:11.173356 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:11.173368 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:11.174666 (+ 1298us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:11.176883 (+ 2217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:11.176886 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:11.176887 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:11.177094 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:11.177470 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:11.177473 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:11.177474 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:11.177578 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:11.177976 (+ 398us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:11.177979 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:11.178077 (+ 98us) client_negotiation.cc:769] Sending connection context
0808 14:34:11.178172 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 14:34:11.178310 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260808 14:34:11.178484 22302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:11.169809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51270 (local address 127.11.131.253:36145)
0808 14:34:11.170113 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:11.170117 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:11.170129 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:34:11.170167 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:11.170169 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:11.170253 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:11.170376 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:11.170872 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.171560 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.172388 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.172641 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.172775 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:11.174815 (+ 2040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:11.174819 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:11.174821 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:11.174847 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:11.176757 (+ 1910us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:11.177198 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:11.177200 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:11.177201 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:11.177282 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:11.177675 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:11.177678 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:11.177679 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:11.177878 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:11.177958 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:11.178229 (+ 271us) server_negotiation.cc:299] Negotiation successful
0808 14:34:11.178353 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232,"thread_start_us":100,"threads_started":1}
I20260808 14:34:11.179479 22298 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.131.252" port: 39635 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:34:11 dist-test-slave-twwt krb5kdc[21195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199651, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.131.252@KRBTEST.COM for oryx/127.11.131.252@KRBTEST.COM
I20260808 14:34:11.187395 22300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:11.180052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.252:39635 (local address 127.0.0.1:45334)
0808 14:34:11.180205 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:11.180219 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:11.180291 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:11.180503 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:11.180505 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:11.180644 (+ 139us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:11.180720 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:11.180725 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.181484 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.181486 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:11.182023 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:11.182031 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.182489 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.182492 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:11.182557 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:11.183065 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:11.183077 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:11.184362 (+ 1285us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:11.186068 (+ 1706us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:11.186071 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:11.186072 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:11.186261 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:11.186517 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:11.186519 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:11.186520 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:11.186650 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:11.187000 (+ 350us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:11.187002 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:11.187080 (+ 78us) client_negotiation.cc:769] Sending connection context
0808 14:34:11.187160 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 14:34:11.187261 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60}
I20260808 14:34:11.187434 22301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:11.180191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45334 (local address 127.11.131.252:39635)
0808 14:34:11.180313 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:11.180316 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:11.180348 (+ 32us) server_negotiation.cc:407] Connection header received
0808 14:34:11.180377 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:11.180380 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:11.180413 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:11.180469 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:11.180849 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.181370 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.182122 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.182369 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.182447 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:11.184494 (+ 2047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:11.184497 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:11.184499 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:11.184520 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:11.185960 (+ 1440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:11.186360 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:11.186362 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:11.186363 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:11.186436 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:11.186741 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:11.186744 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:11.186745 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:11.186915 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:11.186992 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:11.187218 (+ 226us) server_negotiation.cc:299] Negotiation successful
0808 14:34:11.187311 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 14:34:11.191776 22298 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b: Bootstrap starting.
I20260808 14:34:11.195107 22298 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b: Neither blocks nor log segments found. Creating new log.
I20260808 14:34:11.196130 22298 log.cc:824] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b: Log is configured to *not* fsync() on all Append() calls
I20260808 14:34:11.201329 22298 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b: No bootstrap required, opened a new log
I20260808 14:34:11.205022 22298 raft_consensus.cc:348] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36145 } } peers { permanent_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 39635 } }
I20260808 14:34:11.205260 22298 raft_consensus.cc:374] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:34:11.205351 22298 raft_consensus.cc:729] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4a11c28fe8a4334a428d2a865e69e7b, State: Initialized, Role: FOLLOWER
I20260808 14:34:11.205840 22298 consensus_queue.cc:260] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36145 } } peers { permanent_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 39635 } }
I20260808 14:34:11.206403 22307 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36145 } } peers { permanent_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 39635 } } }
I20260808 14:34:11.206562 22307 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:34:11.207293 22298 sys_catalog.cc:564] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [sys.catalog]: configured and running, proceeding with master startup.
W20260808 14:34:11.212556 22324 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:34:11.212677 22324 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:34:11.216619 22081 master_runner.cc:428] Detected that this master b4a11c28fe8a4334a428d2a865e69e7b is joining an existing cluster
I20260808 14:34:11.216701 22081 master_runner.cc:432] Initiating AddMaster RPC to add 127.11.131.252:39635
I20260808 14:34:11.221482 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 21347
I20260808 14:34:11.233352 21318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:11.218923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57706 (local address 127.11.131.254:38851)
0808 14:34:11.219195 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:11.219200 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:11.219487 (+ 287us) server_negotiation.cc:407] Connection header received
0808 14:34:11.219699 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:11.219703 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:11.219757 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:11.219818 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:11.220567 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.221273 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.222804 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.223292 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.223407 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:11.226142 (+ 2735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:11.226151 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:11.226157 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:11.226196 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:11.228610 (+ 2414us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:11.229288 (+ 678us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:11.229295 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:11.229300 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:11.229452 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:11.231846 (+ 2394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:11.231853 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:11.231858 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:11.232185 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:11.232285 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:11.232878 (+ 593us) server_negotiation.cc:299] Negotiation successful
0808 14:34:11.233066 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":193}
I20260808 14:34:11.234162 22332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:11.218845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:38851 (local address 127.0.0.1:57706)
0808 14:34:11.219406 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:11.219421 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:11.219571 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:11.219990 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:11.219993 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:11.220250 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:11.220436 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:11.220443 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.221429 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.221432 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:11.222641 (+ 1209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:11.222658 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.224212 (+ 1554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.224219 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:11.224389 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:11.225157 (+ 768us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:11.225177 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:11.225885 (+ 708us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:11.228783 (+ 2898us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:11.228789 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:11.228794 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:11.229137 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:11.231558 (+ 2421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:11.231564 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:11.231569 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:11.231701 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:11.232395 (+ 694us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:11.232400 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:11.232585 (+ 185us) client_negotiation.cc:769] Sending connection context
0808 14:34:11.233624 (+ 1039us) client_negotiation.cc:240] Negotiation successful
0808 14:34:11.233851 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":135,"threads_started":1}
I20260808 14:34:11.253618 22301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:11.219551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45338 (local address 127.11.131.252:39635)
0808 14:34:11.219665 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:11.219670 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:11.220190 (+ 520us) server_negotiation.cc:407] Connection header received
0808 14:34:11.220347 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:11.220350 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:11.220388 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:11.220434 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:11.244247 (+ 23813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.244980 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.247113 (+ 2133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.247449 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.247518 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:11.249590 (+ 2072us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:11.249594 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:11.249597 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:11.249618 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:11.251923 (+ 2305us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:11.252394 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:11.252397 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:11.252399 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:11.252467 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:11.252729 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:11.252732 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:11.252734 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:11.252938 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:11.253006 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:11.253315 (+ 309us) server_negotiation.cc:299] Negotiation successful
0808 14:34:11.253441 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 14:34:11.254151 22334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:11.219449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.252:39635 (local address 127.0.0.1:45338)
0808 14:34:11.220112 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:11.220125 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:11.220256 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:11.220554 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:11.220556 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:11.221505 (+ 949us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:11.242803 (+ 21298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:11.242818 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.245100 (+ 2282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.245103 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:11.245976 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:11.245986 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.247673 (+ 1687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.247676 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:11.247779 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:11.248950 (+ 1171us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:11.248963 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:11.249451 (+ 488us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:11.252040 (+ 2589us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:11.252043 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:11.252046 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:11.252296 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:11.252555 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:11.252558 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:11.252560 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:11.252631 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:11.253061 (+ 430us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:11.253063 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:11.253151 (+ 88us) client_negotiation.cc:769] Sending connection context
0808 14:34:11.253833 (+ 682us) client_negotiation.cc:240] Negotiation successful
0808 14:34:11.253974 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":599,"thread_start_us":96,"threads_started":1}
Aug 08 14:34:11 dist-test-slave-twwt krb5kdc[21195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199649, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.131.254@KRBTEST.COM for oryx/127.11.131.252@KRBTEST.COM
I20260808 14:34:11.266376 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.193:42373
--local_ip_for_outbound_sockets=127.11.131.193
--tserver_master_addrs=127.11.131.254:38851
--webserver_port=45281
--webserver_interface=127.11.131.193
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.193.keytab
--principal=oryx/127.11.131.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:46739
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.11.131.254:38851,127.11.131.253:36145
--tserver_master_addrs=127.11.131.254:38851,127.11.131.253:36145,127.11.131.252:39635 with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:34:11.268639 22307 raft_consensus.cc:482] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:34:11.268862 22307 raft_consensus.cc:504] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36145 } } peers { permanent_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 39635 } }
I20260808 14:34:11.270076 22307 leader_election.cc:288] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18af051302ab4a05a7b6b26e56688462 (127.11.131.254:38851), f8a29b80ba4b4376b671b2f015f6c5f9 (127.11.131.253:36145)
I20260808 14:34:11.270488 21277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18af051302ab4a05a7b6b26e56688462" is_pre_election: true
I20260808 14:34:11.270737 22144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" is_pre_election: true
I20260808 14:34:11.270954 22144 raft_consensus.cc:1799] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [term 1 LEARNER]: Handling vote request from an unknown peer b4a11c28fe8a4334a428d2a865e69e7b
I20260808 14:34:11.271183 22144 raft_consensus.cc:2396] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [term 1 LEARNER]: Leader pre-election vote request: Denying vote to candidate b4a11c28fe8a4334a428d2a865e69e7b for term 1 because replica has last-logged OpId of term: 1 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260808 14:34:11.272652 22222 leader_election.cc:302] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b4a11c28fe8a4334a428d2a865e69e7b; no voters: 18af051302ab4a05a7b6b26e56688462, f8a29b80ba4b4376b671b2f015f6c5f9
I20260808 14:34:11.273605 22307 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:34:11.276721 22333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:11.218935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.253:36145 (local address 127.0.0.1:51276)
0808 14:34:11.219740 (+ 805us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:11.219753 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:11.219855 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:11.220258 (+ 403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:11.220262 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:11.221031 (+ 769us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:11.221168 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:11.221177 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.244023 (+ 22846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.244026 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:11.246973 (+ 2947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:11.246984 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.248703 (+ 1719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.248706 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:11.248807 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:11.271840 (+ 23033us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:11.271857 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:11.272298 (+ 441us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:11.274794 (+ 2496us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:11.274819 (+ 25us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:11.274821 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:11.275168 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:11.275485 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:11.275491 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:11.275495 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:11.275603 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:11.276175 (+ 572us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:11.276178 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:11.276295 (+ 117us) client_negotiation.cc:769] Sending connection context
0808 14:34:11.276384 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 14:34:11.276532 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":747,"thread_start_us":101,"threads_started":1}
I20260808 14:34:11.277334 22302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:11.219051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51276 (local address 127.11.131.253:36145)
0808 14:34:11.219173 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:11.219178 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:11.219849 (+ 671us) server_negotiation.cc:407] Connection header received
0808 14:34:11.219938 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:11.219942 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:11.220000 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:11.220091 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:11.242992 (+ 22901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.243857 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.248053 (+ 4196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.248451 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.248537 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:11.272618 (+ 24081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:11.272623 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:11.272626 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:11.272657 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:11.274592 (+ 1935us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:11.275294 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:11.275297 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:11.275299 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:11.275386 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:11.275741 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:11.275744 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:11.275746 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:11.275977 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:11.276088 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:11.277042 (+ 954us) server_negotiation.cc:299] Negotiation successful
0808 14:34:11.277174 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 14:34:11.278132 22067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:11.257011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.252:39635 (local address 127.0.0.1:45348)
0808 14:34:11.257315 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:11.257333 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:11.257455 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:11.257885 (+ 430us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:11.257888 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:11.258099 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:11.258214 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:11.258222 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.259393 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.259400 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:11.260371 (+ 971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:11.260389 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.261002 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.261009 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:11.261153 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:11.261742 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:11.261762 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:11.263499 (+ 1737us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:11.276000 (+ 12501us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:11.276006 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:11.276011 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:11.276324 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:11.276734 (+ 410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:11.276739 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:11.276743 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:11.276849 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:11.277428 (+ 579us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:11.277433 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:11.277555 (+ 122us) client_negotiation.cc:769] Sending connection context
0808 14:34:11.277672 (+ 117us) client_negotiation.cc:240] Negotiation successful
0808 14:34:11.277872 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178}
I20260808 14:34:11.278738 22301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:11.257092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45348 (local address 127.11.131.252:39635)
0808 14:34:11.257200 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:11.257205 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:11.257411 (+ 206us) server_negotiation.cc:407] Connection header received
0808 14:34:11.257598 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:11.257601 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:11.257659 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:11.257738 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:11.258368 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.259241 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.260511 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.260860 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.260966 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:11.263651 (+ 2685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:11.263656 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:11.263658 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:11.263685 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:11.275781 (+ 12096us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:11.276493 (+ 712us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:11.276498 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:11.276500 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:11.276595 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:11.276981 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:11.276987 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:11.276990 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:11.277235 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:11.277342 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:11.278461 (+ 1119us) server_negotiation.cc:299] Negotiation successful
0808 14:34:11.278575 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 14:34:11.278987 22307 raft_consensus.cc:2726] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260808 14:34:11.279707 21262 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.11.131.252:39635: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "b4a11c28fe8a4334a428d2a865e69e7b"
member_type: NON_VOTER
last_known_addr {
host: "127.11.131.252"
port: 39635
}
attrs {
promote: true
}
}
dest_uuid: "18af051302ab4a05a7b6b26e56688462"
cas_config_opid_index: 5
I20260808 14:34:11.280465 21262 consensus_queue.cc:237] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: NON_VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: true } } peers { permanent_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" member_type: NON_VOTER last_known_addr { host: "127.11.131.252" port: 39635 } attrs { promote: true } }
I20260808 14:34:11.281798 22072 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER b4a11c28fe8a4334a428d2a865e69e7b (127.11.131.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: NON_VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: true } } peers { permanent_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" member_type: NON_VOTER last_known_addr { host: "127.11.131.252" port: 39635 } attrs { promote: true } } }
I20260808 14:34:11.282410 22264 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [term 1 FOLLOWER]: Refusing update from remote peer 18af051302ab4a05a7b6b26e56688462: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260808 14:34:11.283237 22074 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" member_type: NON_VOTER last_known_addr { host: "127.11.131.252" port: 39635 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:34:11.283474 22072 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.11.131.252:39635
I20260808 14:34:11.283806 22072 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "18af051302ab4a05a7b6b26e56688462" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: NON_VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: true } } peers { permanent_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" member_type: NON_VOTER last_known_addr { host: "127.11.131.252" port: 39635 } attrs { promote: true } } }
I20260808 14:34:11.283915 22072 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462 [sys.catalog]: This master's current role is: LEADER
I20260808 14:34:11.287302 22264 raft_consensus.cc:858] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [term 1 NON_PARTICIPANT]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36145 } } peers { permanent_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 39635 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: NON_VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: NON_VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: true } } peers { permanent_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" member_type: NON_VOTER last_known_addr { host: "127.11.131.252" port: 39635 } attrs { promote: true } }
W20260808 14:34:11.287426 22264 raft_consensus.cc:1565] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [term 1 NON_PARTICIPANT]: Could not prepare op 'term: 1 index: 6' and following 0 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36145 } } peers { permanent_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 39635 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: NON_VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: NON_VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: true } } peers { permanent_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" member_type: NON_VOTER last_known_addr { host: "127.11.131.252" port: 39635 } attrs { promote: true } }
I20260808 14:34:11.289024 22067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:11.281981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.253:36145 (local address 127.0.0.1:51286)
0808 14:34:11.284497 (+ 2516us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:11.284511 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:11.284593 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:11.284993 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:11.284996 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:11.285014 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:34:11.285102 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:11.285108 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.286143 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.286147 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:11.287442 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:11.287453 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.288592 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.288598 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:11.288708 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:11.288766 (+ 58us) client_negotiation.cc:769] Sending connection context
0808 14:34:11.288839 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 14:34:11.288905 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2452}
I20260808 14:34:11.288887 22264 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [term 1 NON_PARTICIPANT]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER f8a29b80ba4b4376b671b2f015f6c5f9 (127.11.131.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: NON_VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: true } } }
I20260808 14:34:11.289471 22302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:11.282881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51286 (local address 127.11.131.253:36145)
0808 14:34:11.284415 (+ 1534us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:11.284419 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:11.284670 (+ 251us) server_negotiation.cc:407] Connection header received
0808 14:34:11.284713 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:11.284716 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:11.284783 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:11.284868 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:34:11.285216 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.286010 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.287588 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.288248 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.288361 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:11.288513 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:11.289290 (+ 777us) server_negotiation.cc:299] Negotiation successful
0808 14:34:11.289361 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1452}
I20260808 14:34:11.289883 22144 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [term 1 LEARNER]: Refusing update from remote peer 18af051302ab4a05a7b6b26e56688462: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260808 14:34:11.290519 22337 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: NON_VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260808 14:34:11.290668 22307 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 18af051302ab4a05a7b6b26e56688462. Latest consensus state: current_term: 1 leader_uuid: "18af051302ab4a05a7b6b26e56688462" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: NON_VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: true } } }
I20260808 14:34:11.290797 22307 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260808 14:34:11.290884 22307 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "18af051302ab4a05a7b6b26e56688462" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: NON_VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: true } } }
I20260808 14:34:11.290948 22307 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260808 14:34:11.291006 22307 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "18af051302ab4a05a7b6b26e56688462" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: NON_VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: true } } }
I20260808 14:34:11.291064 22307 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260808 14:34:11.292347 22144 raft_consensus.cc:2932] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER b4a11c28fe8a4334a428d2a865e69e7b (127.11.131.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: NON_VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: true } } peers { permanent_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" member_type: NON_VOTER last_known_addr { host: "127.11.131.252" port: 39635 } attrs { promote: true } } }
I20260808 14:34:11.294376 22348 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "18af051302ab4a05a7b6b26e56688462" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: NON_VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: true } } peers { permanent_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" member_type: NON_VOTER last_known_addr { host: "127.11.131.252" port: 39635 } attrs { promote: true } } }
I20260808 14:34:11.294499 22348 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [sys.catalog]: This master's current role is: LEARNER
I20260808 14:34:11.294745 22182 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 18af051302ab4a05a7b6b26e56688462. Latest consensus state: current_term: 1 leader_uuid: "18af051302ab4a05a7b6b26e56688462" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: NON_VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: true } } peers { permanent_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" member_type: NON_VOTER last_known_addr { host: "127.11.131.252" port: 39635 } attrs { promote: true } } }
I20260808 14:34:11.294864 22182 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [sys.catalog]: This master's current role is: LEARNER
I20260808 14:34:11.295393 22081 master.cc:537] Master@127.11.131.252:39635 shutting down...
I20260808 14:34:11.295581 22340 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462: attempting to promote NON_VOTER f8a29b80ba4b4376b671b2f015f6c5f9 to VOTER
I20260808 14:34:11.295967 22340 consensus_queue.cc:237] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: false } } peers { permanent_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" member_type: NON_VOTER last_known_addr { host: "127.11.131.252" port: 39635 } attrs { promote: true } }
W20260808 14:34:11.299093 21244 consensus_peers.cc:487] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462 -> Peer b4a11c28fe8a4334a428d2a865e69e7b (127.11.131.252:39635): Couldn't send request to peer b4a11c28fe8a4334a428d2a865e69e7b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260808 14:34:11.299574 22341 mvcc.cc:205] Tried to move back new op lower bound from 7316273765612867584 to 7316273765473984512. Current Snapshot: MvccSnapshot[applied={T|T < 7316273765511524352}]
I20260808 14:34:11.301539 22144 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [term 1 LEARNER]: Refusing update from remote peer 18af051302ab4a05a7b6b26e56688462: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260808 14:34:11.302213 22074 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260808 14:34:11.303005 22081 raft_consensus.cc:2229] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20260808 14:34:11.303238 22081 raft_consensus.cc:2258] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
I20260808 14:34:11.303320 22081 tablet_replica.cc:330] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b: stopping tablet replica
I20260808 14:34:11.304031 22074 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, f8a29b80ba4b4376b671b2f015f6c5f9 (127.11.131.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: false } } peers { permanent_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" member_type: NON_VOTER last_known_addr { host: "127.11.131.252" port: 39635 } attrs { promote: true } } }
I20260808 14:34:11.304471 22143 raft_consensus.cc:2932] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, f8a29b80ba4b4376b671b2f015f6c5f9 (127.11.131.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: false } } peers { permanent_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" member_type: NON_VOTER last_known_addr { host: "127.11.131.252" port: 39635 } attrs { promote: true } } }
I20260808 14:34:11.305738 22340 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "18af051302ab4a05a7b6b26e56688462" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: false } } peers { permanent_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" member_type: NON_VOTER last_known_addr { host: "127.11.131.252" port: 39635 } attrs { promote: true } } }
I20260808 14:34:11.305842 22340 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462 [sys.catalog]: This master's current role is: LEADER
I20260808 14:34:11.306020 22074 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "18af051302ab4a05a7b6b26e56688462" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: false } } peers { permanent_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" member_type: NON_VOTER last_known_addr { host: "127.11.131.252" port: 39635 } attrs { promote: true } } }
I20260808 14:34:11.306054 22182 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "18af051302ab4a05a7b6b26e56688462" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: false } } peers { permanent_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" member_type: NON_VOTER last_known_addr { host: "127.11.131.252" port: 39635 } attrs { promote: true } } }
I20260808 14:34:11.306123 22074 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462 [sys.catalog]: This master's current role is: LEADER
I20260808 14:34:11.306167 22182 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:34:11.316363 21729 heartbeater.cc:503] Master 127.11.131.254:38851 was elected leader, sending a full tablet report...
I20260808 14:34:11.323860 22081 master.cc:552] Master@127.11.131.252:39635 shutdown complete.
I20260808 14:34:11.323939 22081 master_runner.cc:305] Clearing existing system tablet
I20260808 14:34:11.324182 22081 fs_manager.cc:359] Metadata directory not provided
I20260808 14:34:11.324261 22081 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:34:11.325374 22081 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 14:34:11.326427 22355 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:11.326741 22081 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:34:11.326905 22081 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 14:34:11.326944 22081 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-2/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-2/wal
uuid: "b4a11c28fe8a4334a428d2a865e69e7b"
format_stamp: "Formatted at 2026-08-08 14:34:11 on dist-test-slave-twwt"
server_key: "b95571a785e3f05e4bb2cea9eb8c8a9a"
server_key_iv: "9941a9ddd2569e270c5e31362ec2ba0c"
server_key_version: "encryptionkey@0"
I20260808 14:34:11.328439 22081 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:34:11.330384 22081 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 14:34:11.330494 22081 log.cc:1196] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260808 14:34:11.330816 22081 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b: Deleting consensus metadata
I20260808 14:34:11.331012 22081 master_runner.cc:315] Copying system tablet from 127.11.131.254:38851
I20260808 14:34:11.332158 22081 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b: tablet copy: Beginning tablet copy session from remote peer at address 127.11.131.254:38851
I20260808 14:34:11.340449 21318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:11.332848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57710 (local address 127.11.131.254:38851)
0808 14:34:11.332990 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:11.332997 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:11.333365 (+ 368us) server_negotiation.cc:407] Connection header received
0808 14:34:11.333568 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:11.333571 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:11.333634 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:11.333726 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:11.334175 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.334840 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.335656 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.335892 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.336001 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:11.337158 (+ 1157us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:11.337162 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:11.337165 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:11.337191 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:11.338764 (+ 1573us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:11.339201 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:11.339205 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:11.339207 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:11.339293 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:11.339583 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:11.339587 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:11.339588 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:11.339783 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:11.339894 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:11.340162 (+ 268us) server_negotiation.cc:299] Negotiation successful
0808 14:34:11.340279 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 14:34:11.340451 22362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:11.332972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:38851 (local address 127.0.0.1:57710)
0808 14:34:11.333249 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:11.333265 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:11.333453 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:11.333741 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:11.333744 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:11.333958 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:11.334052 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:11.334059 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.334951 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.334955 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:11.335528 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:11.335537 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.336018 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.336021 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:11.336116 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:11.336676 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:11.336689 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:11.337015 (+ 326us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:11.338875 (+ 1860us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:11.338880 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:11.338882 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:11.339097 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:11.339390 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:11.339393 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:11.339395 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:11.339487 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:11.339884 (+ 397us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:11.339887 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:11.339997 (+ 110us) client_negotiation.cc:769] Sending connection context
0808 14:34:11.340107 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 14:34:11.340279 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":122,"threads_started":1}
I20260808 14:34:11.341346 21289 tablet_copy_service.cc:140] P 18af051302ab4a05a7b6b26e56688462: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer b4a11c28fe8a4334a428d2a865e69e7b ({username='oryx', principal='oryx/127.11.131.252@KRBTEST.COM'} at 127.0.0.1:57710)
I20260808 14:34:11.341463 21289 tablet_copy_service.cc:161] P 18af051302ab4a05a7b6b26e56688462: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer b4a11c28fe8a4334a428d2a865e69e7b at {username='oryx', principal='oryx/127.11.131.252@KRBTEST.COM'} at 127.0.0.1:57710: session id = b4a11c28fe8a4334a428d2a865e69e7b-00000000000000000000000000000000
I20260808 14:34:11.342334 21289 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 14:34:11.343602 22081 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 14:34:11.345574 22081 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b: tablet copy: Starting download of 0 data blocks...
I20260808 14:34:11.345791 22081 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b: tablet copy: Starting download of 1 WAL segments...
I20260808 14:34:11.347436 22081 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 14:34:11.348974 21289 tablet_copy_service.cc:342] P 18af051302ab4a05a7b6b26e56688462: Request end of tablet copy session b4a11c28fe8a4334a428d2a865e69e7b-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.11.131.252@KRBTEST.COM'} at 127.0.0.1:57710
I20260808 14:34:11.349077 21289 tablet_copy_service.cc:433] P 18af051302ab4a05a7b6b26e56688462: ending tablet copy session b4a11c28fe8a4334a428d2a865e69e7b-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer b4a11c28fe8a4334a428d2a865e69e7b
I20260808 14:34:11.355667 22081 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:34:11.357336 22365 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:11.357613 22370 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:11.357779 22081 server_base.cc:1034] running on GCE node
W20260808 14:34:11.358765 22367 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:11.358989 22081 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:34:11.359308 22081 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:34:11.360471 22081 hybrid_clock.cc:648] HybridClock initialized: now 1786199651360460 us; error 25 us; skew 500 ppm
Aug 08 14:34:11 dist-test-slave-twwt krb5kdc[21195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199651, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.131.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:34:11.362068 22081 init.cc:377] Logged in from keytab as oryx/127.11.131.252@KRBTEST.COM (short username oryx)
I20260808 14:34:11.362555 22081 webserver.cc:460] Webserver started at http://127.11.131.252:45247/ using document root <none> and password file <none>
I20260808 14:34:11.362809 22081 fs_manager.cc:359] Metadata directory not provided
I20260808 14:34:11.362866 22081 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:34:11.364413 22081 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:34:11.365417 22381 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:11.365649 22081 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 14:34:11.365748 22081 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-2/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-2/wal
uuid: "b4a11c28fe8a4334a428d2a865e69e7b"
format_stamp: "Formatted at 2026-08-08 14:34:11 on dist-test-slave-twwt"
server_key: "b95571a785e3f05e4bb2cea9eb8c8a9a"
server_key_iv: "9941a9ddd2569e270c5e31362ec2ba0c"
server_key_version: "encryptionkey@0"
I20260808 14:34:11.365859 22081 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:34:11.378921 22081 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:34:11.380962 22081 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:34:11.386052 22081 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.252:39635
I20260808 14:34:11.386070 22451 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.252:39635 every 8 connection(s)
I20260808 14:34:11.386759 22081 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/master-2/data/info.pb
I20260808 14:34:11.388260 22452 sys_catalog.cc:263] Verifying existing consensus state
I20260808 14:34:11.389189 22452 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b: Bootstrap starting.
I20260808 14:34:11.396411 22452 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:34:11.396706 22452 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b: Bootstrap complete.
I20260808 14:34:11.397238 22452 raft_consensus.cc:348] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: false } } peers { permanent_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" member_type: NON_VOTER last_known_addr { host: "127.11.131.252" port: 39635 } attrs { promote: true } }
I20260808 14:34:11.397380 22452 raft_consensus.cc:729] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b4a11c28fe8a4334a428d2a865e69e7b, State: Initialized, Role: LEARNER
I20260808 14:34:11.397505 22452 consensus_queue.cc:260] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: false } } peers { permanent_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" member_type: NON_VOTER last_known_addr { host: "127.11.131.252" port: 39635 } attrs { promote: true } }
I20260808 14:34:11.397874 22456 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: false } } peers { permanent_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" member_type: NON_VOTER last_known_addr { host: "127.11.131.252" port: 39635 } attrs { promote: true } } }
I20260808 14:34:11.398042 22452 sys_catalog.cc:564] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:34:11.398047 22456 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [sys.catalog]: This master's current role is: LEARNER
I20260808 14:34:11.401068 22470 catalog_manager.cc:1259] Loaded cluster ID: 54a60cc90df341f0b548154a83c2ced5
I20260808 14:34:11.401189 22470 catalog_manager.cc:1552] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b: loading cluster ID for follower catalog manager: success
I20260808 14:34:11.403115 22470 catalog_manager.cc:1574] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b: acquiring CA information for follower catalog manager: success
I20260808 14:34:11.404511 22470 catalog_manager.cc:1602] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260808 14:34:11.435708 22336 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:34:11.435976 22336 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:34:11.436021 22336 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:34:11.439983 22336 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:34:11.440042 22336 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:34:11.440099 22336 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.193
I20260808 14:34:11.445308 22336 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:46739
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.193.keytab
--principal=oryx/127.11.131.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.193:42373
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.131.193
--webserver_port=45281
--tserver_master_addrs=127.11.131.254:38851,127.11.131.253:36145,127.11.131.252:39635
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22336
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.193
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:34:11.446339 22336 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:34:11.447359 22336 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:34:11.457341 22482 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:11.457459 22336 server_base.cc:1034] running on GCE node
W20260808 14:34:11.457360 22479 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:11.457341 22480 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:11.458091 22336 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:34:11.458873 22336 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:34:11.460055 22336 hybrid_clock.cc:648] HybridClock initialized: now 1786199651460014 us; error 47 us; skew 500 ppm
Aug 08 14:34:11 dist-test-slave-twwt krb5kdc[21195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199651, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.131.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:34:11.463033 22336 init.cc:377] Logged in from keytab as oryx/127.11.131.193@KRBTEST.COM (short username oryx)
I20260808 14:34:11.463967 22336 webserver.cc:460] Webserver started at http://127.11.131.193:45281/ using document root <none> and password file <none>
I20260808 14:34:11.464550 22336 fs_manager.cc:359] Metadata directory not provided
I20260808 14:34:11.464649 22336 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:34:11.468751 22336 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.004s
I20260808 14:34:11.471005 22489 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:11.472503 22336 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:34:11.472640 22336 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-0/wal
uuid: "85aaf6b6511e44698d5245b172f71008"
format_stamp: "Formatted at 2026-08-08 14:34:10 on dist-test-slave-twwt"
server_key: "e64e0a55f6ae4a3b6170379aaa57fa1a"
server_key_iv: "292e3c00e41f6ccc92174825a3d8db18"
server_key_version: "encryptionkey@0"
I20260808 14:34:11.473450 22336 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:34:11.503329 22336 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:34:11.506438 22336 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:34:11.506592 22336 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:34:11.507174 22336 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:34:11.508039 22336 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:34:11.508088 22336 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:11.508129 22336 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:34:11.508145 22336 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:11.519948 22336 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.193:42373
I20260808 14:34:11.519979 22656 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.193:42373 every 8 connection(s)
I20260808 14:34:11.521009 22336 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
I20260808 14:34:11.525424 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 22336
I20260808 14:34:11.525671 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 21542
Aug 08 14:34:11 dist-test-slave-twwt krb5kdc[21195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199651, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.131.193@KRBTEST.COM for oryx/127.11.131.253@KRBTEST.COM
Aug 08 14:34:11 dist-test-slave-twwt krb5kdc[21195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199651, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.131.193@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM
I20260808 14:34:11.545667 21318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:11.522986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:38327 (local address 127.11.131.254:38851)
0808 14:34:11.523140 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:11.523145 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:11.524347 (+ 1202us) server_negotiation.cc:407] Connection header received
0808 14:34:11.534179 (+ 9832us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:11.534183 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:11.534255 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:11.534309 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:11.534996 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.535694 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.536870 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.537235 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.537324 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:11.540353 (+ 3029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:11.540361 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:11.540367 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:11.540404 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:11.542255 (+ 1851us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:11.543564 (+ 1309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:11.543571 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:11.543576 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:11.543661 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:11.544161 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:11.544168 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:11.544172 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:11.544427 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:11.544539 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:11.545366 (+ 827us) server_negotiation.cc:299] Negotiation successful
0808 14:34:11.545492 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 14:34:11.546327 22302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:11.523083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:45373 (local address 127.11.131.253:36145)
0808 14:34:11.523200 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:11.523222 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:11.524347 (+ 1125us) server_negotiation.cc:407] Connection header received
0808 14:34:11.528203 (+ 3856us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:11.528208 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:11.528269 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:11.528353 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:11.532288 (+ 3935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.533155 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.534979 (+ 1824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.535303 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.535402 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:11.539938 (+ 4536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:11.539942 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:11.539944 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:11.539974 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:11.543364 (+ 3390us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:11.543846 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:11.543851 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:11.543853 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:11.543940 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:11.544257 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:11.544261 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:11.544262 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:11.544544 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:11.544634 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:11.546055 (+ 1421us) server_negotiation.cc:299] Negotiation successful
0808 14:34:11.546168 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 14:34:11.547030 22661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:11.523583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.253:36145 (local address 127.11.131.193:45373)
0808 14:34:11.524162 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:11.524228 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:11.525665 (+ 1437us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:11.530795 (+ 5130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:11.530806 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:11.531393 (+ 587us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:11.532092 (+ 699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:11.532115 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.533378 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.533381 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:11.534825 (+ 1444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:11.534837 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.536202 (+ 1365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.536207 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:11.536398 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:11.537111 (+ 713us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:11.537133 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:11.539758 (+ 2625us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:11.543490 (+ 3732us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:11.543496 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:11.543497 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:11.543735 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:11.544048 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:11.544051 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:11.544053 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:11.544143 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:11.544670 (+ 527us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:11.544673 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:11.545060 (+ 387us) client_negotiation.cc:769] Sending connection context
0808 14:34:11.545282 (+ 222us) client_negotiation.cc:240] Negotiation successful
0808 14:34:11.545633 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":324,"mutex_wait_us":89,"spinlock_wait_cycles":3200,"thread_start_us":143,"threads_started":1}
I20260808 14:34:11.547029 22662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:11.523583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:38851 (local address 127.11.131.193:38327)
0808 14:34:11.524162 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:11.524233 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:11.525665 (+ 1432us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:11.534452 (+ 8787us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:11.534454 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:11.534714 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:11.534862 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:11.534872 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.535826 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.535831 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:11.536731 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:11.536744 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.537491 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.537494 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:11.537585 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:11.538093 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:11.538114 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:11.540185 (+ 2071us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:11.543008 (+ 2823us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:11.543018 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:11.543037 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:11.543450 (+ 413us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:11.543794 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:11.543799 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:11.543804 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:11.544052 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:11.544646 (+ 594us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:11.544654 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:11.545060 (+ 406us) client_negotiation.cc:769] Sending connection context
0808 14:34:11.545845 (+ 785us) client_negotiation.cc:240] Negotiation successful
0808 14:34:11.545979 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":452,"mutex_wait_us":52,"spinlock_wait_cycles":89984,"thread_start_us":253,"threads_started":1}
I20260808 14:34:11.548552 22659 heartbeater.cc:347] Connected to a master server at 127.11.131.253:36145
I20260808 14:34:11.548808 22659 heartbeater.cc:464] Registering TS with master...
I20260808 14:34:11.549212 21929 heartbeater.cc:503] Master 127.11.131.254:38851 was elected leader, sending a full tablet report...
I20260808 14:34:11.549459 22659 heartbeater.cc:511] Master 127.11.131.253:36145 requested a full tablet report, sending...
I20260808 14:34:11.551154 22132 ts_manager.cc:194] Registered new tserver with Master: 85aaf6b6511e44698d5245b172f71008 (127.11.131.193:42373)
Aug 08 14:34:11 dist-test-slave-twwt krb5kdc[21195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199651, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.131.193@KRBTEST.COM for oryx/127.11.131.252@KRBTEST.COM
I20260808 14:34:11.558521 22658 heartbeater.cc:347] Connected to a master server at 127.11.131.254:38851
I20260808 14:34:11.558689 22658 heartbeater.cc:464] Registering TS with master...
I20260808 14:34:11.558961 22658 heartbeater.cc:511] Master 127.11.131.254:38851 requested a full tablet report, sending...
I20260808 14:34:11.559999 21262 ts_manager.cc:194] Re-registered known tserver with Master: 85aaf6b6511e44698d5245b172f71008 (127.11.131.193:42373)
I20260808 14:34:11.560930 21262 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.131.193@KRBTEST.COM'} at 127.11.131.193:38327
I20260808 14:34:11.561460 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.194:40983
--local_ip_for_outbound_sockets=127.11.131.194
--tserver_master_addrs=127.11.131.254:38851
--webserver_port=45195
--webserver_interface=127.11.131.194
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.194.keytab
--principal=oryx/127.11.131.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:46739
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.11.131.254:38851,127.11.131.253:36145
--tserver_master_addrs=127.11.131.254:38851,127.11.131.253:36145,127.11.131.252:39635 with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:34:11.562513 22664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:11.524781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.252:39635 (local address 127.11.131.193:40447)
0808 14:34:11.525157 (+ 376us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:11.525174 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:11.525674 (+ 500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:11.553282 (+ 27608us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:11.553286 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:11.553494 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:11.553592 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:11.553599 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.554553 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.554559 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:11.555406 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:11.555418 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.556078 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.556085 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:11.556221 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:11.556776 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:11.556796 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:11.558389 (+ 1593us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:11.560423 (+ 2034us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:11.560426 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:11.560428 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:11.560685 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:11.561069 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:11.561072 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:11.561074 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:11.561173 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:11.561767 (+ 594us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:11.561773 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:11.561891 (+ 118us) client_negotiation.cc:769] Sending connection context
0808 14:34:11.562003 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 14:34:11.562210 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":175,"threads_started":1}
I20260808 14:34:11.563218 22666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:11.524954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:40447 (local address 127.11.131.252:39635)
0808 14:34:11.525277 (+ 323us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:11.525282 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:11.525299 (+ 17us) server_negotiation.cc:407] Connection header received
0808 14:34:11.553105 (+ 27806us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:11.553108 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:11.553164 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:11.553265 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:11.553734 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.554433 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.555548 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.555920 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.556037 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:11.558548 (+ 2511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:11.558554 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:11.558560 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:11.558598 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:11.560283 (+ 1685us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:11.560811 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:11.560815 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:11.560817 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:11.560947 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:11.561334 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:11.561341 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:11.561345 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:11.561603 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:11.561714 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:11.562751 (+ 1037us) server_negotiation.cc:299] Negotiation successful
0808 14:34:11.562923 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":243,"thread_start_us":115,"threads_started":1}
I20260808 14:34:11.564124 22657 heartbeater.cc:347] Connected to a master server at 127.11.131.252:39635
I20260808 14:34:11.564226 22657 heartbeater.cc:464] Registering TS with master...
I20260808 14:34:11.564460 22657 heartbeater.cc:511] Master 127.11.131.252:39635 requested a full tablet report, sending...
I20260808 14:34:11.565616 22403 ts_manager.cc:194] Registered new tserver with Master: 85aaf6b6511e44698d5245b172f71008 (127.11.131.193:42373)
W20260808 14:34:11.682708 22667 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:34:11.683003 22667 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:34:11.683096 22667 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:34:11.687189 22667 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:34:11.687273 22667 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:34:11.687364 22667 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.194
I20260808 14:34:11.692764 22667 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:46739
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.194.keytab
--principal=oryx/127.11.131.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.194:40983
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.131.194
--webserver_port=45195
--tserver_master_addrs=127.11.131.254:38851,127.11.131.253:36145,127.11.131.252:39635
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22667
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.194
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:34:11.694059 22667 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:34:11.695288 22667 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:34:11.705535 22676 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:11.705535 22672 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:11.705559 22673 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:11.705989 22667 server_base.cc:1034] running on GCE node
I20260808 14:34:11.706449 22667 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:34:11.707167 22667 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:34:11.708335 22667 hybrid_clock.cc:648] HybridClock initialized: now 1786199651708297 us; error 49 us; skew 500 ppm
Aug 08 14:34:11 dist-test-slave-twwt krb5kdc[21195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199651, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.131.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:34:11.711220 22667 init.cc:377] Logged in from keytab as oryx/127.11.131.194@KRBTEST.COM (short username oryx)
I20260808 14:34:11.712170 22667 webserver.cc:460] Webserver started at http://127.11.131.194:45195/ using document root <none> and password file <none>
I20260808 14:34:11.712775 22667 fs_manager.cc:359] Metadata directory not provided
I20260808 14:34:11.712901 22667 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:34:11.716830 22667 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 14:34:11.718973 22685 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:11.720233 22667 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 14:34:11.720388 22667 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-1/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-1/wal
uuid: "3e8ddfc3c5534dbd88bb4d10b61eef3c"
format_stamp: "Formatted at 2026-08-08 14:34:10 on dist-test-slave-twwt"
server_key: "117dbc527c5062d0d5e98905e669122a"
server_key_iv: "32f36f0698b43aec9f38b3a302368f56"
server_key_version: "encryptionkey@0"
I20260808 14:34:11.720948 22667 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:34:11.743470 22667 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:34:11.746546 22667 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:34:11.746791 22667 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:34:11.747440 22667 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:34:11.748375 22667 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:34:11.748449 22667 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:11.748525 22667 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:34:11.748579 22667 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:11.758671 22667 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.194:40983
I20260808 14:34:11.758852 22842 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.194:40983 every 8 connection(s)
I20260808 14:34:11.759887 22667 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
I20260808 14:34:11.769721 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 22667
I20260808 14:34:11.769937 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 21736
Aug 08 14:34:11 dist-test-slave-twwt krb5kdc[21195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199651, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.131.194@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM
Aug 08 14:34:11 dist-test-slave-twwt krb5kdc[21195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199651, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.131.194@KRBTEST.COM for oryx/127.11.131.252@KRBTEST.COM
Aug 08 14:34:11 dist-test-slave-twwt krb5kdc[21195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199651, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.131.194@KRBTEST.COM for oryx/127.11.131.253@KRBTEST.COM
I20260808 14:34:11.780764 22302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:11.763749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:48131 (local address 127.11.131.253:36145)
0808 14:34:11.763878 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:11.763881 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:11.764066 (+ 185us) server_negotiation.cc:407] Connection header received
0808 14:34:11.764810 (+ 744us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:11.764814 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:11.764865 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:11.764947 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:11.766699 (+ 1752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.767398 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.768455 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.768741 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.768849 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:11.775592 (+ 6743us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:11.775599 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:11.775605 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:11.775647 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:11.777713 (+ 2066us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:11.778521 (+ 808us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:11.778525 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:11.778527 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:11.778780 (+ 253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:11.779235 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:11.779239 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:11.779240 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:11.779496 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:11.779565 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:11.780447 (+ 882us) server_negotiation.cc:299] Negotiation successful
0808 14:34:11.780588 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 14:34:11.780764 21318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:11.762221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:46793 (local address 127.11.131.254:38851)
0808 14:34:11.762478 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:11.762482 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:11.763211 (+ 729us) server_negotiation.cc:407] Connection header received
0808 14:34:11.764506 (+ 1295us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:11.764509 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:11.764567 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:11.764677 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:11.766317 (+ 1640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.766987 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.768676 (+ 1689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.768984 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.769072 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:11.774510 (+ 5438us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:11.774513 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:11.774515 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:11.774544 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:11.777684 (+ 3140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:11.778521 (+ 837us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:11.778525 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:11.778527 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:11.778666 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:11.779235 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:11.779239 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:11.779241 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:11.779488 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:11.779565 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:11.780447 (+ 882us) server_negotiation.cc:299] Negotiation successful
0808 14:34:11.780588 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174}
I20260808 14:34:11.780958 22666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:11.762060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:40119 (local address 127.11.131.252:39635)
0808 14:34:11.762373 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:11.762378 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:11.763212 (+ 834us) server_negotiation.cc:407] Connection header received
0808 14:34:11.764512 (+ 1300us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:11.764515 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:11.764578 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:11.764634 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:11.766283 (+ 1649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.767150 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.769170 (+ 2020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.769461 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.769571 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:11.775100 (+ 5529us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:11.775105 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:11.775108 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:11.775149 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:11.777303 (+ 2154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:11.778697 (+ 1394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:11.778704 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:11.778709 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:11.778889 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:11.779330 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:11.779336 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:11.779341 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:11.779663 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:11.779772 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:11.780474 (+ 702us) server_negotiation.cc:299] Negotiation successful
0808 14:34:11.780675 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":215}
I20260808 14:34:11.783056 22852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:11.762471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:38851 (local address 127.11.131.194:46793)
0808 14:34:11.763048 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:11.763103 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:11.764281 (+ 1178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:11.764867 (+ 586us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:11.764871 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:11.765454 (+ 583us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:11.766092 (+ 638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:11.766108 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.767142 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.767145 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:11.768558 (+ 1413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:11.768566 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.769101 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.769104 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:11.769189 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:11.770026 (+ 837us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:11.770064 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:11.774272 (+ 4208us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:11.777827 (+ 3555us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:11.777836 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:11.777862 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:11.778391 (+ 529us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:11.778935 (+ 544us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:11.778941 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:11.778946 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:11.779113 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:11.779656 (+ 543us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:11.779664 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:11.780106 (+ 442us) client_negotiation.cc:769] Sending connection context
0808 14:34:11.781334 (+ 1228us) client_negotiation.cc:240] Negotiation successful
0808 14:34:11.781939 (+ 605us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":476,"mutex_wait_us":562,"spinlock_wait_cycles":29312,"thread_start_us":118,"threads_started":1}
I20260808 14:34:11.783425 22851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:11.762471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.252:39635 (local address 127.11.131.194:40119)
0808 14:34:11.763048 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:11.763103 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:11.764279 (+ 1176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:11.764852 (+ 573us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:11.764859 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:11.765499 (+ 640us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:11.766104 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:11.766114 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.767266 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.767269 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:11.768554 (+ 1285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:11.768566 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.769621 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.769628 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:11.769724 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:11.770744 (+ 1020us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:11.770755 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:11.774879 (+ 4124us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:11.778144 (+ 3265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:11.778151 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:11.778155 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:11.778518 (+ 363us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:11.779049 (+ 531us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:11.779055 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:11.779060 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:11.779187 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:11.779866 (+ 679us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:11.779872 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:11.780124 (+ 252us) client_negotiation.cc:769] Sending connection context
0808 14:34:11.781232 (+ 1108us) client_negotiation.cc:240] Negotiation successful
0808 14:34:11.781778 (+ 546us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":356,"mutex_wait_us":185,"spinlock_wait_cycles":76032,"thread_start_us":188,"threads_started":1}
I20260808 14:34:11.783071 22856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:11.763600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.253:36145 (local address 127.11.131.194:48131)
0808 14:34:11.763936 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:11.763952 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:11.764279 (+ 327us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:11.765001 (+ 722us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:11.765007 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:11.765504 (+ 497us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:11.766105 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:11.766114 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.767510 (+ 1396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.767514 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:11.768326 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:11.768335 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.768894 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.768896 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:11.769066 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:11.770059 (+ 993us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:11.770090 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:11.775386 (+ 5296us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:11.777960 (+ 2574us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:11.777966 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:11.777971 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:11.778391 (+ 420us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:11.778892 (+ 501us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:11.778898 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:11.778900 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:11.779113 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:11.779657 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:11.779664 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:11.780106 (+ 442us) client_negotiation.cc:769] Sending connection context
0808 14:34:11.781200 (+ 1094us) client_negotiation.cc:240] Negotiation successful
0808 14:34:11.781882 (+ 682us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"mutex_wait_us":357,"spinlock_wait_cycles":53504,"thread_start_us":83,"threads_started":1}
I20260808 14:34:11.784399 22847 heartbeater.cc:347] Connected to a master server at 127.11.131.254:38851
I20260808 14:34:11.784744 22847 heartbeater.cc:464] Registering TS with master...
I20260808 14:34:11.785585 22847 heartbeater.cc:511] Master 127.11.131.254:38851 requested a full tablet report, sending...
I20260808 14:34:11.791661 21262 ts_manager.cc:194] Re-registered known tserver with Master: 3e8ddfc3c5534dbd88bb4d10b61eef3c (127.11.131.194:40983)
I20260808 14:34:11.792481 22843 heartbeater.cc:347] Connected to a master server at 127.11.131.252:39635
I20260808 14:34:11.792531 21262 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.131.194@KRBTEST.COM'} at 127.11.131.194:46793
I20260808 14:34:11.792587 22843 heartbeater.cc:464] Registering TS with master...
I20260808 14:34:11.792860 22843 heartbeater.cc:511] Master 127.11.131.252:39635 requested a full tablet report, sending...
I20260808 14:34:11.793648 22848 heartbeater.cc:347] Connected to a master server at 127.11.131.253:36145
I20260808 14:34:11.793735 22848 heartbeater.cc:464] Registering TS with master...
I20260808 14:34:11.793946 22403 ts_manager.cc:194] Registered new tserver with Master: 3e8ddfc3c5534dbd88bb4d10b61eef3c (127.11.131.194:40983)
I20260808 14:34:11.794173 22848 heartbeater.cc:511] Master 127.11.131.253:36145 requested a full tablet report, sending...
I20260808 14:34:11.795145 22132 ts_manager.cc:194] Registered new tserver with Master: 3e8ddfc3c5534dbd88bb4d10b61eef3c (127.11.131.194:40983)
I20260808 14:34:11.799592 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.195:42891
--local_ip_for_outbound_sockets=127.11.131.195
--tserver_master_addrs=127.11.131.254:38851
--webserver_port=42377
--webserver_interface=127.11.131.195
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.195.keytab
--principal=oryx/127.11.131.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:46739
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.11.131.254:38851,127.11.131.253:36145
--tserver_master_addrs=127.11.131.254:38851,127.11.131.253:36145,127.11.131.252:39635 with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:34:11.867724 22859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:11.863005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.252:39635 (local address 127.0.0.1:45356)
0808 14:34:11.863382 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:11.863399 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:11.863535 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:11.863851 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:11.863854 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:11.863877 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:34:11.864001 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:11.864010 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.864981 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.864984 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:11.866291 (+ 1307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:11.866306 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.867335 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.867338 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:11.867416 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:11.867441 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 14:34:11.867518 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 14:34:11.867588 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":130,"threads_started":1}
I20260808 14:34:11.867755 22666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:11.863110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45356 (local address 127.11.131.252:39635)
0808 14:34:11.863273 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:11.863278 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:11.863507 (+ 229us) server_negotiation.cc:407] Connection header received
0808 14:34:11.863632 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:11.863634 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:11.863697 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:11.863801 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:34:11.864296 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.864862 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.866466 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:11.867204 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:11.867337 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:11.867493 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:11.867547 (+ 54us) server_negotiation.cc:299] Negotiation successful
0808 14:34:11.867620 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 14:34:11.868395 22417 raft_consensus.cc:1203] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260808 14:34:11.868676 22456 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 18af051302ab4a05a7b6b26e56688462. Latest consensus state: current_term: 1 leader_uuid: "18af051302ab4a05a7b6b26e56688462" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: false } } peers { permanent_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" member_type: NON_VOTER last_known_addr { host: "127.11.131.252" port: 39635 } attrs { promote: true } } }
I20260808 14:34:11.868829 22456 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [sys.catalog]: This master's current role is: LEARNER
W20260808 14:34:11.922209 22857 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:34:11.922470 22857 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:34:11.922514 22857 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:34:11.926939 22857 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:34:11.926997 22857 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:34:11.927091 22857 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.195
I20260808 14:34:11.932395 22857 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:46739
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.195.keytab
--principal=oryx/127.11.131.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.195:42891
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.131.195
--webserver_port=42377
--tserver_master_addrs=127.11.131.254:38851,127.11.131.253:36145,127.11.131.252:39635
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22857
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.195
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:34:11.933518 22857 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:34:11.934706 22857 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:34:11.944928 22868 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:11.945012 22871 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:11.944906 22875 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:11.945456 22857 server_base.cc:1034] running on GCE node
I20260808 14:34:11.945878 22857 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:34:11.946532 22857 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:34:11.947707 22857 hybrid_clock.cc:648] HybridClock initialized: now 1786199651947667 us; error 51 us; skew 500 ppm
Aug 08 14:34:11 dist-test-slave-twwt krb5kdc[21195](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199651, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.131.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:34:11.950685 22857 init.cc:377] Logged in from keytab as oryx/127.11.131.195@KRBTEST.COM (short username oryx)
I20260808 14:34:11.951680 22857 webserver.cc:460] Webserver started at http://127.11.131.195:42377/ using document root <none> and password file <none>
I20260808 14:34:11.952268 22857 fs_manager.cc:359] Metadata directory not provided
I20260808 14:34:11.952376 22857 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:34:11.958115 22857 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 14:34:11.960742 22885 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:11.962044 22857 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 14:34:11.962183 22857 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-2/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-2/wal
uuid: "58a435968eb440fe9e5e17a994e9e721"
format_stamp: "Formatted at 2026-08-08 14:34:10 on dist-test-slave-twwt"
server_key: "1a9e698abe4fa183f82ddec70a0a4805"
server_key_iv: "e982570779ec01af7cfc137675e4297f"
server_key_version: "encryptionkey@0"
I20260808 14:34:11.962848 22857 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:34:11.978587 22857 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:34:11.981634 22857 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:34:11.981858 22857 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:34:11.982522 22857 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:34:11.983487 22857 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:34:11.983560 22857 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:11.983634 22857 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:34:11.983685 22857 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:11.993635 22857 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.195:42891
I20260808 14:34:11.993665 23065 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.195:42891 every 8 connection(s)
I20260808 14:34:11.994752 22857 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
I20260808 14:34:11.996882 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 22857
Aug 08 14:34:12 dist-test-slave-twwt krb5kdc[21195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199651, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.131.195@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM
I20260808 14:34:12.011091 23087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:11.999359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51296 (local address 127.11.131.253:36145)
0808 14:34:12.000178 (+ 819us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:12.000183 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:12.000196 (+ 13us) server_negotiation.cc:407] Connection header received
0808 14:34:12.000239 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:12.000242 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:12.000291 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:12.000385 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:12.001518 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:12.002366 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:12.003642 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:12.003996 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:12.004092 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:12.005968 (+ 1876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:12.005972 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:12.005975 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:12.006000 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:12.008336 (+ 2336us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:12.008850 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:12.008854 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:12.008856 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:12.008949 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:12.009246 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:12.009250 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:12.009252 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:12.009558 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:12.009689 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:12.010462 (+ 773us) server_negotiation.cc:299] Negotiation successful
0808 14:34:12.010624 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":746,"thread_start_us":87,"threads_started":1}
Aug 08 14:34:12 dist-test-slave-twwt krb5kdc[21195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199651, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.131.195@KRBTEST.COM for oryx/127.11.131.253@KRBTEST.COM
I20260808 14:34:12.018528 21318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:11.996677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:37605 (local address 127.11.131.254:38851)
0808 14:34:11.997273 (+ 596us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:11.997278 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:11.998017 (+ 739us) server_negotiation.cc:407] Connection header received
0808 14:34:11.999689 (+ 1672us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:11.999693 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:11.999750 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:11.999818 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:12.002091 (+ 2273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:12.002905 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:12.005069 (+ 2164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:12.005409 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:12.005484 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:12.012935 (+ 7451us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:12.012941 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:12.012946 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:12.012980 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:12.015483 (+ 2503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:12.016319 (+ 836us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:12.016325 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:12.016329 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:12.016431 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:12.016917 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:12.016922 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:12.016924 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:12.017215 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:12.017311 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:12.018147 (+ 836us) server_negotiation.cc:299] Negotiation successful
0808 14:34:12.018310 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":482}
Aug 08 14:34:12 dist-test-slave-twwt krb5kdc[21195](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199651, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.131.195@KRBTEST.COM for oryx/127.11.131.252@KRBTEST.COM
I20260808 14:34:12.020943 23074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:11.997113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:38851 (local address 127.11.131.195:37605)
0808 14:34:11.997852 (+ 739us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:11.997913 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:11.999428 (+ 1515us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:12.000283 (+ 855us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:12.000293 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:12.000929 (+ 636us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:12.001898 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:12.001924 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:12.003071 (+ 1147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:12.003074 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:12.004921 (+ 1847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:12.004933 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:12.005737 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:12.005741 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:12.006138 (+ 397us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:12.006953 (+ 815us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:12.007005 (+ 52us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:12.012743 (+ 5738us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:12.015686 (+ 2943us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:12.015695 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:12.015717 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:12.016165 (+ 448us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:12.016561 (+ 396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:12.016566 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:12.016570 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:12.016789 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:12.017413 (+ 624us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:12.017424 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:12.017809 (+ 385us) client_negotiation.cc:769] Sending connection context
0808 14:34:12.019181 (+ 1372us) client_negotiation.cc:240] Negotiation successful
0808 14:34:12.019643 (+ 462us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":462,"mutex_wait_us":421,"spinlock_wait_cycles":12800,"thread_start_us":655,"threads_started":1}
I20260808 14:34:12.021750 22302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:11.998823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:55923 (local address 127.11.131.253:36145)
0808 14:34:11.998967 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:11.998971 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:11.998985 (+ 14us) server_negotiation.cc:407] Connection header received
0808 14:34:11.999689 (+ 704us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:11.999693 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:11.999750 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:11.999809 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:12.002089 (+ 2280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:12.002897 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:12.005068 (+ 2171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:12.005409 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:12.005483 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:12.013412 (+ 7929us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:12.013416 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:12.013419 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:12.013450 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:12.016438 (+ 2988us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:12.020102 (+ 3664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:12.020107 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:12.020109 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:12.020209 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:12.020600 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:12.020604 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:12.020605 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:12.020855 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:12.020951 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:12.021455 (+ 504us) server_negotiation.cc:299] Negotiation successful
0808 14:34:12.021589 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 14:34:12.022313 23083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:11.997114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.253:36145 (local address 127.11.131.195:55923)
0808 14:34:11.998643 (+ 1529us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:11.998657 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:11.999428 (+ 771us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:12.000283 (+ 855us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:12.000300 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:12.000929 (+ 629us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:12.001898 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:12.001924 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:12.003071 (+ 1147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:12.003074 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:12.004920 (+ 1846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:12.004933 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:12.005736 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:12.005740 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:12.006138 (+ 398us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:12.006869 (+ 731us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:12.007175 (+ 306us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:12.012280 (+ 5105us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:12.019675 (+ 7395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:12.019679 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:12.019682 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:12.019967 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:12.020359 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:12.020363 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:12.020366 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:12.020472 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:12.021075 (+ 603us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:12.021078 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:12.021186 (+ 108us) client_negotiation.cc:769] Sending connection context
0808 14:34:12.021957 (+ 771us) client_negotiation.cc:240] Negotiation successful
0808 14:34:12.022123 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1422,"mutex_wait_us":688,"spinlock_wait_cycles":4992,"thread_start_us":150,"threads_started":1}
I20260808 14:34:12.023197 23067 heartbeater.cc:347] Connected to a master server at 127.11.131.254:38851
I20260808 14:34:12.023340 22666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:11.998459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:49469 (local address 127.11.131.252:39635)
0808 14:34:11.998587 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:11.998592 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:12.010485 (+ 11893us) server_negotiation.cc:407] Connection header received
0808 14:34:12.011477 (+ 992us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:12.011483 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:12.011552 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:12.011614 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:12.012347 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:12.014356 (+ 2009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:12.016048 (+ 1692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:12.016433 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:12.016522 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:12.019316 (+ 2794us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:12.019320 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:12.019323 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:12.019353 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:12.021108 (+ 1755us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:12.021638 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:12.021642 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:12.021644 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:12.021754 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:12.022147 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:12.022151 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:12.022153 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:12.022400 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:12.022496 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:12.023035 (+ 539us) server_negotiation.cc:299] Negotiation successful
0808 14:34:12.023171 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 14:34:12.023494 23070 heartbeater.cc:347] Connected to a master server at 127.11.131.253:36145
I20260808 14:34:12.023594 23070 heartbeater.cc:464] Registering TS with master...
I20260808 14:34:12.024354 23070 heartbeater.cc:511] Master 127.11.131.253:36145 requested a full tablet report, sending...
I20260808 14:34:12.023499 23067 heartbeater.cc:464] Registering TS with master...
I20260808 14:34:12.025348 23067 heartbeater.cc:511] Master 127.11.131.254:38851 requested a full tablet report, sending...
I20260808 14:34:12.025818 22132 ts_manager.cc:194] Registered new tserver with Master: 58a435968eb440fe9e5e17a994e9e721 (127.11.131.195:42891)
I20260808 14:34:12.026005 23088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:11.999739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45366 (local address 127.11.131.252:39635)
0808 14:34:12.000029 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:12.000034 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:12.001532 (+ 1498us) server_negotiation.cc:407] Connection header received
0808 14:34:12.001585 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:12.001587 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:12.001637 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:12.001717 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:12.003546 (+ 1829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:12.004313 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:12.008017 (+ 3704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:12.008443 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:12.008554 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:12.013467 (+ 4913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:12.013472 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:12.013478 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:12.013518 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:12.018554 (+ 5036us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:12.023178 (+ 4624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:12.023181 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:12.023183 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:12.023269 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:12.024432 (+ 1163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:12.024436 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:12.024438 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:12.024650 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:12.024777 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:12.025509 (+ 732us) server_negotiation.cc:299] Negotiation successful
0808 14:34:12.025654 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":70,"threads_started":1}
I20260808 14:34:12.026077 21262 ts_manager.cc:194] Re-registered known tserver with Master: 58a435968eb440fe9e5e17a994e9e721 (127.11.131.195:42891)
I20260808 14:34:12.026575 23091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:12.000517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57716 (local address 127.11.131.254:38851)
0808 14:34:12.001192 (+ 675us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:12.001197 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:12.002179 (+ 982us) server_negotiation.cc:407] Connection header received
0808 14:34:12.002223 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:12.002225 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:12.002293 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:12.002414 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:12.005506 (+ 3092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:12.006735 (+ 1229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:12.009678 (+ 2943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:12.010019 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:12.010123 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:12.014915 (+ 4792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:12.014918 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:12.014921 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:12.014950 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:12.019544 (+ 4594us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:12.023785 (+ 4241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:12.023788 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:12.023790 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:12.023896 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:12.024594 (+ 698us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:12.024598 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:12.024601 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:12.024865 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:12.025007 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:12.026026 (+ 1019us) server_negotiation.cc:299] Negotiation successful
0808 14:34:12.026404 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":581,"thread_start_us":100,"threads_started":1}
I20260808 14:34:12.026832 21262 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.131.195@KRBTEST.COM'} at 127.11.131.195:37605
I20260808 14:34:12.027956 23076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:11.998371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.252:39635 (local address 127.11.131.195:49469)
0808 14:34:12.010397 (+ 12026us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:12.010413 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:12.010944 (+ 531us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:12.011944 (+ 1000us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:12.011947 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:12.012102 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:12.012217 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:12.012222 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:12.014517 (+ 2295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:12.014523 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:12.015895 (+ 1372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:12.015909 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:12.016729 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:12.016771 (+ 42us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:12.016899 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:12.017470 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:12.017487 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:12.019143 (+ 1656us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:12.021227 (+ 2084us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:12.021230 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:12.021232 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:12.021519 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:12.021892 (+ 373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:12.021896 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:12.021897 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:12.022031 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:12.022707 (+ 676us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:12.022710 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:12.022809 (+ 99us) client_negotiation.cc:769] Sending connection context
0808 14:34:12.027307 (+ 4498us) client_negotiation.cc:240] Negotiation successful
0808 14:34:12.027496 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11926,"thread_start_us":80,"threads_started":1}
I20260808 14:34:12.028555 23066 heartbeater.cc:347] Connected to a master server at 127.11.131.252:39635
I20260808 14:34:12.028643 23066 heartbeater.cc:464] Registering TS with master...
I20260808 14:34:12.028800 23066 heartbeater.cc:511] Master 127.11.131.252:39635 requested a full tablet report, sending...
I20260808 14:34:12.029537 22403 ts_manager.cc:194] Registered new tserver with Master: 58a435968eb440fe9e5e17a994e9e721 (127.11.131.195:42891)
I20260808 14:34:12.030184 21262 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57716:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:34:12.033442 21262 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:34:12.036541 22858 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "18af051302ab4a05a7b6b26e56688462" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: false } } peers { permanent_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" member_type: NON_VOTER last_known_addr { host: "127.11.131.252" port: 39635 } attrs { promote: true } } }
I20260808 14:34:12.036692 22858 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462 [sys.catalog]: This master's current role is: LEADER
I20260808 14:34:12.038704 23100 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462: attempting to promote NON_VOTER b4a11c28fe8a4334a428d2a865e69e7b to VOTER
I20260808 14:34:12.039086 23100 consensus_queue.cc:237] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: false } } peers { permanent_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 39635 } attrs { promote: false } }
I20260808 14:34:12.040426 22417 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [term 1 LEARNER]: Refusing update from remote peer 18af051302ab4a05a7b6b26e56688462: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260808 14:34:12.040412 22143 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [term 1 FOLLOWER]: Refusing update from remote peer 18af051302ab4a05a7b6b26e56688462: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260808 14:34:12.040853 23100 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260808 14:34:12.041002 23095 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 39635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260808 14:34:12.042917 22858 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, b4a11c28fe8a4334a428d2a865e69e7b (127.11.131.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: false } } peers { permanent_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 39635 } attrs { promote: false } } }
I20260808 14:34:12.043434 22143 raft_consensus.cc:2932] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, b4a11c28fe8a4334a428d2a865e69e7b (127.11.131.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: false } } peers { permanent_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 39635 } attrs { promote: false } } }
I20260808 14:34:12.043409 22417 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, b4a11c28fe8a4334a428d2a865e69e7b (127.11.131.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: false } } peers { permanent_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 39635 } attrs { promote: false } } }
I20260808 14:34:12.044713 22858 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "18af051302ab4a05a7b6b26e56688462" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: false } } peers { permanent_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 39635 } attrs { promote: false } } }
I20260808 14:34:12.044835 22858 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462 [sys.catalog]: This master's current role is: LEADER
I20260808 14:34:12.044983 22858 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "18af051302ab4a05a7b6b26e56688462" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: false } } peers { permanent_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 39635 } attrs { promote: false } } }
I20260808 14:34:12.045066 22858 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462 [sys.catalog]: This master's current role is: LEADER
I20260808 14:34:12.045133 23113 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "18af051302ab4a05a7b6b26e56688462" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: false } } peers { permanent_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 39635 } attrs { promote: false } } }
I20260808 14:34:12.045260 23113 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:34:12.045214 23096 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "18af051302ab4a05a7b6b26e56688462" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: false } } peers { permanent_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 39635 } attrs { promote: false } } }
I20260808 14:34:12.045311 23096 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462 [sys.catalog]: This master's current role is: LEADER
I20260808 14:34:12.045286 22456 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "18af051302ab4a05a7b6b26e56688462" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: false } } peers { permanent_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 39635 } attrs { promote: false } } }
I20260808 14:34:12.045419 22456 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:34:12.059739 23115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:12.053980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.194:40983 (local address 127.0.0.1:50506)
0808 14:34:12.054380 (+ 400us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:12.054397 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:12.054498 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:12.055115 (+ 617us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:12.055121 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:12.055145 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:34:12.055268 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:12.055276 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:12.056881 (+ 1605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:12.056884 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:12.058131 (+ 1247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:12.058143 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:12.059316 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:12.059320 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:12.059427 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:12.059456 (+ 29us) client_negotiation.cc:769] Sending connection context
0808 14:34:12.059508 (+ 52us) client_negotiation.cc:240] Negotiation successful
0808 14:34:12.059575 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":323,"mutex_wait_us":6,"thread_start_us":106,"threads_started":1}
I20260808 14:34:12.060448 23116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:12.054184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50506 (local address 127.11.131.194:40983)
0808 14:34:12.054485 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:12.054499 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:12.054528 (+ 29us) server_negotiation.cc:407] Connection header received
0808 14:34:12.054646 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:12.054655 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:12.054939 (+ 284us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:12.055448 (+ 509us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:34:12.055613 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:12.056738 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:12.058293 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:12.059176 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:12.059968 (+ 792us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:12.060120 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:12.060171 (+ 51us) server_negotiation.cc:299] Negotiation successful
0808 14:34:12.060265 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":203,"thread_start_us":130,"threads_started":1}
I20260808 14:34:12.061410 22859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:12.053727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:42373 (local address 127.0.0.1:48292)
0808 14:34:12.053877 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:12.053895 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:12.054010 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:12.055878 (+ 1868us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:12.055882 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:12.055903 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:34:12.056011 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:12.056021 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:12.057706 (+ 1685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:12.057712 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:12.059125 (+ 1413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:12.059139 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:12.060950 (+ 1811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:12.060955 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:12.061070 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:12.061105 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 14:34:12.061161 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 14:34:12.061266 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62}
I20260808 14:34:12.061949 23117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:12.055034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.195:42891 (local address 127.0.0.1:49418)
0808 14:34:12.055288 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:12.055305 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:12.055403 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:12.056848 (+ 1445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:12.056854 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:12.056877 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:34:12.056994 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:12.057001 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:12.058407 (+ 1406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:12.058411 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:12.060278 (+ 1867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:12.060289 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:12.061561 (+ 1272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:12.061565 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:12.061658 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:12.061680 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 14:34:12.061751 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 14:34:12.061814 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"mutex_wait_us":22,"thread_start_us":90,"threads_started":1}
I20260808 14:34:12.062565 23114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:12.053918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48292 (local address 127.11.131.193:42373)
0808 14:34:12.054794 (+ 876us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:12.054804 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:12.054831 (+ 27us) server_negotiation.cc:407] Connection header received
0808 14:34:12.054916 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:12.054924 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:12.055715 (+ 791us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:12.056163 (+ 448us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:34:12.056331 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:12.057556 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:12.059327 (+ 1771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:12.060796 (+ 1469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:12.061801 (+ 1005us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:12.061954 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:12.062199 (+ 245us) server_negotiation.cc:299] Negotiation successful
0808 14:34:12.062382 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":748,"thread_start_us":114,"threads_started":1}
I20260808 14:34:12.063301 23119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:12.055196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49418 (local address 127.11.131.195:42891)
0808 14:34:12.056260 (+ 1064us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:12.056271 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:12.056294 (+ 23us) server_negotiation.cc:407] Connection header received
0808 14:34:12.056380 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:12.056385 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:12.056553 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:12.056694 (+ 141us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:34:12.057124 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:12.058249 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:12.060433 (+ 2184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:12.061218 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:12.061362 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:12.061491 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:12.062226 (+ 735us) server_negotiation.cc:299] Negotiation successful
0808 14:34:12.062345 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":964,"thread_start_us":140,"threads_started":1}
I20260808 14:34:12.064029 22728 tablet_service.cc:1467] Processing CreateTablet for tablet 3ebdb5b29dbd412e96dbcda013ea1724 (DEFAULT_TABLE table=test-table [id=46f84662da2f4d45a0f75e9d4bfab0ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:34:12.065253 22728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ebdb5b29dbd412e96dbcda013ea1724. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:34:12.066056 22565 tablet_service.cc:1467] Processing CreateTablet for tablet 3ebdb5b29dbd412e96dbcda013ea1724 (DEFAULT_TABLE table=test-table [id=46f84662da2f4d45a0f75e9d4bfab0ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:34:12.067345 22970 tablet_service.cc:1467] Processing CreateTablet for tablet 3ebdb5b29dbd412e96dbcda013ea1724 (DEFAULT_TABLE table=test-table [id=46f84662da2f4d45a0f75e9d4bfab0ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:34:12.068188 22565 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ebdb5b29dbd412e96dbcda013ea1724. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:34:12.068439 22970 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ebdb5b29dbd412e96dbcda013ea1724. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:34:12.074656 23120 tablet_bootstrap.cc:492] T 3ebdb5b29dbd412e96dbcda013ea1724 P 3e8ddfc3c5534dbd88bb4d10b61eef3c: Bootstrap starting.
I20260808 14:34:12.077222 23120 tablet_bootstrap.cc:654] T 3ebdb5b29dbd412e96dbcda013ea1724 P 3e8ddfc3c5534dbd88bb4d10b61eef3c: Neither blocks nor log segments found. Creating new log.
I20260808 14:34:12.077430 23122 tablet_bootstrap.cc:492] T 3ebdb5b29dbd412e96dbcda013ea1724 P 58a435968eb440fe9e5e17a994e9e721: Bootstrap starting.
I20260808 14:34:12.077996 23124 tablet_bootstrap.cc:492] T 3ebdb5b29dbd412e96dbcda013ea1724 P 85aaf6b6511e44698d5245b172f71008: Bootstrap starting.
I20260808 14:34:12.078214 23120 log.cc:824] T 3ebdb5b29dbd412e96dbcda013ea1724 P 3e8ddfc3c5534dbd88bb4d10b61eef3c: Log is configured to *not* fsync() on all Append() calls
I20260808 14:34:12.079839 23122 tablet_bootstrap.cc:654] T 3ebdb5b29dbd412e96dbcda013ea1724 P 58a435968eb440fe9e5e17a994e9e721: Neither blocks nor log segments found. Creating new log.
I20260808 14:34:12.080418 23124 tablet_bootstrap.cc:654] T 3ebdb5b29dbd412e96dbcda013ea1724 P 85aaf6b6511e44698d5245b172f71008: Neither blocks nor log segments found. Creating new log.
I20260808 14:34:12.080729 23122 log.cc:824] T 3ebdb5b29dbd412e96dbcda013ea1724 P 58a435968eb440fe9e5e17a994e9e721: Log is configured to *not* fsync() on all Append() calls
I20260808 14:34:12.081760 23124 log.cc:824] T 3ebdb5b29dbd412e96dbcda013ea1724 P 85aaf6b6511e44698d5245b172f71008: Log is configured to *not* fsync() on all Append() calls
I20260808 14:34:12.083169 23120 tablet_bootstrap.cc:492] T 3ebdb5b29dbd412e96dbcda013ea1724 P 3e8ddfc3c5534dbd88bb4d10b61eef3c: No bootstrap required, opened a new log
I20260808 14:34:12.083185 23122 tablet_bootstrap.cc:492] T 3ebdb5b29dbd412e96dbcda013ea1724 P 58a435968eb440fe9e5e17a994e9e721: No bootstrap required, opened a new log
I20260808 14:34:12.083379 23122 ts_tablet_manager.cc:1397] T 3ebdb5b29dbd412e96dbcda013ea1724 P 58a435968eb440fe9e5e17a994e9e721: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 14:34:12.083490 23120 ts_tablet_manager.cc:1397] T 3ebdb5b29dbd412e96dbcda013ea1724 P 3e8ddfc3c5534dbd88bb4d10b61eef3c: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.002s
I20260808 14:34:12.084215 23124 tablet_bootstrap.cc:492] T 3ebdb5b29dbd412e96dbcda013ea1724 P 85aaf6b6511e44698d5245b172f71008: No bootstrap required, opened a new log
I20260808 14:34:12.084412 23124 ts_tablet_manager.cc:1397] T 3ebdb5b29dbd412e96dbcda013ea1724 P 85aaf6b6511e44698d5245b172f71008: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260808 14:34:12.088330 23124 raft_consensus.cc:348] T 3ebdb5b29dbd412e96dbcda013ea1724 P 85aaf6b6511e44698d5245b172f71008 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85aaf6b6511e44698d5245b172f71008" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 42373 } } peers { permanent_uuid: "3e8ddfc3c5534dbd88bb4d10b61eef3c" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40983 } } peers { permanent_uuid: "58a435968eb440fe9e5e17a994e9e721" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 42891 } }
I20260808 14:34:12.088258 23122 raft_consensus.cc:348] T 3ebdb5b29dbd412e96dbcda013ea1724 P 58a435968eb440fe9e5e17a994e9e721 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85aaf6b6511e44698d5245b172f71008" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 42373 } } peers { permanent_uuid: "3e8ddfc3c5534dbd88bb4d10b61eef3c" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40983 } } peers { permanent_uuid: "58a435968eb440fe9e5e17a994e9e721" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 42891 } }
I20260808 14:34:12.088569 23122 raft_consensus.cc:374] T 3ebdb5b29dbd412e96dbcda013ea1724 P 58a435968eb440fe9e5e17a994e9e721 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:34:12.088568 23124 raft_consensus.cc:374] T 3ebdb5b29dbd412e96dbcda013ea1724 P 85aaf6b6511e44698d5245b172f71008 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:34:12.088621 23122 raft_consensus.cc:729] T 3ebdb5b29dbd412e96dbcda013ea1724 P 58a435968eb440fe9e5e17a994e9e721 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58a435968eb440fe9e5e17a994e9e721, State: Initialized, Role: FOLLOWER
I20260808 14:34:12.088630 23124 raft_consensus.cc:729] T 3ebdb5b29dbd412e96dbcda013ea1724 P 85aaf6b6511e44698d5245b172f71008 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85aaf6b6511e44698d5245b172f71008, State: Initialized, Role: FOLLOWER
I20260808 14:34:12.089160 23122 consensus_queue.cc:260] T 3ebdb5b29dbd412e96dbcda013ea1724 P 58a435968eb440fe9e5e17a994e9e721 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85aaf6b6511e44698d5245b172f71008" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 42373 } } peers { permanent_uuid: "3e8ddfc3c5534dbd88bb4d10b61eef3c" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40983 } } peers { permanent_uuid: "58a435968eb440fe9e5e17a994e9e721" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 42891 } }
I20260808 14:34:12.089160 23124 consensus_queue.cc:260] T 3ebdb5b29dbd412e96dbcda013ea1724 P 85aaf6b6511e44698d5245b172f71008 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85aaf6b6511e44698d5245b172f71008" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 42373 } } peers { permanent_uuid: "3e8ddfc3c5534dbd88bb4d10b61eef3c" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40983 } } peers { permanent_uuid: "58a435968eb440fe9e5e17a994e9e721" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 42891 } }
I20260808 14:34:12.089581 23120 raft_consensus.cc:348] T 3ebdb5b29dbd412e96dbcda013ea1724 P 3e8ddfc3c5534dbd88bb4d10b61eef3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85aaf6b6511e44698d5245b172f71008" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 42373 } } peers { permanent_uuid: "3e8ddfc3c5534dbd88bb4d10b61eef3c" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40983 } } peers { permanent_uuid: "58a435968eb440fe9e5e17a994e9e721" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 42891 } }
I20260808 14:34:12.089896 23120 raft_consensus.cc:374] T 3ebdb5b29dbd412e96dbcda013ea1724 P 3e8ddfc3c5534dbd88bb4d10b61eef3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:34:12.090013 23120 raft_consensus.cc:729] T 3ebdb5b29dbd412e96dbcda013ea1724 P 3e8ddfc3c5534dbd88bb4d10b61eef3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8ddfc3c5534dbd88bb4d10b61eef3c, State: Initialized, Role: FOLLOWER
I20260808 14:34:12.090271 23124 ts_tablet_manager.cc:1428] T 3ebdb5b29dbd412e96dbcda013ea1724 P 85aaf6b6511e44698d5245b172f71008: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 14:34:12.090271 23122 ts_tablet_manager.cc:1428] T 3ebdb5b29dbd412e96dbcda013ea1724 P 58a435968eb440fe9e5e17a994e9e721: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260808 14:34:12.090621 23120 consensus_queue.cc:260] T 3ebdb5b29dbd412e96dbcda013ea1724 P 3e8ddfc3c5534dbd88bb4d10b61eef3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85aaf6b6511e44698d5245b172f71008" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 42373 } } peers { permanent_uuid: "3e8ddfc3c5534dbd88bb4d10b61eef3c" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40983 } } peers { permanent_uuid: "58a435968eb440fe9e5e17a994e9e721" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 42891 } }
I20260808 14:34:12.091670 23120 ts_tablet_manager.cc:1428] T 3ebdb5b29dbd412e96dbcda013ea1724 P 3e8ddfc3c5534dbd88bb4d10b61eef3c: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260808 14:34:12.091764 22658 heartbeater.cc:503] Master 127.11.131.254:38851 was elected leader, sending a full tablet report...
I20260808 14:34:12.093005 22847 heartbeater.cc:503] Master 127.11.131.254:38851 was elected leader, sending a full tablet report...
I20260808 14:34:12.093672 23067 heartbeater.cc:503] Master 127.11.131.254:38851 was elected leader, sending a full tablet report...
W20260808 14:34:12.246279 23071 tablet.cc:2369] T 3ebdb5b29dbd412e96dbcda013ea1724 P 58a435968eb440fe9e5e17a994e9e721: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:34:12.262200 22849 tablet.cc:2369] T 3ebdb5b29dbd412e96dbcda013ea1724 P 3e8ddfc3c5534dbd88bb4d10b61eef3c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:34:12.272948 22660 tablet.cc:2369] T 3ebdb5b29dbd412e96dbcda013ea1724 P 85aaf6b6511e44698d5245b172f71008: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:34:12.275053 23129 raft_consensus.cc:482] T 3ebdb5b29dbd412e96dbcda013ea1724 P 85aaf6b6511e44698d5245b172f71008 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:34:12.275295 23129 raft_consensus.cc:504] T 3ebdb5b29dbd412e96dbcda013ea1724 P 85aaf6b6511e44698d5245b172f71008 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85aaf6b6511e44698d5245b172f71008" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 42373 } } peers { permanent_uuid: "3e8ddfc3c5534dbd88bb4d10b61eef3c" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40983 } } peers { permanent_uuid: "58a435968eb440fe9e5e17a994e9e721" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 42891 } }
I20260808 14:34:12.276822 23129 leader_election.cc:288] T 3ebdb5b29dbd412e96dbcda013ea1724 P 85aaf6b6511e44698d5245b172f71008 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e8ddfc3c5534dbd88bb4d10b61eef3c (127.11.131.194:40983), 58a435968eb440fe9e5e17a994e9e721 (127.11.131.195:42891)
I20260808 14:34:12.281363 23116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:12.277181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:45401 (local address 127.11.131.194:40983)
0808 14:34:12.277352 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:12.277357 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:12.277625 (+ 268us) server_negotiation.cc:407] Connection header received
0808 14:34:12.277795 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:12.277798 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:12.277866 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:12.277950 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:34:12.278344 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:12.279065 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:12.280316 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:12.280700 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:12.280840 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:12.280900 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:12.281148 (+ 248us) server_negotiation.cc:299] Negotiation successful
0808 14:34:12.281221 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 14:34:12.281373 23119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:12.277200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:59511 (local address 127.11.131.195:42891)
0808 14:34:12.277357 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:12.277362 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:12.278013 (+ 651us) server_negotiation.cc:407] Connection header received
0808 14:34:12.278085 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:12.278088 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:12.278138 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:12.278229 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:34:12.278550 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:12.279078 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:12.280290 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:12.280702 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:12.280841 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:12.280900 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:12.281149 (+ 249us) server_negotiation.cc:299] Negotiation successful
0808 14:34:12.281229 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 14:34:12.281410 23132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:12.277105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.194:40983 (local address 127.11.131.193:45401)
0808 14:34:12.277522 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:12.277535 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:12.277677 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:12.278033 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:12.278037 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:12.278066 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:34:12.278221 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:12.278228 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:12.279200 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:12.279205 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:12.280152 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:12.280162 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:12.280834 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:12.280838 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:12.281005 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:12.281040 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 14:34:12.281130 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 14:34:12.281226 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":350,"mutex_wait_us":115,"thread_start_us":168,"threads_started":1}
I20260808 14:34:12.281421 23133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:12.277105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.195:42891 (local address 127.11.131.193:59511)
0808 14:34:12.277893 (+ 788us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:12.277909 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:12.278000 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:12.278251 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:12.278254 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:12.278268 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:34:12.278414 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:12.278421 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:12.279218 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:12.279222 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:12.280142 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:12.280152 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:12.280836 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:12.280839 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:12.281004 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:12.281038 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 14:34:12.281131 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 14:34:12.281219 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":720,"mutex_wait_us":89,"thread_start_us":156,"threads_started":1}
I20260808 14:34:12.282322 23000 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ebdb5b29dbd412e96dbcda013ea1724" candidate_uuid: "85aaf6b6511e44698d5245b172f71008" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58a435968eb440fe9e5e17a994e9e721" is_pre_election: true
I20260808 14:34:12.282336 22774 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ebdb5b29dbd412e96dbcda013ea1724" candidate_uuid: "85aaf6b6511e44698d5245b172f71008" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8ddfc3c5534dbd88bb4d10b61eef3c" is_pre_election: true
I20260808 14:34:12.282702 23000 raft_consensus.cc:2454] T 3ebdb5b29dbd412e96dbcda013ea1724 P 58a435968eb440fe9e5e17a994e9e721 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85aaf6b6511e44698d5245b172f71008 in term 0.
I20260808 14:34:12.282702 22774 raft_consensus.cc:2454] T 3ebdb5b29dbd412e96dbcda013ea1724 P 3e8ddfc3c5534dbd88bb4d10b61eef3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85aaf6b6511e44698d5245b172f71008 in term 0.
I20260808 14:34:12.283169 22492 leader_election.cc:302] T 3ebdb5b29dbd412e96dbcda013ea1724 P 85aaf6b6511e44698d5245b172f71008 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58a435968eb440fe9e5e17a994e9e721, 85aaf6b6511e44698d5245b172f71008; no voters:
I20260808 14:34:12.283439 23129 raft_consensus.cc:2781] T 3ebdb5b29dbd412e96dbcda013ea1724 P 85aaf6b6511e44698d5245b172f71008 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:34:12.283526 23129 raft_consensus.cc:482] T 3ebdb5b29dbd412e96dbcda013ea1724 P 85aaf6b6511e44698d5245b172f71008 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:34:12.283577 23129 raft_consensus.cc:3037] T 3ebdb5b29dbd412e96dbcda013ea1724 P 85aaf6b6511e44698d5245b172f71008 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:34:12.284763 23129 raft_consensus.cc:504] T 3ebdb5b29dbd412e96dbcda013ea1724 P 85aaf6b6511e44698d5245b172f71008 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85aaf6b6511e44698d5245b172f71008" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 42373 } } peers { permanent_uuid: "3e8ddfc3c5534dbd88bb4d10b61eef3c" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40983 } } peers { permanent_uuid: "58a435968eb440fe9e5e17a994e9e721" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 42891 } }
I20260808 14:34:12.285106 23129 leader_election.cc:288] T 3ebdb5b29dbd412e96dbcda013ea1724 P 85aaf6b6511e44698d5245b172f71008 [CANDIDATE]: Term 1 election: Requested vote from peers 3e8ddfc3c5534dbd88bb4d10b61eef3c (127.11.131.194:40983), 58a435968eb440fe9e5e17a994e9e721 (127.11.131.195:42891)
I20260808 14:34:12.285439 22774 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ebdb5b29dbd412e96dbcda013ea1724" candidate_uuid: "85aaf6b6511e44698d5245b172f71008" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8ddfc3c5534dbd88bb4d10b61eef3c"
I20260808 14:34:12.285514 23000 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ebdb5b29dbd412e96dbcda013ea1724" candidate_uuid: "85aaf6b6511e44698d5245b172f71008" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58a435968eb440fe9e5e17a994e9e721"
I20260808 14:34:12.285602 22774 raft_consensus.cc:3037] T 3ebdb5b29dbd412e96dbcda013ea1724 P 3e8ddfc3c5534dbd88bb4d10b61eef3c [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:34:12.285652 23000 raft_consensus.cc:3037] T 3ebdb5b29dbd412e96dbcda013ea1724 P 58a435968eb440fe9e5e17a994e9e721 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:34:12.286991 22774 raft_consensus.cc:2454] T 3ebdb5b29dbd412e96dbcda013ea1724 P 3e8ddfc3c5534dbd88bb4d10b61eef3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85aaf6b6511e44698d5245b172f71008 in term 1.
I20260808 14:34:12.287075 23000 raft_consensus.cc:2454] T 3ebdb5b29dbd412e96dbcda013ea1724 P 58a435968eb440fe9e5e17a994e9e721 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85aaf6b6511e44698d5245b172f71008 in term 1.
I20260808 14:34:12.287304 22495 leader_election.cc:302] T 3ebdb5b29dbd412e96dbcda013ea1724 P 85aaf6b6511e44698d5245b172f71008 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8ddfc3c5534dbd88bb4d10b61eef3c, 85aaf6b6511e44698d5245b172f71008; no voters:
I20260808 14:34:12.287545 23129 raft_consensus.cc:2781] T 3ebdb5b29dbd412e96dbcda013ea1724 P 85aaf6b6511e44698d5245b172f71008 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:34:12.287770 23129 raft_consensus.cc:686] T 3ebdb5b29dbd412e96dbcda013ea1724 P 85aaf6b6511e44698d5245b172f71008 [term 1 LEADER]: Becoming Leader. State: Replica: 85aaf6b6511e44698d5245b172f71008, State: Running, Role: LEADER
I20260808 14:34:12.288134 23129 consensus_queue.cc:237] T 3ebdb5b29dbd412e96dbcda013ea1724 P 85aaf6b6511e44698d5245b172f71008 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85aaf6b6511e44698d5245b172f71008" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 42373 } } peers { permanent_uuid: "3e8ddfc3c5534dbd88bb4d10b61eef3c" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40983 } } peers { permanent_uuid: "58a435968eb440fe9e5e17a994e9e721" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 42891 } }
I20260808 14:34:12.291199 21261 catalog_manager.cc:5495] T 3ebdb5b29dbd412e96dbcda013ea1724 P 85aaf6b6511e44698d5245b172f71008 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85aaf6b6511e44698d5245b172f71008 (127.11.131.193). New cstate: current_term: 1 leader_uuid: "85aaf6b6511e44698d5245b172f71008" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85aaf6b6511e44698d5245b172f71008" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 42373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e8ddfc3c5534dbd88bb4d10b61eef3c" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58a435968eb440fe9e5e17a994e9e721" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 42891 } health_report { overall_health: UNKNOWN } } }
I20260808 14:34:12.352649 23114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:12.348741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57238 (local address 127.11.131.193:42373)
0808 14:34:12.348894 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:12.348898 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:12.348912 (+ 14us) server_negotiation.cc:407] Connection header received
0808 14:34:12.349050 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:12.349052 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:12.349107 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:12.349197 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:34:12.349451 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:12.349965 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:12.351006 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:12.351229 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:12.351310 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:12.351664 (+ 354us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:34:12.352186 (+ 522us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:34:12.352304 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:12.352399 (+ 95us) server_negotiation.cc:299] Negotiation successful
0808 14:34:12.352457 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 14:34:12.359561 22774 raft_consensus.cc:1261] T 3ebdb5b29dbd412e96dbcda013ea1724 P 3e8ddfc3c5534dbd88bb4d10b61eef3c [term 1 FOLLOWER]: Refusing update from remote peer 85aaf6b6511e44698d5245b172f71008: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:34:12.359561 23000 raft_consensus.cc:1261] T 3ebdb5b29dbd412e96dbcda013ea1724 P 58a435968eb440fe9e5e17a994e9e721 [term 1 FOLLOWER]: Refusing update from remote peer 85aaf6b6511e44698d5245b172f71008: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:34:12.360424 23134 consensus_queue.cc:1035] T 3ebdb5b29dbd412e96dbcda013ea1724 P 85aaf6b6511e44698d5245b172f71008 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e8ddfc3c5534dbd88bb4d10b61eef3c" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:34:12.360635 23129 consensus_queue.cc:1035] T 3ebdb5b29dbd412e96dbcda013ea1724 P 85aaf6b6511e44698d5245b172f71008 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58a435968eb440fe9e5e17a994e9e721" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 42891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:34:12.370584 23142 mvcc.cc:205] Tried to move back new op lower bound from 7316273776056160256 to 7316273775774597120. Current Snapshot: MvccSnapshot[applied={T|T < 7316273776056160256}]
I20260808 14:34:12.371474 23143 mvcc.cc:205] Tried to move back new op lower bound from 7316273776056160256 to 7316273775774597120. Current Snapshot: MvccSnapshot[applied={T|T < 7316273776056160256}]
I20260808 14:34:12.380714 21262 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57716:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:34:12.380882 21262 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57716:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:34:12.385143 21262 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 18af051302ab4a05a7b6b26e56688462: Sending DeleteTablet for 3 replicas of tablet 3ebdb5b29dbd412e96dbcda013ea1724
I20260808 14:34:12.386094 22970 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ebdb5b29dbd412e96dbcda013ea1724 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:34:12 UTC) from {username='oryx', principal='oryx/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:49418
I20260808 14:34:12.386119 22565 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ebdb5b29dbd412e96dbcda013ea1724 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:34:12 UTC) from {username='oryx', principal='oryx/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:48292
I20260808 14:34:12.386642 23153 tablet_replica.cc:330] T 3ebdb5b29dbd412e96dbcda013ea1724 P 58a435968eb440fe9e5e17a994e9e721: stopping tablet replica
I20260808 14:34:12.387015 23153 raft_consensus.cc:2229] T 3ebdb5b29dbd412e96dbcda013ea1724 P 58a435968eb440fe9e5e17a994e9e721 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:34:12.387403 23153 raft_consensus.cc:2258] T 3ebdb5b29dbd412e96dbcda013ea1724 P 58a435968eb440fe9e5e17a994e9e721 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:34:12.387619 22728 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ebdb5b29dbd412e96dbcda013ea1724 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:34:12 UTC) from {username='oryx', principal='oryx/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:50506
I20260808 14:34:12.387671 23154 tablet_replica.cc:330] T 3ebdb5b29dbd412e96dbcda013ea1724 P 85aaf6b6511e44698d5245b172f71008: stopping tablet replica
I20260808 14:34:12.387976 23154 raft_consensus.cc:2229] T 3ebdb5b29dbd412e96dbcda013ea1724 P 85aaf6b6511e44698d5245b172f71008 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:34:12.388403 23154 raft_consensus.cc:2258] T 3ebdb5b29dbd412e96dbcda013ea1724 P 85aaf6b6511e44698d5245b172f71008 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:34:12.389400 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 21217
I20260808 14:34:12.392676 23153 ts_tablet_manager.cc:1905] T 3ebdb5b29dbd412e96dbcda013ea1724 P 58a435968eb440fe9e5e17a994e9e721: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:34:12.393000 23154 ts_tablet_manager.cc:1905] T 3ebdb5b29dbd412e96dbcda013ea1724 P 85aaf6b6511e44698d5245b172f71008: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:34:12.398074 23153 ts_tablet_manager.cc:1918] T 3ebdb5b29dbd412e96dbcda013ea1724 P 58a435968eb440fe9e5e17a994e9e721: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:34:12.398252 23153 log.cc:1196] T 3ebdb5b29dbd412e96dbcda013ea1724 P 58a435968eb440fe9e5e17a994e9e721: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-2/wal/wals/3ebdb5b29dbd412e96dbcda013ea1724
I20260808 14:34:12.398557 23154 ts_tablet_manager.cc:1918] T 3ebdb5b29dbd412e96dbcda013ea1724 P 85aaf6b6511e44698d5245b172f71008: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:34:12.399075 23153 ts_tablet_manager.cc:1939] T 3ebdb5b29dbd412e96dbcda013ea1724 P 58a435968eb440fe9e5e17a994e9e721: Deleting consensus metadata
I20260808 14:34:12.399214 23154 log.cc:1196] T 3ebdb5b29dbd412e96dbcda013ea1724 P 85aaf6b6511e44698d5245b172f71008: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-0/wal/wals/3ebdb5b29dbd412e96dbcda013ea1724
I20260808 14:34:12.399583 23154 ts_tablet_manager.cc:1939] T 3ebdb5b29dbd412e96dbcda013ea1724 P 85aaf6b6511e44698d5245b172f71008: Deleting consensus metadata
I20260808 14:34:12.405551 23159 tablet_replica.cc:330] T 3ebdb5b29dbd412e96dbcda013ea1724 P 3e8ddfc3c5534dbd88bb4d10b61eef3c: stopping tablet replica
I20260808 14:34:12.405936 23159 raft_consensus.cc:2229] T 3ebdb5b29dbd412e96dbcda013ea1724 P 3e8ddfc3c5534dbd88bb4d10b61eef3c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:34:12.406324 23159 raft_consensus.cc:2258] T 3ebdb5b29dbd412e96dbcda013ea1724 P 3e8ddfc3c5534dbd88bb4d10b61eef3c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:34:12.408273 23159 ts_tablet_manager.cc:1905] T 3ebdb5b29dbd412e96dbcda013ea1724 P 3e8ddfc3c5534dbd88bb4d10b61eef3c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:34:12.411577 23159 ts_tablet_manager.cc:1918] T 3ebdb5b29dbd412e96dbcda013ea1724 P 3e8ddfc3c5534dbd88bb4d10b61eef3c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:34:12.411733 23159 log.cc:1196] T 3ebdb5b29dbd412e96dbcda013ea1724 P 3e8ddfc3c5534dbd88bb4d10b61eef3c: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-1/wal/wals/3ebdb5b29dbd412e96dbcda013ea1724
I20260808 14:34:12.411902 22302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:12.388476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46914 (local address 127.11.131.253:36145)
0808 14:34:12.389332 (+ 856us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:12.389336 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:12.389349 (+ 13us) server_negotiation.cc:407] Connection header received
0808 14:34:12.389389 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:12.389393 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:12.389445 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:12.389525 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:12.399889 (+ 10364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:12.400983 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:12.402420 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:12.402797 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:12.402905 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:12.407777 (+ 4872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:12.407781 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:12.407784 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:12.407857 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:12.409663 (+ 1806us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:12.410240 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:12.410244 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:12.410245 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:12.410342 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:12.410748 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:12.410752 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:12.410754 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:12.410998 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:12.411115 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:12.411552 (+ 437us) server_negotiation.cc:299] Negotiation successful
0808 14:34:12.411696 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":785}
I20260808 14:34:12.412259 23159 ts_tablet_manager.cc:1939] T 3ebdb5b29dbd412e96dbcda013ea1724 P 3e8ddfc3c5534dbd88bb4d10b61eef3c: Deleting consensus metadata
W20260808 14:34:12.414454 22687 connection.cc:535] server connection from 127.0.0.1:50506 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 14:34:12.414511 22888 connection.cc:535] server connection from 127.0.0.1:49418 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 14:34:12.414884 22494 connection.cc:535] server connection from 127.0.0.1:48292 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 14:34:12.422055 23088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:12.388727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44042 (local address 127.11.131.252:39635)
0808 14:34:12.389237 (+ 510us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:12.389242 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:12.412897 (+ 23655us) server_negotiation.cc:407] Connection header received
0808 14:34:12.413100 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:12.413104 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:12.413159 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:12.413213 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:12.414054 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:12.414857 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:12.415689 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:12.415981 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:12.416080 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:12.417913 (+ 1833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:12.417919 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:12.417921 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:12.417954 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:12.419805 (+ 1851us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:12.420372 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:12.420376 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:12.420380 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:12.420480 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:12.420797 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:12.420802 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:12.420805 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:12.421033 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:12.421658 (+ 625us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:12.421741 (+ 83us) server_negotiation.cc:299] Negotiation successful
0808 14:34:12.421886 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":428}
I20260808 14:34:12.428818 22666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:12.419402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44058 (local address 127.11.131.252:39635)
0808 14:34:12.419508 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:12.419514 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:12.419859 (+ 345us) server_negotiation.cc:407] Connection header received
0808 14:34:12.420018 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:12.420021 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:12.420063 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:12.420111 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:12.421059 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:12.421840 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:12.423331 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:12.423653 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:12.423772 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:12.425428 (+ 1656us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:12.425432 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:12.425434 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:12.425459 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:12.427138 (+ 1679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:12.427576 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:12.427580 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:12.427582 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:12.427668 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:12.427962 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:12.427967 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:12.427968 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:12.428146 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:12.428286 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:12.428524 (+ 238us) server_negotiation.cc:299] Negotiation successful
0808 14:34:12.428662 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 14:34:12.428822 22302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:12.418766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46930 (local address 127.11.131.253:36145)
0808 14:34:12.418878 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:12.418882 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:12.419441 (+ 559us) server_negotiation.cc:407] Connection header received
0808 14:34:12.419684 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:12.419688 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:12.419754 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:12.419811 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:12.420857 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:12.421609 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:12.422993 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:12.423298 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:12.423385 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:12.425201 (+ 1816us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:12.425205 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:12.425208 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:12.425233 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:12.426916 (+ 1683us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:12.427383 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:12.427386 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:12.427388 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:12.427478 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:12.427840 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:12.427844 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:12.427846 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:12.428055 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:12.428151 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:12.428516 (+ 365us) server_negotiation.cc:299] Negotiation successful
0808 14:34:12.428661 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 14:34:13.374143 23170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:13.373510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:38851 (local address 127.11.131.193:33377)
0808 14:34:13.373885 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:13.374009 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:38851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":87,"threads_started":1}
W20260808 14:34:13.374624 22658 heartbeater.cc:644] Failed to heartbeat to 127.11.131.254:38851 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.11.131.254:38851: connect: Connection refused (error 111)
I20260808 14:34:13.375471 23171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:13.374956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:38851 (local address 127.11.131.195:45611)
0808 14:34:13.375313 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:13.375391 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:38851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":84,"threads_started":1}
W20260808 14:34:13.375968 23067 heartbeater.cc:644] Failed to heartbeat to 127.11.131.254:38851 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.11.131.254:38851: connect: Connection refused (error 111)
I20260808 14:34:13.377701 23173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:13.377286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:38851 (local address 127.11.131.194:40691)
0808 14:34:13.377511 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:13.377583 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:38851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":67,"threads_started":1}
W20260808 14:34:13.377992 22847 heartbeater.cc:644] Failed to heartbeat to 127.11.131.254:38851 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.11.131.254:38851: connect: Connection refused (error 111)
I20260808 14:34:13.885679 23174 raft_consensus.cc:482] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18af051302ab4a05a7b6b26e56688462)
I20260808 14:34:13.885874 23174 raft_consensus.cc:504] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: false } } peers { permanent_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 39635 } attrs { promote: false } }
I20260808 14:34:13.886523 23174 leader_election.cc:288] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18af051302ab4a05a7b6b26e56688462 (127.11.131.254:38851), f8a29b80ba4b4376b671b2f015f6c5f9 (127.11.131.253:36145)
I20260808 14:34:13.887080 23178 raft_consensus.cc:482] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 18af051302ab4a05a7b6b26e56688462)
I20260808 14:34:13.887290 23178 raft_consensus.cc:504] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: false } } peers { permanent_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 39635 } attrs { promote: false } }
I20260808 14:34:13.887822 23181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:13.887049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:38851 (local address 127.0.0.1:59628)
0808 14:34:13.887599 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:13.887690 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:38851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":490,"thread_start_us":74,"threads_started":1}
W20260808 14:34:13.888043 22384 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.131.254:38851: connect: Connection refused (error 111)
I20260808 14:34:13.888532 23178 leader_election.cc:288] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18af051302ab4a05a7b6b26e56688462 (127.11.131.254:38851), b4a11c28fe8a4334a428d2a865e69e7b (127.11.131.252:39635)
I20260808 14:34:13.888979 23183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:13.888579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:38851 (local address 127.0.0.1:59642)
0808 14:34:13.888805 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:13.888883 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:38851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":93,"threads_started":1}
W20260808 14:34:13.889251 22112 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.131.254:38851: connect: Connection refused (error 111)
I20260808 14:34:13.889374 23181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:13.889083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:38851 (local address 127.0.0.1:59656)
0808 14:34:13.889239 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:13.889290 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:38851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
W20260808 14:34:13.889475 22384 leader_election.cc:334] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 18af051302ab4a05a7b6b26e56688462 (127.11.131.254:38851): Network error: Client connection negotiation failed: client connection to 127.11.131.254:38851: connect: Connection refused (error 111)
I20260808 14:34:13.890266 23185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:13.890041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:38851 (local address 127.0.0.1:59662)
0808 14:34:13.890146 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:13.890197 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:38851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260808 14:34:13.890579 22112 leader_election.cc:334] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 18af051302ab4a05a7b6b26e56688462 (127.11.131.254:38851): Network error: Client connection negotiation failed: client connection to 127.11.131.254:38851: connect: Connection refused (error 111)
I20260808 14:34:13.892858 23176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:13.886752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.253:36145 (local address 127.0.0.1:46932)
0808 14:34:13.887501 (+ 749us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:13.887520 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:13.887669 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:13.888089 (+ 420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:13.888091 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:13.888108 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:34:13.888212 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:13.888218 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:13.890393 (+ 2175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:13.890396 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:13.891406 (+ 1010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:13.891416 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:13.892316 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:13.892320 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:13.892489 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:13.892531 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 14:34:13.892615 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 14:34:13.892715 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":588,"mutex_wait_us":30,"thread_start_us":73,"threads_started":1}
I20260808 14:34:13.892887 23186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:13.888890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44070 (local address 127.11.131.252:39635)
0808 14:34:13.889122 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:13.889131 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:13.889237 (+ 106us) server_negotiation.cc:407] Connection header received
0808 14:34:13.889350 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:13.889352 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:13.889397 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:13.889533 (+ 136us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:34:13.889845 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:13.890571 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:13.891724 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:13.892324 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:13.892488 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:13.892541 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:13.892666 (+ 125us) server_negotiation.cc:299] Negotiation successful
0808 14:34:13.892753 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":42,"server-negotiator.queue_time_us":172,"thread_start_us":93,"threads_started":1}
I20260808 14:34:13.893055 23179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:13.886843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46932 (local address 127.11.131.253:36145)
0808 14:34:13.887337 (+ 494us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:13.887343 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:13.887588 (+ 245us) server_negotiation.cc:407] Connection header received
0808 14:34:13.887799 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:13.887802 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:13.887862 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:13.887929 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:34:13.888353 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:13.890261 (+ 1908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:13.891535 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:13.892191 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:13.892313 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:13.892378 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:13.892652 (+ 274us) server_negotiation.cc:299] Negotiation successful
0808 14:34:13.892814 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":74,"server-negotiator.queue_time_us":413,"thread_start_us":49,"threads_started":1}
I20260808 14:34:13.893077 23183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:13.888767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.252:39635 (local address 127.0.0.1:44070)
0808 14:34:13.889140 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:13.889153 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:13.889263 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:13.889569 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:13.889573 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:13.889596 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:34:13.889708 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:13.889714 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:13.890713 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:13.890716 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:13.891597 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:13.891608 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:13.892447 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:13.892450 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:13.892543 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:13.892577 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 14:34:13.892648 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 14:34:13.892795 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":317,"mutex_wait_us":25,"thread_start_us":85,"threads_started":1}
I20260808 14:34:13.893376 22143 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" is_pre_election: true
I20260808 14:34:13.893561 22143 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4a11c28fe8a4334a428d2a865e69e7b in term 1.
I20260808 14:34:13.893556 22417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" is_pre_election: true
I20260808 14:34:13.893805 22417 raft_consensus.cc:2454] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8a29b80ba4b4376b671b2f015f6c5f9 in term 1.
I20260808 14:34:13.893873 22388 leader_election.cc:302] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b4a11c28fe8a4334a428d2a865e69e7b, f8a29b80ba4b4376b671b2f015f6c5f9; no voters: 18af051302ab4a05a7b6b26e56688462
I20260808 14:34:13.894042 23174 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260808 14:34:13.894101 23174 raft_consensus.cc:482] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 18af051302ab4a05a7b6b26e56688462)
I20260808 14:34:13.894155 23174 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [term 1 FOLLOWER]: Advancing to term 2
I20260808 14:34:13.894150 22116 leader_election.cc:302] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b4a11c28fe8a4334a428d2a865e69e7b, f8a29b80ba4b4376b671b2f015f6c5f9; no voters: 18af051302ab4a05a7b6b26e56688462
I20260808 14:34:13.894377 23178 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260808 14:34:13.894439 23178 raft_consensus.cc:482] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 18af051302ab4a05a7b6b26e56688462)
I20260808 14:34:13.894495 23178 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [term 1 FOLLOWER]: Advancing to term 2
I20260808 14:34:13.895562 23174 raft_consensus.cc:504] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: false } } peers { permanent_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 39635 } attrs { promote: false } }
I20260808 14:34:13.895735 23178 raft_consensus.cc:504] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: false } } peers { permanent_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 39635 } attrs { promote: false } }
I20260808 14:34:13.895992 23174 leader_election.cc:288] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [CANDIDATE]: Term 2 election: Requested vote from peers 18af051302ab4a05a7b6b26e56688462 (127.11.131.254:38851), f8a29b80ba4b4376b671b2f015f6c5f9 (127.11.131.253:36145)
I20260808 14:34:13.896080 23178 leader_election.cc:288] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [CANDIDATE]: Term 2 election: Requested vote from peers 18af051302ab4a05a7b6b26e56688462 (127.11.131.254:38851), b4a11c28fe8a4334a428d2a865e69e7b (127.11.131.252:39635)
I20260808 14:34:13.896317 22143 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9"
I20260808 14:34:13.896384 23176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:13.896156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:38851 (local address 127.0.0.1:59664)
0808 14:34:13.896251 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:13.896308 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:38851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260808 14:34:13.896493 22143 raft_consensus.cc:2379] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b4a11c28fe8a4334a428d2a865e69e7b in current term 2: Already voted for candidate f8a29b80ba4b4376b671b2f015f6c5f9 in this term.
I20260808 14:34:13.896442 22417 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "b4a11c28fe8a4334a428d2a865e69e7b"
I20260808 14:34:13.896615 22417 raft_consensus.cc:2379] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f8a29b80ba4b4376b671b2f015f6c5f9 in current term 2: Already voted for candidate b4a11c28fe8a4334a428d2a865e69e7b in this term.
I20260808 14:34:13.897127 23176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:13.896856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:38851 (local address 127.0.0.1:59666)
0808 14:34:13.896996 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:13.897057 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:38851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260808 14:34:13.897163 23183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:13.896969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:38851 (local address 127.0.0.1:59670)
0808 14:34:13.897058 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:13.897104 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:38851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260808 14:34:13.897274 22384 leader_election.cc:334] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 18af051302ab4a05a7b6b26e56688462 (127.11.131.254:38851): Network error: Client connection negotiation failed: client connection to 127.11.131.254:38851: connect: Connection refused (error 111)
I20260808 14:34:13.897367 22384 leader_election.cc:302] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b4a11c28fe8a4334a428d2a865e69e7b; no voters: 18af051302ab4a05a7b6b26e56688462, f8a29b80ba4b4376b671b2f015f6c5f9
I20260808 14:34:13.897504 23174 raft_consensus.cc:2726] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260808 14:34:13.897928 23183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:13.897630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:38851 (local address 127.0.0.1:59680)
0808 14:34:13.897786 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:13.897862 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:38851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
W20260808 14:34:13.898072 22112 leader_election.cc:334] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 18af051302ab4a05a7b6b26e56688462 (127.11.131.254:38851): Network error: Client connection negotiation failed: client connection to 127.11.131.254:38851: connect: Connection refused (error 111)
I20260808 14:34:13.898150 22112 leader_election.cc:302] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8a29b80ba4b4376b671b2f015f6c5f9; no voters: 18af051302ab4a05a7b6b26e56688462, b4a11c28fe8a4334a428d2a865e69e7b
I20260808 14:34:13.898336 23178 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260808 14:34:14.376157 23188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:14.375540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:38851 (local address 127.11.131.193:58397)
0808 14:34:14.375932 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:14.376028 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:38851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":104,"threads_started":1}
I20260808 14:34:14.377504 23189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:14.376844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:38851 (local address 127.11.131.195:53039)
0808 14:34:14.377327 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:14.377399 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:38851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":98,"threads_started":1}
I20260808 14:34:14.378921 23190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:14.378496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:38851 (local address 127.11.131.194:58129)
0808 14:34:14.378781 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:14.378834 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:38851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":73,"threads_started":1}
I20260808 14:34:15.377811 23192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:15.377253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:38851 (local address 127.11.131.193:37591)
0808 14:34:15.377599 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:15.377679 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:38851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":131,"threads_started":1}
I20260808 14:34:15.379523 23193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:15.378589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:38851 (local address 127.11.131.195:48081)
0808 14:34:15.379318 (+ 729us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:15.379403 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:38851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":646,"thread_start_us":78,"threads_started":1}
I20260808 14:34:15.380146 23195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:15.379685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:38851 (local address 127.11.131.194:56561)
0808 14:34:15.379998 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:15.380066 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:38851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":90,"threads_started":1}
I20260808 14:34:15.758082 23196 raft_consensus.cc:482] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:34:15.758302 23196 raft_consensus.cc:504] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: false } } peers { permanent_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 39635 } attrs { promote: false } }
I20260808 14:34:15.758818 23196 leader_election.cc:288] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 18af051302ab4a05a7b6b26e56688462 (127.11.131.254:38851), f8a29b80ba4b4376b671b2f015f6c5f9 (127.11.131.253:36145)
I20260808 14:34:15.759404 22143 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" is_pre_election: true
I20260808 14:34:15.759582 22143 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4a11c28fe8a4334a428d2a865e69e7b in term 2.
I20260808 14:34:15.759619 23197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:15.759129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:38851 (local address 127.0.0.1:59952)
0808 14:34:15.759415 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:15.759482 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:38851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":76,"threads_started":1}
I20260808 14:34:15.759941 22388 leader_election.cc:302] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b4a11c28fe8a4334a428d2a865e69e7b, f8a29b80ba4b4376b671b2f015f6c5f9; no voters:
I20260808 14:34:15.760177 23196 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260808 14:34:15.760298 23196 raft_consensus.cc:482] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:34:15.760352 23196 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [term 2 FOLLOWER]: Advancing to term 3
I20260808 14:34:15.760667 23197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:15.760427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:38851 (local address 127.0.0.1:59954)
0808 14:34:15.760544 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:15.760606 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:38851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260808 14:34:15.760848 22384 leader_election.cc:334] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 18af051302ab4a05a7b6b26e56688462 (127.11.131.254:38851): Network error: Client connection negotiation failed: client connection to 127.11.131.254:38851: connect: Connection refused (error 111)
I20260808 14:34:15.761694 23196 raft_consensus.cc:504] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: false } } peers { permanent_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 39635 } attrs { promote: false } }
I20260808 14:34:15.762053 23196 leader_election.cc:288] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [CANDIDATE]: Term 3 election: Requested vote from peers 18af051302ab4a05a7b6b26e56688462 (127.11.131.254:38851), f8a29b80ba4b4376b671b2f015f6c5f9 (127.11.131.253:36145)
I20260808 14:34:15.762508 23197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:15.762284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:38851 (local address 127.0.0.1:59964)
0808 14:34:15.762394 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:15.762444 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:38851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260808 14:34:15.762544 22143 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9"
I20260808 14:34:15.762777 22143 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [term 2 FOLLOWER]: Advancing to term 3
I20260808 14:34:15.763254 23197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:15.763032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:38851 (local address 127.0.0.1:59978)
0808 14:34:15.763138 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:15.763203 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:38851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260808 14:34:15.763370 22384 leader_election.cc:334] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 18af051302ab4a05a7b6b26e56688462 (127.11.131.254:38851): Network error: Client connection negotiation failed: client connection to 127.11.131.254:38851: connect: Connection refused (error 111)
I20260808 14:34:15.763911 22143 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4a11c28fe8a4334a428d2a865e69e7b in term 3.
I20260808 14:34:15.764250 22388 leader_election.cc:302] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b4a11c28fe8a4334a428d2a865e69e7b, f8a29b80ba4b4376b671b2f015f6c5f9; no voters: 18af051302ab4a05a7b6b26e56688462
I20260808 14:34:15.764492 23196 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [term 3 FOLLOWER]: Leader election won for term 3
I20260808 14:34:15.764758 23196 raft_consensus.cc:686] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [term 3 LEADER]: Becoming Leader. State: Replica: b4a11c28fe8a4334a428d2a865e69e7b, State: Running, Role: LEADER
I20260808 14:34:15.765064 23196 consensus_queue.cc:237] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: false } } peers { permanent_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 39635 } attrs { promote: false } }
I20260808 14:34:15.766654 23199 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [sys.catalog]: SysCatalogTable state changed. Reason: New leader b4a11c28fe8a4334a428d2a865e69e7b. Latest consensus state: current_term: 3 leader_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: false } } peers { permanent_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 39635 } attrs { promote: false } } }
I20260808 14:34:15.766803 23199 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [sys.catalog]: This master's current role is: LEADER
I20260808 14:34:15.767148 23203 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:34:15.769583 23203 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:34:15.770002 23203 catalog_manager.cc:1259] Loaded cluster ID: 54a60cc90df341f0b548154a83c2ced5
I20260808 14:34:15.770049 23203 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:34:15.770682 23203 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:34:15.771081 23203 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b: Loaded TSK: 0
I20260808 14:34:15.771802 23203 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:34:15.808990 22403 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44058:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:34:15.812423 22403 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:34:15.815778 23197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:15.815506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:38851 (local address 127.0.0.1:59990)
0808 14:34:15.815650 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:15.815703 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:38851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260808 14:34:15.815896 22143 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [term 3 FOLLOWER]: Refusing update from remote peer b4a11c28fe8a4334a428d2a865e69e7b: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260808 14:34:15.816519 23199 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260808 14:34:15.816670 23197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:15.816384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:38851 (local address 127.0.0.1:60006)
0808 14:34:15.816542 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:15.816603 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:38851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
W20260808 14:34:15.816823 22384 consensus_peers.cc:487] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b -> Peer 18af051302ab4a05a7b6b26e56688462 (127.11.131.254:38851): Couldn't send request to peer 18af051302ab4a05a7b6b26e56688462. Status: Network error: Client connection negotiation failed: client connection to 127.11.131.254:38851: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 14:34:15.818277 23206 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b4a11c28fe8a4334a428d2a865e69e7b. Latest consensus state: current_term: 3 leader_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: false } } peers { permanent_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 39635 } attrs { promote: false } } }
I20260808 14:34:15.818408 23206 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:34:15.819837 23199 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: false } } peers { permanent_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 39635 } attrs { promote: false } } }
I20260808 14:34:15.820005 23199 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b [sys.catalog]: This master's current role is: LEADER
I20260808 14:34:15.820078 23206 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "18af051302ab4a05a7b6b26e56688462" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38851 } } peers { permanent_uuid: "f8a29b80ba4b4376b671b2f015f6c5f9" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36145 } attrs { promote: false } } peers { permanent_uuid: "b4a11c28fe8a4334a428d2a865e69e7b" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 39635 } attrs { promote: false } } }
I20260808 14:34:15.820206 23206 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8a29b80ba4b4376b671b2f015f6c5f9 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:34:15.830371 23197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:15.826087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:42373 (local address 127.0.0.1:57240)
0808 14:34:15.826563 (+ 476us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:15.826581 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:15.826706 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:15.827093 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:15.827096 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:15.827119 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:34:15.827240 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:15.827247 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:15.828247 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:15.828250 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:15.829192 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:15.829201 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:15.829907 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:15.829911 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:15.830006 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:15.830050 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 14:34:15.830150 (+ 100us) client_negotiation.cc:240] Negotiation successful
0808 14:34:15.830226 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":388}
I20260808 14:34:15.831218 23221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:15.826294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57240 (local address 127.11.131.193:42373)
0808 14:34:15.826795 (+ 501us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:15.826800 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:15.826814 (+ 14us) server_negotiation.cc:407] Connection header received
0808 14:34:15.826881 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:15.826887 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:15.826950 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:15.827078 (+ 128us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:34:15.827369 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:15.828156 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:15.829330 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:15.829773 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:15.829916 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:15.829978 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:15.830947 (+ 969us) server_negotiation.cc:299] Negotiation successful
0808 14:34:15.831056 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":404,"thread_start_us":105,"threads_started":1}
I20260808 14:34:15.831403 23227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:15.826341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.195:42891 (local address 127.0.0.1:41730)
0808 14:34:15.827083 (+ 742us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:15.827096 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:15.827182 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:15.827528 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:15.827531 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:15.827547 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:34:15.827644 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:15.827651 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:15.828728 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:15.828730 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:15.829954 (+ 1224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:15.829965 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:15.830968 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:15.830972 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:15.831065 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:15.831102 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 14:34:15.831180 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 14:34:15.831254 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":667,"thread_start_us":106,"threads_started":1}
I20260808 14:34:15.831774 22565 tablet_service.cc:1467] Processing CreateTablet for tablet 412efe8a3c40428e9aac5b90e00f0576 (DEFAULT_TABLE table=test-table [id=654b1c923e0442e08045559670b3e515]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:34:15.832139 22565 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 412efe8a3c40428e9aac5b90e00f0576. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:34:15.832724 23229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:15.827243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39364 (local address 127.11.131.194:40983)
0808 14:34:15.827874 (+ 631us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:15.827880 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:15.828106 (+ 226us) server_negotiation.cc:407] Connection header received
0808 14:34:15.828204 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:15.828209 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:15.828269 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:15.828390 (+ 121us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:34:15.828668 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:15.829486 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:15.831121 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:15.832015 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:15.832149 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:15.832213 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:15.832521 (+ 308us) server_negotiation.cc:299] Negotiation successful
0808 14:34:15.832592 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":536,"thread_start_us":86,"threads_started":1}
I20260808 14:34:15.832736 23223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:15.826821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.194:40983 (local address 127.0.0.1:39364)
0808 14:34:15.828003 (+ 1182us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:15.828016 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:15.828113 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:15.828411 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:15.828414 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:15.828432 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:34:15.828552 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:15.828557 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:15.829622 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:15.829625 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:15.830952 (+ 1327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:15.830963 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:15.832279 (+ 1316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:15.832282 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:15.832385 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:15.832409 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 14:34:15.832492 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 14:34:15.832578 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1125,"mutex_wait_us":210,"thread_start_us":116,"threads_started":1}
I20260808 14:34:15.833457 22728 tablet_service.cc:1467] Processing CreateTablet for tablet 412efe8a3c40428e9aac5b90e00f0576 (DEFAULT_TABLE table=test-table [id=654b1c923e0442e08045559670b3e515]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:34:15.833789 22728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 412efe8a3c40428e9aac5b90e00f0576. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:34:15.831442 23226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:15.826478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41730 (local address 127.11.131.195:42891)
0808 14:34:15.826789 (+ 311us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:15.826793 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:15.827272 (+ 479us) server_negotiation.cc:407] Connection header received
0808 14:34:15.827359 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:15.827362 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:15.827415 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:15.827503 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:34:15.827796 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:15.828620 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:15.830063 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:15.830708 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:15.830844 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:15.830908 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:15.831203 (+ 295us) server_negotiation.cc:299] Negotiation successful
0808 14:34:15.831298 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":211,"thread_start_us":85,"threads_started":1}
I20260808 14:34:15.835232 23230 tablet_bootstrap.cc:492] T 412efe8a3c40428e9aac5b90e00f0576 P 85aaf6b6511e44698d5245b172f71008: Bootstrap starting.
I20260808 14:34:15.835232 22970 tablet_service.cc:1467] Processing CreateTablet for tablet 412efe8a3c40428e9aac5b90e00f0576 (DEFAULT_TABLE table=test-table [id=654b1c923e0442e08045559670b3e515]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:34:15.835518 22970 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 412efe8a3c40428e9aac5b90e00f0576. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:34:15.836207 23231 tablet_bootstrap.cc:492] T 412efe8a3c40428e9aac5b90e00f0576 P 3e8ddfc3c5534dbd88bb4d10b61eef3c: Bootstrap starting.
I20260808 14:34:15.836316 23230 tablet_bootstrap.cc:654] T 412efe8a3c40428e9aac5b90e00f0576 P 85aaf6b6511e44698d5245b172f71008: Neither blocks nor log segments found. Creating new log.
I20260808 14:34:15.836961 23231 tablet_bootstrap.cc:654] T 412efe8a3c40428e9aac5b90e00f0576 P 3e8ddfc3c5534dbd88bb4d10b61eef3c: Neither blocks nor log segments found. Creating new log.
I20260808 14:34:15.837788 23230 tablet_bootstrap.cc:492] T 412efe8a3c40428e9aac5b90e00f0576 P 85aaf6b6511e44698d5245b172f71008: No bootstrap required, opened a new log
I20260808 14:34:15.837903 23230 ts_tablet_manager.cc:1397] T 412efe8a3c40428e9aac5b90e00f0576 P 85aaf6b6511e44698d5245b172f71008: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 14:34:15.838101 23231 tablet_bootstrap.cc:492] T 412efe8a3c40428e9aac5b90e00f0576 P 3e8ddfc3c5534dbd88bb4d10b61eef3c: No bootstrap required, opened a new log
I20260808 14:34:15.838186 23231 ts_tablet_manager.cc:1397] T 412efe8a3c40428e9aac5b90e00f0576 P 3e8ddfc3c5534dbd88bb4d10b61eef3c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:34:15.838267 23235 tablet_bootstrap.cc:492] T 412efe8a3c40428e9aac5b90e00f0576 P 58a435968eb440fe9e5e17a994e9e721: Bootstrap starting.
I20260808 14:34:15.838397 23230 raft_consensus.cc:348] T 412efe8a3c40428e9aac5b90e00f0576 P 85aaf6b6511e44698d5245b172f71008 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85aaf6b6511e44698d5245b172f71008" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 42373 } } peers { permanent_uuid: "58a435968eb440fe9e5e17a994e9e721" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 42891 } } peers { permanent_uuid: "3e8ddfc3c5534dbd88bb4d10b61eef3c" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40983 } }
I20260808 14:34:15.838513 23230 raft_consensus.cc:374] T 412efe8a3c40428e9aac5b90e00f0576 P 85aaf6b6511e44698d5245b172f71008 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:34:15.838542 23230 raft_consensus.cc:729] T 412efe8a3c40428e9aac5b90e00f0576 P 85aaf6b6511e44698d5245b172f71008 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85aaf6b6511e44698d5245b172f71008, State: Initialized, Role: FOLLOWER
I20260808 14:34:15.838660 23231 raft_consensus.cc:348] T 412efe8a3c40428e9aac5b90e00f0576 P 3e8ddfc3c5534dbd88bb4d10b61eef3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85aaf6b6511e44698d5245b172f71008" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 42373 } } peers { permanent_uuid: "58a435968eb440fe9e5e17a994e9e721" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 42891 } } peers { permanent_uuid: "3e8ddfc3c5534dbd88bb4d10b61eef3c" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40983 } }
I20260808 14:34:15.838711 23230 consensus_queue.cc:260] T 412efe8a3c40428e9aac5b90e00f0576 P 85aaf6b6511e44698d5245b172f71008 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85aaf6b6511e44698d5245b172f71008" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 42373 } } peers { permanent_uuid: "58a435968eb440fe9e5e17a994e9e721" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 42891 } } peers { permanent_uuid: "3e8ddfc3c5534dbd88bb4d10b61eef3c" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40983 } }
I20260808 14:34:15.838788 23231 raft_consensus.cc:374] T 412efe8a3c40428e9aac5b90e00f0576 P 3e8ddfc3c5534dbd88bb4d10b61eef3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:34:15.838822 23231 raft_consensus.cc:729] T 412efe8a3c40428e9aac5b90e00f0576 P 3e8ddfc3c5534dbd88bb4d10b61eef3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8ddfc3c5534dbd88bb4d10b61eef3c, State: Initialized, Role: FOLLOWER
I20260808 14:34:15.838990 23231 consensus_queue.cc:260] T 412efe8a3c40428e9aac5b90e00f0576 P 3e8ddfc3c5534dbd88bb4d10b61eef3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85aaf6b6511e44698d5245b172f71008" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 42373 } } peers { permanent_uuid: "58a435968eb440fe9e5e17a994e9e721" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 42891 } } peers { permanent_uuid: "3e8ddfc3c5534dbd88bb4d10b61eef3c" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40983 } }
I20260808 14:34:15.839131 23230 ts_tablet_manager.cc:1428] T 412efe8a3c40428e9aac5b90e00f0576 P 85aaf6b6511e44698d5245b172f71008: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:34:15.839344 23231 ts_tablet_manager.cc:1428] T 412efe8a3c40428e9aac5b90e00f0576 P 3e8ddfc3c5534dbd88bb4d10b61eef3c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:34:15.839813 23235 tablet_bootstrap.cc:654] T 412efe8a3c40428e9aac5b90e00f0576 P 58a435968eb440fe9e5e17a994e9e721: Neither blocks nor log segments found. Creating new log.
I20260808 14:34:15.840026 23192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:15.839598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:38851 (local address 127.11.131.193:57745)
0808 14:34:15.839877 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:15.839943 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:38851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179}
I20260808 14:34:15.841128 23235 tablet_bootstrap.cc:492] T 412efe8a3c40428e9aac5b90e00f0576 P 58a435968eb440fe9e5e17a994e9e721: No bootstrap required, opened a new log
I20260808 14:34:15.841226 23235 ts_tablet_manager.cc:1397] T 412efe8a3c40428e9aac5b90e00f0576 P 58a435968eb440fe9e5e17a994e9e721: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 14:34:15.841703 23192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:15.841410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:38851 (local address 127.11.131.193:35207)
0808 14:34:15.841581 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:15.841633 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:38851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
I20260808 14:34:15.841656 23235 raft_consensus.cc:348] T 412efe8a3c40428e9aac5b90e00f0576 P 58a435968eb440fe9e5e17a994e9e721 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85aaf6b6511e44698d5245b172f71008" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 42373 } } peers { permanent_uuid: "58a435968eb440fe9e5e17a994e9e721" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 42891 } } peers { permanent_uuid: "3e8ddfc3c5534dbd88bb4d10b61eef3c" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40983 } }
I20260808 14:34:15.841763 23235 raft_consensus.cc:374] T 412efe8a3c40428e9aac5b90e00f0576 P 58a435968eb440fe9e5e17a994e9e721 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:34:15.841804 23235 raft_consensus.cc:729] T 412efe8a3c40428e9aac5b90e00f0576 P 58a435968eb440fe9e5e17a994e9e721 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58a435968eb440fe9e5e17a994e9e721, State: Initialized, Role: FOLLOWER
I20260808 14:34:15.841948 23235 consensus_queue.cc:260] T 412efe8a3c40428e9aac5b90e00f0576 P 58a435968eb440fe9e5e17a994e9e721 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85aaf6b6511e44698d5245b172f71008" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 42373 } } peers { permanent_uuid: "58a435968eb440fe9e5e17a994e9e721" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 42891 } } peers { permanent_uuid: "3e8ddfc3c5534dbd88bb4d10b61eef3c" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40983 } }
I20260808 14:34:15.842252 23195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:15.841974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:38851 (local address 127.11.131.194:55441)
0808 14:34:15.842120 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:15.842178 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:38851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260808 14:34:15.842348 23235 ts_tablet_manager.cc:1428] T 412efe8a3c40428e9aac5b90e00f0576 P 58a435968eb440fe9e5e17a994e9e721: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260808 14:34:15.842423 22657 heartbeater.cc:503] Master 127.11.131.252:39635 was elected leader, sending a full tablet report...
I20260808 14:34:15.843425 23193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:15.843147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:38851 (local address 127.11.131.195:58197)
0808 14:34:15.843282 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:15.843341 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:38851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260808 14:34:15.843910 22843 heartbeater.cc:503] Master 127.11.131.252:39635 was elected leader, sending a full tablet report...
I20260808 14:34:15.846278 23066 heartbeater.cc:503] Master 127.11.131.252:39635 was elected leader, sending a full tablet report...
I20260808 14:34:15.846802 23193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:15.846496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:38851 (local address 127.11.131.195:47777)
0808 14:34:15.846687 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:15.846732 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:38851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124}
I20260808 14:34:16.101068 23236 raft_consensus.cc:482] T 412efe8a3c40428e9aac5b90e00f0576 P 85aaf6b6511e44698d5245b172f71008 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:34:16.101269 23236 raft_consensus.cc:504] T 412efe8a3c40428e9aac5b90e00f0576 P 85aaf6b6511e44698d5245b172f71008 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85aaf6b6511e44698d5245b172f71008" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 42373 } } peers { permanent_uuid: "58a435968eb440fe9e5e17a994e9e721" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 42891 } } peers { permanent_uuid: "3e8ddfc3c5534dbd88bb4d10b61eef3c" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40983 } }
I20260808 14:34:16.101758 23236 leader_election.cc:288] T 412efe8a3c40428e9aac5b90e00f0576 P 85aaf6b6511e44698d5245b172f71008 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58a435968eb440fe9e5e17a994e9e721 (127.11.131.195:42891), 3e8ddfc3c5534dbd88bb4d10b61eef3c (127.11.131.194:40983)
I20260808 14:34:16.102391 22774 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "412efe8a3c40428e9aac5b90e00f0576" candidate_uuid: "85aaf6b6511e44698d5245b172f71008" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8ddfc3c5534dbd88bb4d10b61eef3c" is_pre_election: true
I20260808 14:34:16.102391 23000 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "412efe8a3c40428e9aac5b90e00f0576" candidate_uuid: "85aaf6b6511e44698d5245b172f71008" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58a435968eb440fe9e5e17a994e9e721" is_pre_election: true
I20260808 14:34:16.102566 22774 raft_consensus.cc:2454] T 412efe8a3c40428e9aac5b90e00f0576 P 3e8ddfc3c5534dbd88bb4d10b61eef3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85aaf6b6511e44698d5245b172f71008 in term 0.
I20260808 14:34:16.102566 23000 raft_consensus.cc:2454] T 412efe8a3c40428e9aac5b90e00f0576 P 58a435968eb440fe9e5e17a994e9e721 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85aaf6b6511e44698d5245b172f71008 in term 0.
I20260808 14:34:16.102982 22492 leader_election.cc:302] T 412efe8a3c40428e9aac5b90e00f0576 P 85aaf6b6511e44698d5245b172f71008 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 3e8ddfc3c5534dbd88bb4d10b61eef3c, 58a435968eb440fe9e5e17a994e9e721, 85aaf6b6511e44698d5245b172f71008; no voters:
I20260808 14:34:16.103214 23236 raft_consensus.cc:2781] T 412efe8a3c40428e9aac5b90e00f0576 P 85aaf6b6511e44698d5245b172f71008 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:34:16.103292 23236 raft_consensus.cc:482] T 412efe8a3c40428e9aac5b90e00f0576 P 85aaf6b6511e44698d5245b172f71008 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:34:16.103346 23236 raft_consensus.cc:3037] T 412efe8a3c40428e9aac5b90e00f0576 P 85aaf6b6511e44698d5245b172f71008 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:34:16.104425 23236 raft_consensus.cc:504] T 412efe8a3c40428e9aac5b90e00f0576 P 85aaf6b6511e44698d5245b172f71008 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85aaf6b6511e44698d5245b172f71008" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 42373 } } peers { permanent_uuid: "58a435968eb440fe9e5e17a994e9e721" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 42891 } } peers { permanent_uuid: "3e8ddfc3c5534dbd88bb4d10b61eef3c" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40983 } }
I20260808 14:34:16.104765 23236 leader_election.cc:288] T 412efe8a3c40428e9aac5b90e00f0576 P 85aaf6b6511e44698d5245b172f71008 [CANDIDATE]: Term 1 election: Requested vote from peers 58a435968eb440fe9e5e17a994e9e721 (127.11.131.195:42891), 3e8ddfc3c5534dbd88bb4d10b61eef3c (127.11.131.194:40983)
I20260808 14:34:16.105175 23000 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "412efe8a3c40428e9aac5b90e00f0576" candidate_uuid: "85aaf6b6511e44698d5245b172f71008" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58a435968eb440fe9e5e17a994e9e721"
I20260808 14:34:16.105196 22774 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "412efe8a3c40428e9aac5b90e00f0576" candidate_uuid: "85aaf6b6511e44698d5245b172f71008" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8ddfc3c5534dbd88bb4d10b61eef3c"
I20260808 14:34:16.105280 23000 raft_consensus.cc:3037] T 412efe8a3c40428e9aac5b90e00f0576 P 58a435968eb440fe9e5e17a994e9e721 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:34:16.105363 22774 raft_consensus.cc:3037] T 412efe8a3c40428e9aac5b90e00f0576 P 3e8ddfc3c5534dbd88bb4d10b61eef3c [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:34:16.106244 23000 raft_consensus.cc:2454] T 412efe8a3c40428e9aac5b90e00f0576 P 58a435968eb440fe9e5e17a994e9e721 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85aaf6b6511e44698d5245b172f71008 in term 1.
I20260808 14:34:16.106323 22774 raft_consensus.cc:2454] T 412efe8a3c40428e9aac5b90e00f0576 P 3e8ddfc3c5534dbd88bb4d10b61eef3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85aaf6b6511e44698d5245b172f71008 in term 1.
I20260808 14:34:16.106537 22492 leader_election.cc:302] T 412efe8a3c40428e9aac5b90e00f0576 P 85aaf6b6511e44698d5245b172f71008 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58a435968eb440fe9e5e17a994e9e721, 85aaf6b6511e44698d5245b172f71008; no voters:
I20260808 14:34:16.106765 23236 raft_consensus.cc:2781] T 412efe8a3c40428e9aac5b90e00f0576 P 85aaf6b6511e44698d5245b172f71008 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:34:16.107036 23236 raft_consensus.cc:686] T 412efe8a3c40428e9aac5b90e00f0576 P 85aaf6b6511e44698d5245b172f71008 [term 1 LEADER]: Becoming Leader. State: Replica: 85aaf6b6511e44698d5245b172f71008, State: Running, Role: LEADER
I20260808 14:34:16.107451 23236 consensus_queue.cc:237] T 412efe8a3c40428e9aac5b90e00f0576 P 85aaf6b6511e44698d5245b172f71008 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85aaf6b6511e44698d5245b172f71008" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 42373 } } peers { permanent_uuid: "58a435968eb440fe9e5e17a994e9e721" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 42891 } } peers { permanent_uuid: "3e8ddfc3c5534dbd88bb4d10b61eef3c" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40983 } }
I20260808 14:34:16.107815 23192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:16.107513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:38851 (local address 127.11.131.193:44861)
0808 14:34:16.107653 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:16.107718 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:38851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260808 14:34:16.109680 22403 catalog_manager.cc:5495] T 412efe8a3c40428e9aac5b90e00f0576 P 85aaf6b6511e44698d5245b172f71008 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85aaf6b6511e44698d5245b172f71008 (127.11.131.193). New cstate: current_term: 1 leader_uuid: "85aaf6b6511e44698d5245b172f71008" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85aaf6b6511e44698d5245b172f71008" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 42373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58a435968eb440fe9e5e17a994e9e721" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 42891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e8ddfc3c5534dbd88bb4d10b61eef3c" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40983 } health_report { overall_health: UNKNOWN } } }
I20260808 14:34:16.133309 23221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:16.130180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57242 (local address 127.11.131.193:42373)
0808 14:34:16.130331 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:16.130337 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:16.130371 (+ 34us) server_negotiation.cc:407] Connection header received
0808 14:34:16.130425 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:16.130428 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:16.130483 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:16.130567 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:34:16.130836 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:16.131356 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:16.132213 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:16.132439 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:16.132549 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:16.132817 (+ 268us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:34:16.132891 (+ 74us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:34:16.132972 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:16.133100 (+ 128us) server_negotiation.cc:299] Negotiation successful
0808 14:34:16.133158 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 14:34:16.135671 23000 raft_consensus.cc:1261] T 412efe8a3c40428e9aac5b90e00f0576 P 58a435968eb440fe9e5e17a994e9e721 [term 1 FOLLOWER]: Refusing update from remote peer 85aaf6b6511e44698d5245b172f71008: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:34:16.135671 22774 raft_consensus.cc:1261] T 412efe8a3c40428e9aac5b90e00f0576 P 3e8ddfc3c5534dbd88bb4d10b61eef3c [term 1 FOLLOWER]: Refusing update from remote peer 85aaf6b6511e44698d5245b172f71008: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:34:16.136139 23236 consensus_queue.cc:1035] T 412efe8a3c40428e9aac5b90e00f0576 P 85aaf6b6511e44698d5245b172f71008 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e8ddfc3c5534dbd88bb4d10b61eef3c" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:34:16.136353 23240 consensus_queue.cc:1035] T 412efe8a3c40428e9aac5b90e00f0576 P 85aaf6b6511e44698d5245b172f71008 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58a435968eb440fe9e5e17a994e9e721" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 42891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:34:16.138139 23195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:16.137685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:38851 (local address 127.11.131.194:41037)
0808 14:34:16.137995 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:16.138055 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:38851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":239}
I20260808 14:34:16.138309 23193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:16.138017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:38851 (local address 127.11.131.195:55503)
0808 14:34:16.138178 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:16.138233 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:38851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260808 14:34:16.140564 23244 mvcc.cc:205] Tried to move back new op lower bound from 7316273791526961152 to 7316273791417643008. Current Snapshot: MvccSnapshot[applied={T|T < 7316273791526961152}]
I20260808 14:34:16.141790 23192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:16.141493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:38851 (local address 127.11.131.193:35805)
0808 14:34:16.141648 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:16.141716 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:38851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260808 14:34:16.141881 23195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:16.141269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:38851 (local address 127.11.131.194:49705)
0808 14:34:16.141736 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:16.141795 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:38851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":398}
I20260808 14:34:16.146409 23193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:16.146062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:38851 (local address 127.11.131.195:39127)
0808 14:34:16.146276 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:16.146334 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:38851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133}
I20260808 14:34:16.146409 22402 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44058:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:34:16.146554 22402 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44058:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:34:16.146687 23192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:16.146342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:38851 (local address 127.11.131.193:45459)
0808 14:34:16.146522 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:16.146577 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:38851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113}
I20260808 14:34:16.150823 22402 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b4a11c28fe8a4334a428d2a865e69e7b: Sending DeleteTablet for 3 replicas of tablet 412efe8a3c40428e9aac5b90e00f0576
I20260808 14:34:16.151434 22565 tablet_service.cc:1514] Processing DeleteTablet for tablet 412efe8a3c40428e9aac5b90e00f0576 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:34:16 UTC) from {username='oryx', principal='oryx/127.11.131.252@KRBTEST.COM'} at 127.0.0.1:57240
I20260808 14:34:16.151502 22728 tablet_service.cc:1514] Processing DeleteTablet for tablet 412efe8a3c40428e9aac5b90e00f0576 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:34:16 UTC) from {username='oryx', principal='oryx/127.11.131.252@KRBTEST.COM'} at 127.0.0.1:39364
I20260808 14:34:16.151774 23256 tablet_replica.cc:330] T 412efe8a3c40428e9aac5b90e00f0576 P 85aaf6b6511e44698d5245b172f71008: stopping tablet replica
I20260808 14:34:16.151925 23257 tablet_replica.cc:330] T 412efe8a3c40428e9aac5b90e00f0576 P 3e8ddfc3c5534dbd88bb4d10b61eef3c: stopping tablet replica
I20260808 14:34:16.151902 23256 raft_consensus.cc:2229] T 412efe8a3c40428e9aac5b90e00f0576 P 85aaf6b6511e44698d5245b172f71008 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:34:16.152067 23257 raft_consensus.cc:2229] T 412efe8a3c40428e9aac5b90e00f0576 P 3e8ddfc3c5534dbd88bb4d10b61eef3c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:34:16.152061 22964 tablet_service.cc:1514] Processing DeleteTablet for tablet 412efe8a3c40428e9aac5b90e00f0576 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:34:16 UTC) from {username='oryx', principal='oryx/127.11.131.252@KRBTEST.COM'} at 127.0.0.1:41730
I20260808 14:34:16.152120 23256 raft_consensus.cc:2258] T 412efe8a3c40428e9aac5b90e00f0576 P 85aaf6b6511e44698d5245b172f71008 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:34:16.152107 22970 tablet_service.cc:1514] Processing DeleteTablet for tablet 412efe8a3c40428e9aac5b90e00f0576 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:34:16 UTC) from {username='oryx', principal='oryx/127.11.131.252@KRBTEST.COM'} at 127.0.0.1:41730
I20260808 14:34:16.152197 23257 raft_consensus.cc:2258] T 412efe8a3c40428e9aac5b90e00f0576 P 3e8ddfc3c5534dbd88bb4d10b61eef3c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:34:16.152449 23258 tablet_replica.cc:330] T 412efe8a3c40428e9aac5b90e00f0576 P 58a435968eb440fe9e5e17a994e9e721: stopping tablet replica
I20260808 14:34:16.152634 23258 raft_consensus.cc:2229] T 412efe8a3c40428e9aac5b90e00f0576 P 58a435968eb440fe9e5e17a994e9e721 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:34:16.152674 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 22336
I20260808 14:34:16.153357 23258 raft_consensus.cc:2258] T 412efe8a3c40428e9aac5b90e00f0576 P 58a435968eb440fe9e5e17a994e9e721 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:34:16.155632 23258 ts_tablet_manager.cc:1905] T 412efe8a3c40428e9aac5b90e00f0576 P 58a435968eb440fe9e5e17a994e9e721: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:34:16.157745 23258 ts_tablet_manager.cc:1918] T 412efe8a3c40428e9aac5b90e00f0576 P 58a435968eb440fe9e5e17a994e9e721: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:34:16.157843 23258 log.cc:1196] T 412efe8a3c40428e9aac5b90e00f0576 P 58a435968eb440fe9e5e17a994e9e721: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-2/wal/wals/412efe8a3c40428e9aac5b90e00f0576
I20260808 14:34:16.158124 23258 ts_tablet_manager.cc:1939] T 412efe8a3c40428e9aac5b90e00f0576 P 58a435968eb440fe9e5e17a994e9e721: Deleting consensus metadata
I20260808 14:34:16.158231 23257 ts_tablet_manager.cc:1905] T 412efe8a3c40428e9aac5b90e00f0576 P 3e8ddfc3c5534dbd88bb4d10b61eef3c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:34:16.161716 23257 ts_tablet_manager.cc:1918] T 412efe8a3c40428e9aac5b90e00f0576 P 3e8ddfc3c5534dbd88bb4d10b61eef3c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:34:16.161837 23257 log.cc:1196] T 412efe8a3c40428e9aac5b90e00f0576 P 3e8ddfc3c5534dbd88bb4d10b61eef3c: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786199615258783-11791-0/minicluster-data/ts-1/wal/wals/412efe8a3c40428e9aac5b90e00f0576
I20260808 14:34:16.162225 23257 ts_tablet_manager.cc:1939] T 412efe8a3c40428e9aac5b90e00f0576 P 3e8ddfc3c5534dbd88bb4d10b61eef3c: Deleting consensus metadata
I20260808 14:34:16.163874 22388 catalog_manager.cc:4841] TS 3e8ddfc3c5534dbd88bb4d10b61eef3c (127.11.131.194:40983): tablet 412efe8a3c40428e9aac5b90e00f0576 (table test-table [id=654b1c923e0442e08045559670b3e515]) successfully deleted
I20260808 14:34:16.168288 22382 catalog_manager.cc:4841] TS 58a435968eb440fe9e5e17a994e9e721 (127.11.131.195:42891): tablet 412efe8a3c40428e9aac5b90e00f0576 (table test-table [id=654b1c923e0442e08045559670b3e515]) successfully deleted
W20260808 14:34:16.168676 22382 catalog_manager.cc:4808] TS 58a435968eb440fe9e5e17a994e9e721 (127.11.131.195:42891): delete failed for tablet 412efe8a3c40428e9aac5b90e00f0576 because the tablet was not found. No further retry: Not found: Tablet not found: 412efe8a3c40428e9aac5b90e00f0576
I20260808 14:34:16.177753 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 22667
I20260808 14:34:16.177876 23223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:16.177564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:42373 (local address 127.0.0.1:57252)
0808 14:34:16.177736 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:16.177788 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.193:42373: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
W20260808 14:34:16.183089 22388 catalog_manager.cc:4584] TS 85aaf6b6511e44698d5245b172f71008 (127.11.131.193:42373): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 412efe8a3c40428e9aac5b90e00f0576: Network error: Client connection negotiation failed: client connection to 127.11.131.193:42373: connect: Connection refused (error 111)
I20260808 14:34:16.199013 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 22857
I20260808 14:34:16.206658 23223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:16.203063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:38851 (local address 127.0.0.1:60016)
0808 14:34:16.206434 (+ 3371us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:16.206520 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:38851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3228}
I20260808 14:34:16.208675 23223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:16.208385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:38851 (local address 127.0.0.1:60026)
0808 14:34:16.208544 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:16.208595 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:38851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260808 14:34:16.219121 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 21935
I20260808 14:34:16.234505 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 22081
2026-08-08T14:34:16Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (8044 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:34:16 dist-test-slave-twwt krb5kdc[23262](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:34:16 dist-test-slave-twwt krb5kdc[23262](info): set up 2 sockets
Aug 08 14:34:16 dist-test-slave-twwt krb5kdc[23262](info): commencing operation
krb5kdc: starting...
W20260808 14:34:17.490445 11791 mini_kdc.cc:121] Time spent starting KDC: real 1.222s user 0.003s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Aug 08 14:34:17 dist-test-slave-twwt krb5kdc[23262](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199657, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:34:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:34:17Z Disabled control of system clock
WARNING: no policy specified for oryx/127.11.131.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.131.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.131.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.254.keytab.
Entry for principal oryx/127.11.131.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.254.keytab.
I20260808 14:34:17.626174 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:41101
--webserver_interface=127.11.131.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.254.keytab
--principal=oryx/127.11.131.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:36331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:41101
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:34:17.741641 23278 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:34:17.741964 23278 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:34:17.742053 23278 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:34:17.746079 23278 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:34:17.746169 23278 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 14:34:17.746204 23278 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:34:17.746248 23278 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:34:17.746282 23278 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:34:17.746315 23278 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:34:17.751518 23278 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:36331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:41101
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.254.keytab
--principal=oryx/127.11.131.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:41101
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.131.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23278
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:34:17.752609 23278 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:34:17.753664 23278 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:34:17.762698 23284 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:17.762765 23278 server_base.cc:1034] running on GCE node
W20260808 14:34:17.762778 23289 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:17.762709 23285 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:17.763656 23278 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:34:17.764815 23278 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:34:17.766021 23278 hybrid_clock.cc:648] HybridClock initialized: now 1786199657765991 us; error 42 us; skew 500 ppm
Aug 08 14:34:17 dist-test-slave-twwt krb5kdc[23262](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199657, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.131.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:34:17.773723 23278 init.cc:377] Logged in from keytab as oryx/127.11.131.254@KRBTEST.COM (short username oryx)
I20260808 14:34:17.774748 23278 webserver.cc:460] Webserver started at http://127.11.131.254:42571/ using document root <none> and password file <none>
I20260808 14:34:17.775324 23278 fs_manager.cc:359] Metadata directory not provided
I20260808 14:34:17.775389 23278 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:34:17.775563 23278 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:34:17.777661 23278 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/master-0/data/instance:
uuid: "549d638a80bc4b74b95025f8a750633b"
format_stamp: "Formatted at 2026-08-08 14:34:17 on dist-test-slave-twwt"
server_key: "c0c9a3d47f631663bdbe249524fdfe20"
server_key_iv: "f7c89d349efdf2e8a1d9661ec2004dc0"
server_key_version: "encryptionkey@0"
I20260808 14:34:17.778198 23278 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/master-0/wal/instance:
uuid: "549d638a80bc4b74b95025f8a750633b"
format_stamp: "Formatted at 2026-08-08 14:34:17 on dist-test-slave-twwt"
server_key: "c0c9a3d47f631663bdbe249524fdfe20"
server_key_iv: "f7c89d349efdf2e8a1d9661ec2004dc0"
server_key_version: "encryptionkey@0"
I20260808 14:34:17.782137 23278 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260808 14:34:17.784653 23304 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:17.785916 23278 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 14:34:17.786034 23278 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "549d638a80bc4b74b95025f8a750633b"
format_stamp: "Formatted at 2026-08-08 14:34:17 on dist-test-slave-twwt"
server_key: "c0c9a3d47f631663bdbe249524fdfe20"
server_key_iv: "f7c89d349efdf2e8a1d9661ec2004dc0"
server_key_version: "encryptionkey@0"
I20260808 14:34:17.786123 23278 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:34:17.803030 23278 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:34:17.806705 23278 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:34:17.806869 23278 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:34:17.814994 23278 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.254:41101
I20260808 14:34:17.815039 23389 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.254:41101 every 8 connection(s)
I20260808 14:34:17.815975 23278 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:34:17.818850 23391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:34:17.824230 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 23278
I20260808 14:34:17.824364 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/master-0/wal/instance
I20260808 14:34:17.824602 23391 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 549d638a80bc4b74b95025f8a750633b: Bootstrap starting.
I20260808 14:34:17.824666 11791 external_mini_cluster.cc:1428] Setting key eae389fe55493c4997940ebf0ed7d40a
I20260808 14:34:17.827284 23391 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 549d638a80bc4b74b95025f8a750633b: Neither blocks nor log segments found. Creating new log.
I20260808 14:34:17.828074 23391 log.cc:824] T 00000000000000000000000000000000 P 549d638a80bc4b74b95025f8a750633b: Log is configured to *not* fsync() on all Append() calls
I20260808 14:34:17.830155 23391 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 549d638a80bc4b74b95025f8a750633b: No bootstrap required, opened a new log
Aug 08 14:34:17 dist-test-slave-twwt krb5kdc[23262](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199657, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM
I20260808 14:34:17.834918 23391 raft_consensus.cc:348] T 00000000000000000000000000000000 P 549d638a80bc4b74b95025f8a750633b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "549d638a80bc4b74b95025f8a750633b" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 41101 } }
I20260808 14:34:17.835191 23391 raft_consensus.cc:374] T 00000000000000000000000000000000 P 549d638a80bc4b74b95025f8a750633b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:34:17.835271 23391 raft_consensus.cc:729] T 00000000000000000000000000000000 P 549d638a80bc4b74b95025f8a750633b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 549d638a80bc4b74b95025f8a750633b, State: Initialized, Role: FOLLOWER
I20260808 14:34:17.835875 23391 consensus_queue.cc:260] T 00000000000000000000000000000000 P 549d638a80bc4b74b95025f8a750633b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "549d638a80bc4b74b95025f8a750633b" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 41101 } }
I20260808 14:34:17.836102 23391 raft_consensus.cc:388] T 00000000000000000000000000000000 P 549d638a80bc4b74b95025f8a750633b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:34:17.836181 23391 raft_consensus.cc:482] T 00000000000000000000000000000000 P 549d638a80bc4b74b95025f8a750633b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:34:17.836292 23391 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 549d638a80bc4b74b95025f8a750633b [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:34:17.837492 23391 raft_consensus.cc:504] T 00000000000000000000000000000000 P 549d638a80bc4b74b95025f8a750633b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "549d638a80bc4b74b95025f8a750633b" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 41101 } }
I20260808 14:34:17.837877 23391 leader_election.cc:302] T 00000000000000000000000000000000 P 549d638a80bc4b74b95025f8a750633b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 549d638a80bc4b74b95025f8a750633b; no voters:
I20260808 14:34:17.838261 23391 leader_election.cc:288] T 00000000000000000000000000000000 P 549d638a80bc4b74b95025f8a750633b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:34:17.838385 23398 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 549d638a80bc4b74b95025f8a750633b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:34:17.838626 23398 raft_consensus.cc:686] T 00000000000000000000000000000000 P 549d638a80bc4b74b95025f8a750633b [term 1 LEADER]: Becoming Leader. State: Replica: 549d638a80bc4b74b95025f8a750633b, State: Running, Role: LEADER
I20260808 14:34:17.839012 23398 consensus_queue.cc:237] T 00000000000000000000000000000000 P 549d638a80bc4b74b95025f8a750633b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "549d638a80bc4b74b95025f8a750633b" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 41101 } }
I20260808 14:34:17.839620 23391 sys_catalog.cc:564] T 00000000000000000000000000000000 P 549d638a80bc4b74b95025f8a750633b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:34:17.840312 23398 sys_catalog.cc:455] T 00000000000000000000000000000000 P 549d638a80bc4b74b95025f8a750633b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 549d638a80bc4b74b95025f8a750633b. Latest consensus state: current_term: 1 leader_uuid: "549d638a80bc4b74b95025f8a750633b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "549d638a80bc4b74b95025f8a750633b" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 41101 } } }
I20260808 14:34:17.840461 23394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:17.826099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46896 (local address 127.11.131.254:41101)
0808 14:34:17.826721 (+ 622us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:17.826739 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:17.826777 (+ 38us) server_negotiation.cc:407] Connection header received
0808 14:34:17.827471 (+ 694us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:17.827495 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:17.827895 (+ 400us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:17.828179 (+ 284us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:17.829087 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:17.830115 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:17.831329 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:17.831804 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:17.831927 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:17.834842 (+ 2915us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:17.834848 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:17.834873 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:17.834902 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:17.836978 (+ 2076us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:17.837407 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:17.837415 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:17.837424 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:17.837575 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:17.837903 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:17.837914 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:17.837916 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:17.838478 (+ 562us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:17.838713 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:17.839056 (+ 343us) server_negotiation.cc:299] Negotiation successful
0808 14:34:17.839393 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":419,"thread_start_us":164,"threads_started":1}
I20260808 14:34:17.841121 23398 sys_catalog.cc:458] T 00000000000000000000000000000000 P 549d638a80bc4b74b95025f8a750633b [sys.catalog]: This master's current role is: LEADER
I20260808 14:34:17.840997 23399 sys_catalog.cc:455] T 00000000000000000000000000000000 P 549d638a80bc4b74b95025f8a750633b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "549d638a80bc4b74b95025f8a750633b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "549d638a80bc4b74b95025f8a750633b" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 41101 } } }
I20260808 14:34:17.841578 23399 sys_catalog.cc:458] T 00000000000000000000000000000000 P 549d638a80bc4b74b95025f8a750633b [sys.catalog]: This master's current role is: LEADER
W20260808 14:34:17.844823 23420 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 549d638a80bc4b74b95025f8a750633b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:34:17.844897 23420 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:34:17.844980 23412 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:34:17.845723 23412 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:34:17.851888 23412 catalog_manager.cc:1347] Generated new cluster ID: 793357e5c75141adb14607b2e0994db8
I20260808 14:34:17.851958 23412 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:34:17.861770 23412 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:34:17.862862 23412 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:34:17.871263 23412 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 549d638a80bc4b74b95025f8a750633b: Generated new TSK 0
I20260808 14:34:17.872067 23412 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.11.131.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.131.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.131.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.193.keytab.
Entry for principal oryx/127.11.131.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.193.keytab.
I20260808 14:34:17.911986 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.193:0
--local_ip_for_outbound_sockets=127.11.131.193
--webserver_interface=127.11.131.193
--webserver_port=0
--tserver_master_addrs=127.11.131.254:41101
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.193.keytab
--principal=oryx/127.11.131.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:36331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:34:18.037323 23431 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:34:18.037604 23431 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:34:18.037650 23431 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:34:18.041973 23431 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:34:18.042035 23431 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:34:18.042095 23431 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 14:34:18.042167 23431 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.193
I20260808 14:34:18.047541 23431 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:36331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.193.keytab
--principal=oryx/127.11.131.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.131.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.131.254:41101
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23431
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.193
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:34:18.048650 23431 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:34:18.049759 23431 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:34:18.060117 23436 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:18.060196 23439 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:18.060117 23437 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:18.060474 23431 server_base.cc:1034] running on GCE node
I20260808 14:34:18.060918 23431 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:34:18.061602 23431 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:34:18.062795 23431 hybrid_clock.cc:648] HybridClock initialized: now 1786199658062783 us; error 35 us; skew 500 ppm
Aug 08 14:34:18 dist-test-slave-twwt krb5kdc[23262](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199658, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.131.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:34:18.065740 23431 init.cc:377] Logged in from keytab as oryx/127.11.131.193@KRBTEST.COM (short username oryx)
I20260808 14:34:18.066732 23431 webserver.cc:460] Webserver started at http://127.11.131.193:43683/ using document root <none> and password file <none>
I20260808 14:34:18.067281 23431 fs_manager.cc:359] Metadata directory not provided
I20260808 14:34:18.067340 23431 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:34:18.067519 23431 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:34:18.069660 23431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-0/data/instance:
uuid: "fb232188802a4b5eb680bcde792b54ad"
format_stamp: "Formatted at 2026-08-08 14:34:18 on dist-test-slave-twwt"
server_key: "81c852b19d8bcc3763dc84c542a02bad"
server_key_iv: "06e9fb3cc0cb3be0779acd998d275601"
server_key_version: "encryptionkey@0"
I20260808 14:34:18.070195 23431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-0/wal/instance:
uuid: "fb232188802a4b5eb680bcde792b54ad"
format_stamp: "Formatted at 2026-08-08 14:34:18 on dist-test-slave-twwt"
server_key: "81c852b19d8bcc3763dc84c542a02bad"
server_key_iv: "06e9fb3cc0cb3be0779acd998d275601"
server_key_version: "encryptionkey@0"
I20260808 14:34:18.073961 23431 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 14:34:18.076412 23452 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:18.077665 23431 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 14:34:18.077776 23431 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-0/wal
uuid: "fb232188802a4b5eb680bcde792b54ad"
format_stamp: "Formatted at 2026-08-08 14:34:18 on dist-test-slave-twwt"
server_key: "81c852b19d8bcc3763dc84c542a02bad"
server_key_iv: "06e9fb3cc0cb3be0779acd998d275601"
server_key_version: "encryptionkey@0"
I20260808 14:34:18.077864 23431 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:34:18.088294 23431 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:34:18.091609 23431 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:34:18.091817 23431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:34:18.093281 23431 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:34:18.093357 23431 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:18.093442 23431 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:34:18.093494 23431 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 14:34:18 dist-test-slave-twwt krb5kdc[23262](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199658, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.131.193@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM
I20260808 14:34:18.105072 23431 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.193:46203
I20260808 14:34:18.105146 23635 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.193:46203 every 8 connection(s)
I20260808 14:34:18.105993 23431 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
I20260808 14:34:18.109103 23394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:18.094167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:56207 (local address 127.11.131.254:41101)
0808 14:34:18.094295 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:18.094298 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:18.095403 (+ 1105us) server_negotiation.cc:407] Connection header received
0808 14:34:18.096538 (+ 1135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:18.096543 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:18.096616 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:18.096720 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:18.098533 (+ 1813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:18.099302 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:18.101307 (+ 2005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:18.101712 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:18.101802 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:18.105191 (+ 3389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:18.105195 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:18.105198 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:18.105231 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:18.106975 (+ 1744us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:18.107512 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:18.107517 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:18.107519 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:18.107604 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:18.107945 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:18.107950 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:18.107952 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:18.108143 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:18.108251 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:18.108785 (+ 534us) server_negotiation.cc:299] Negotiation successful
0808 14:34:18.108924 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 14:34:18.109866 23463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:18.094763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:41101 (local address 127.11.131.193:56207)
0808 14:34:18.095255 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:18.095297 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:18.096262 (+ 965us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:18.097083 (+ 821us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:18.097096 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:18.097601 (+ 505us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:18.098347 (+ 746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:18.098374 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:18.099471 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:18.099479 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:18.101167 (+ 1688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:18.101181 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:18.101888 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:18.101896 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:18.102149 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:18.102935 (+ 786us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:18.102962 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:18.104906 (+ 1944us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:18.107100 (+ 2194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:18.107108 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:18.107126 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:18.107403 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:18.107697 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:18.107700 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:18.107702 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:18.107847 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:18.108297 (+ 450us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:18.108307 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:18.108545 (+ 238us) client_negotiation.cc:769] Sending connection context
0808 14:34:18.108732 (+ 187us) client_negotiation.cc:240] Negotiation successful
0808 14:34:18.109048 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":153,"threads_started":1}
I20260808 14:34:18.110050 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 23431
I20260808 14:34:18.110183 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-0/wal/instance
I20260808 14:34:18.110566 11791 external_mini_cluster.cc:1428] Setting key abe2789bb7a1e61d49f6aeef688a0187
I20260808 14:34:18.111327 23642 heartbeater.cc:347] Connected to a master server at 127.11.131.254:41101
I20260808 14:34:18.111478 23642 heartbeater.cc:464] Registering TS with master...
I20260808 14:34:18.112037 23642 heartbeater.cc:511] Master 127.11.131.254:41101 requested a full tablet report, sending...
I20260808 14:34:18.113803 23326 ts_manager.cc:194] Registered new tserver with Master: fb232188802a4b5eb680bcde792b54ad (127.11.131.193:46203)
I20260808 14:34:18.115388 23326 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.131.193@KRBTEST.COM'} at 127.11.131.193:56207
I20260808 14:34:18.121423 23394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:18.113684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:53081 (local address 127.11.131.254:41101)
0808 14:34:18.113803 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:18.113807 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:18.114056 (+ 249us) server_negotiation.cc:407] Connection header received
0808 14:34:18.114172 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:18.114177 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:18.114217 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:18.114311 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:18.114890 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:18.115613 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:18.116779 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:18.116991 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:18.117108 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:18.118204 (+ 1096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:18.118216 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:18.118219 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:18.118249 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:18.119759 (+ 1510us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:18.120221 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:18.120231 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:18.120233 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:18.120305 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:18.120589 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:18.120593 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:18.120595 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:18.120768 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:18.120877 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:18.121139 (+ 262us) server_negotiation.cc:299] Negotiation successful
0808 14:34:18.121259 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 14:34:18.121431 23648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:18.113641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:41101 (local address 127.11.131.193:53081)
0808 14:34:18.113981 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:18.113997 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:18.114096 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:18.114327 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:18.114330 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:18.114562 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:18.114752 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:18.114762 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:18.115750 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:18.115755 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:18.116648 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:18.116662 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:18.117115 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:18.117119 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:18.117220 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:18.117731 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:18.117743 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:18.118066 (+ 323us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:18.119888 (+ 1822us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:18.119892 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:18.119894 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:18.120108 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:18.120402 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:18.120406 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:18.120408 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:18.120495 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:18.120867 (+ 372us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:18.120871 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:18.120972 (+ 101us) client_negotiation.cc:769] Sending connection context
0808 14:34:18.121082 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 14:34:18.121233 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":101,"threads_started":1}
WARNING: no policy specified for oryx/127.11.131.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.131.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.131.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.194.keytab.
Entry for principal oryx/127.11.131.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.194.keytab.
I20260808 14:34:18.142655 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.194:0
--local_ip_for_outbound_sockets=127.11.131.194
--webserver_interface=127.11.131.194
--webserver_port=0
--tserver_master_addrs=127.11.131.254:41101
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.194.keytab
--principal=oryx/127.11.131.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:36331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:34:18.261664 23651 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:34:18.261927 23651 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:34:18.262015 23651 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:34:18.266031 23651 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:34:18.266096 23651 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:34:18.266168 23651 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 14:34:18.266240 23651 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.194
I20260808 14:34:18.271775 23651 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:36331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.194.keytab
--principal=oryx/127.11.131.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.131.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.131.254:41101
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23651
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.194
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:34:18.273015 23651 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:34:18.274143 23651 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:34:18.284298 23659 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:18.284300 23662 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:18.284300 23660 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:18.284483 23651 server_base.cc:1034] running on GCE node
I20260808 14:34:18.285032 23651 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:34:18.285672 23651 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:34:18.286859 23651 hybrid_clock.cc:648] HybridClock initialized: now 1786199658286847 us; error 24 us; skew 500 ppm
Aug 08 14:34:18 dist-test-slave-twwt krb5kdc[23262](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199658, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.131.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:34:18.289649 23651 init.cc:377] Logged in from keytab as oryx/127.11.131.194@KRBTEST.COM (short username oryx)
I20260808 14:34:18.290683 23651 webserver.cc:460] Webserver started at http://127.11.131.194:40843/ using document root <none> and password file <none>
I20260808 14:34:18.291272 23651 fs_manager.cc:359] Metadata directory not provided
I20260808 14:34:18.291368 23651 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:34:18.291617 23651 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:34:18.293771 23651 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-1/data/instance:
uuid: "03ef70a3a2d642fa9199381942e4b838"
format_stamp: "Formatted at 2026-08-08 14:34:18 on dist-test-slave-twwt"
server_key: "b989469a3be190cd7432625b732d0954"
server_key_iv: "4bb16a122c611db953f4ef154c3ba236"
server_key_version: "encryptionkey@0"
I20260808 14:34:18.294379 23651 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-1/wal/instance:
uuid: "03ef70a3a2d642fa9199381942e4b838"
format_stamp: "Formatted at 2026-08-08 14:34:18 on dist-test-slave-twwt"
server_key: "b989469a3be190cd7432625b732d0954"
server_key_iv: "4bb16a122c611db953f4ef154c3ba236"
server_key_version: "encryptionkey@0"
I20260808 14:34:18.298302 23651 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260808 14:34:18.300977 23669 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:18.302240 23651 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 14:34:18.302384 23651 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-1/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-1/wal
uuid: "03ef70a3a2d642fa9199381942e4b838"
format_stamp: "Formatted at 2026-08-08 14:34:18 on dist-test-slave-twwt"
server_key: "b989469a3be190cd7432625b732d0954"
server_key_iv: "4bb16a122c611db953f4ef154c3ba236"
server_key_version: "encryptionkey@0"
I20260808 14:34:18.302511 23651 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:34:18.320644 23651 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:34:18.324158 23651 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:34:18.324385 23651 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:34:18.325975 23651 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:34:18.326054 23651 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:18.326133 23651 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:34:18.326179 23651 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 14:34:18 dist-test-slave-twwt krb5kdc[23262](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199658, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.131.194@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM
I20260808 14:34:18.338227 23651 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.194:40913
I20260808 14:34:18.338349 23840 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.194:40913 every 8 connection(s)
I20260808 14:34:18.339258 23651 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
I20260808 14:34:18.339617 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 23651
I20260808 14:34:18.339756 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-1/wal/instance
I20260808 14:34:18.340152 11791 external_mini_cluster.cc:1428] Setting key 93a36cb011cbbae75e1848715907237e
I20260808 14:34:18.341632 23394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:18.326955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:37127 (local address 127.11.131.254:41101)
0808 14:34:18.327102 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:18.327106 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:18.328251 (+ 1145us) server_negotiation.cc:407] Connection header received
0808 14:34:18.329380 (+ 1129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:18.329385 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:18.329446 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:18.329504 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:18.331089 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:18.331711 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:18.333040 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:18.333457 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:18.333615 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:18.336950 (+ 3335us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:18.336954 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:18.336957 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:18.336987 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:18.338751 (+ 1764us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:18.339270 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:18.339274 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:18.339276 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:18.339405 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:18.339853 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:18.339857 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:18.339861 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:18.340138 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:18.340239 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:18.341301 (+ 1062us) server_negotiation.cc:299] Negotiation successful
0808 14:34:18.341449 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 14:34:18.342554 23682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:18.327555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:41101 (local address 127.11.131.194:37127)
0808 14:34:18.328097 (+ 542us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:18.328142 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:18.329080 (+ 938us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:18.329946 (+ 866us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:18.329952 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:18.330362 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:18.330927 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:18.330965 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:18.331851 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:18.331854 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:18.332896 (+ 1042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:18.332906 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:18.333728 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:18.333734 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:18.333969 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:18.334665 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:18.334692 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:18.336770 (+ 2078us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:18.338875 (+ 2105us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:18.338881 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:18.338896 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:18.339158 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:18.339529 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:18.339531 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:18.339534 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:18.339728 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:18.340673 (+ 945us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:18.340680 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:18.341022 (+ 342us) client_negotiation.cc:769] Sending connection context
0808 14:34:18.341253 (+ 231us) client_negotiation.cc:240] Negotiation successful
0808 14:34:18.341579 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":150,"threads_started":1}
I20260808 14:34:18.344007 23842 heartbeater.cc:347] Connected to a master server at 127.11.131.254:41101
I20260808 14:34:18.344172 23842 heartbeater.cc:464] Registering TS with master...
I20260808 14:34:18.344682 23842 heartbeater.cc:511] Master 127.11.131.254:41101 requested a full tablet report, sending...
I20260808 14:34:18.345860 23327 ts_manager.cc:194] Registered new tserver with Master: 03ef70a3a2d642fa9199381942e4b838 (127.11.131.194:40913)
I20260808 14:34:18.346707 23327 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.131.194@KRBTEST.COM'} at 127.11.131.194:37127
WARNING: no policy specified for oryx/127.11.131.195@KRBTEST.COM; defaulting to no policy
I20260808 14:34:18.354830 23852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:18.346363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:41101 (local address 127.11.131.194:36597)
0808 14:34:18.347139 (+ 776us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:18.347157 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:18.347263 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:18.347534 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:18.347539 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:18.347780 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:18.348008 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:18.348024 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:18.349020 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:18.349027 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:18.350110 (+ 1083us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:18.350124 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:18.350556 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:18.350562 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:18.350709 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:18.351195 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:18.351209 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:18.351658 (+ 449us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:18.353402 (+ 1744us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:18.353404 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:18.353406 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:18.353591 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:18.353914 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:18.353916 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:18.353917 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:18.353996 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:18.354374 (+ 378us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:18.354377 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:18.354451 (+ 74us) client_negotiation.cc:769] Sending connection context
0808 14:34:18.354531 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 14:34:18.354696 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":669,"mutex_wait_us":1,"thread_start_us":106,"threads_started":1}
I20260808 14:34:18.354967 23394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:18.346404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:36597 (local address 127.11.131.254:41101)
0808 14:34:18.346521 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:18.346525 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:18.347239 (+ 714us) server_negotiation.cc:407] Connection header received
0808 14:34:18.347349 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:18.347352 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:18.347400 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:18.347492 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:18.348160 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:18.348878 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:18.350234 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:18.350439 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:18.350513 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:18.351798 (+ 1285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:18.351801 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:18.351803 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:18.351825 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:18.353286 (+ 1461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:18.353688 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:18.353693 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:18.353699 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:18.353809 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:18.354079 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:18.354082 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:18.354083 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:18.354276 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:18.354354 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:18.354566 (+ 212us) server_negotiation.cc:299] Negotiation successful
0808 14:34:18.354749 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.131.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.131.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.195.keytab.
Entry for principal oryx/127.11.131.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.195.keytab.
I20260808 14:34:18.373623 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.195:0
--local_ip_for_outbound_sockets=127.11.131.195
--webserver_interface=127.11.131.195
--webserver_port=0
--tserver_master_addrs=127.11.131.254:41101
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.195.keytab
--principal=oryx/127.11.131.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:36331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:34:18.492381 23854 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:34:18.492628 23854 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:34:18.492671 23854 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:34:18.496634 23854 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:34:18.496687 23854 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:34:18.496724 23854 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 14:34:18.496757 23854 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.195
I20260808 14:34:18.502313 23854 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:36331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.195.keytab
--principal=oryx/127.11.131.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.131.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.131.254:41101
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23854
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.195
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:34:18.503440 23854 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:34:18.504436 23854 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:34:18.514684 23863 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:18.514698 23864 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:18.514848 23854 server_base.cc:1034] running on GCE node
W20260808 14:34:18.515004 23868 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:18.515455 23854 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:34:18.516124 23854 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:34:18.517319 23854 hybrid_clock.cc:648] HybridClock initialized: now 1786199658517301 us; error 28 us; skew 500 ppm
Aug 08 14:34:18 dist-test-slave-twwt krb5kdc[23262](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199658, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.131.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:34:18.520263 23854 init.cc:377] Logged in from keytab as oryx/127.11.131.195@KRBTEST.COM (short username oryx)
I20260808 14:34:18.521256 23854 webserver.cc:460] Webserver started at http://127.11.131.195:39097/ using document root <none> and password file <none>
I20260808 14:34:18.521867 23854 fs_manager.cc:359] Metadata directory not provided
I20260808 14:34:18.521965 23854 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:34:18.522212 23854 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:34:18.524437 23854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-2/data/instance:
uuid: "0cc430c282114763a287d3dfc4baa59e"
format_stamp: "Formatted at 2026-08-08 14:34:18 on dist-test-slave-twwt"
server_key: "8bdba4feb414b79710194a1930f3feca"
server_key_iv: "99ceb966d12b8e36035cb85c20316759"
server_key_version: "encryptionkey@0"
I20260808 14:34:18.525040 23854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-2/wal/instance:
uuid: "0cc430c282114763a287d3dfc4baa59e"
format_stamp: "Formatted at 2026-08-08 14:34:18 on dist-test-slave-twwt"
server_key: "8bdba4feb414b79710194a1930f3feca"
server_key_iv: "99ceb966d12b8e36035cb85c20316759"
server_key_version: "encryptionkey@0"
I20260808 14:34:18.528959 23854 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 14:34:18.531495 23877 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:18.532677 23854 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 14:34:18.532841 23854 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-2/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-2/wal
uuid: "0cc430c282114763a287d3dfc4baa59e"
format_stamp: "Formatted at 2026-08-08 14:34:18 on dist-test-slave-twwt"
server_key: "8bdba4feb414b79710194a1930f3feca"
server_key_iv: "99ceb966d12b8e36035cb85c20316759"
server_key_version: "encryptionkey@0"
I20260808 14:34:18.532958 23854 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:34:18.547915 23854 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:34:18.551011 23854 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:34:18.551216 23854 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:34:18.552794 23854 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:34:18.552868 23854 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:18.552929 23854 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:34:18.552968 23854 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 14:34:18 dist-test-slave-twwt krb5kdc[23262](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199658, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.131.195@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM
I20260808 14:34:18.564429 23854 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.195:34505
I20260808 14:34:18.564828 24061 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.195:34505 every 8 connection(s)
I20260808 14:34:18.565411 23854 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
I20260808 14:34:18.568084 23394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:18.553496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:56341 (local address 127.11.131.254:41101)
0808 14:34:18.553654 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:18.553659 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:18.554622 (+ 963us) server_negotiation.cc:407] Connection header received
0808 14:34:18.555686 (+ 1064us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:18.555691 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:18.555754 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:18.555818 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:18.557676 (+ 1858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:18.558525 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:18.560560 (+ 2035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:18.560963 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:18.561068 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:18.564180 (+ 3112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:18.564186 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:18.564188 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:18.564222 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:18.565994 (+ 1772us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:18.566658 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:18.566662 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:18.566664 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:18.566761 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:18.567083 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:18.567085 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:18.567086 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:18.567269 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:18.567348 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:18.567835 (+ 487us) server_negotiation.cc:299] Negotiation successful
0808 14:34:18.567957 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 14:34:18.568935 23892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:18.553939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:41101 (local address 127.11.131.195:56341)
0808 14:34:18.554421 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:18.554472 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:18.555390 (+ 918us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:18.556310 (+ 920us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:18.556317 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:18.556831 (+ 514us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:18.557501 (+ 670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:18.557544 (+ 43us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:18.558727 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:18.558735 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:18.560390 (+ 1655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:18.560408 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:18.561133 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:18.561139 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:18.561410 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:18.562098 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:18.562129 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:18.563995 (+ 1866us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:18.566134 (+ 2139us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:18.566140 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:18.566155 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:18.566516 (+ 361us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:18.566851 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:18.566854 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:18.566855 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:18.566995 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:18.567382 (+ 387us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:18.567388 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:18.567622 (+ 234us) client_negotiation.cc:769] Sending connection context
0808 14:34:18.567781 (+ 159us) client_negotiation.cc:240] Negotiation successful
0808 14:34:18.568042 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":142,"threads_started":1}
I20260808 14:34:18.570262 24062 heartbeater.cc:347] Connected to a master server at 127.11.131.254:41101
I20260808 14:34:18.570432 24062 heartbeater.cc:464] Registering TS with master...
I20260808 14:34:18.571063 24062 heartbeater.cc:511] Master 127.11.131.254:41101 requested a full tablet report, sending...
I20260808 14:34:18.571273 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 23854
I20260808 14:34:18.571424 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-2/wal/instance
I20260808 14:34:18.571794 11791 external_mini_cluster.cc:1428] Setting key a1f18ed49e3e9dbd3a3360331ad9d4e0
I20260808 14:34:18.572300 23327 ts_manager.cc:194] Registered new tserver with Master: 0cc430c282114763a287d3dfc4baa59e (127.11.131.195:34505)
I20260808 14:34:18.573119 23327 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.131.195@KRBTEST.COM'} at 127.11.131.195:56341
I20260808 14:34:18.574105 11791 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:34:18.580693 23394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:18.572650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:34839 (local address 127.11.131.254:41101)
0808 14:34:18.572918 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:18.572926 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:18.572961 (+ 35us) server_negotiation.cc:407] Connection header received
0808 14:34:18.573160 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:18.573164 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:18.573215 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:18.573302 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:18.573843 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:18.574567 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:18.575692 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:18.575975 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:18.576081 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:18.577315 (+ 1234us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:18.577321 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:18.577327 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:18.577359 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:18.578898 (+ 1539us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:18.579423 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:18.579426 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:18.579427 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:18.579501 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:18.579810 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:18.579812 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:18.579814 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:18.579984 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:18.580059 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:18.580433 (+ 374us) server_negotiation.cc:299] Negotiation successful
0808 14:34:18.580572 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179}
I20260808 14:34:18.580787 24071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:18.572595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:41101 (local address 127.11.131.195:34839)
0808 14:34:18.572888 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:18.572904 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:18.573007 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:18.573341 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:18.573344 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:18.573556 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:18.573689 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:18.573697 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:18.574750 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:18.574753 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:18.575555 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:18.575565 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:18.576111 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:18.576118 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:18.576259 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:18.576836 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:18.576848 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:18.577170 (+ 322us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:18.579013 (+ 1843us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:18.579019 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:18.579024 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:18.579300 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:18.579594 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:18.579600 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:18.579605 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:18.579719 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:18.580096 (+ 377us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:18.580102 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:18.580227 (+ 125us) client_negotiation.cc:769] Sending connection context
0808 14:34:18.580352 (+ 125us) client_negotiation.cc:240] Negotiation successful
0808 14:34:18.580536 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":119,"threads_started":1}
Aug 08 14:34:18 dist-test-slave-twwt krb5kdc[23262](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199658, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 14:34:18 dist-test-slave-twwt krb5kdc[23262](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:18 dist-test-slave-twwt krb5kdc[23262](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 14:34:18.601926 23394 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:18.595594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46900 (local address 127.11.131.254:41101)
0808 14:34:18.595737 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:18.595741 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:18.595753 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:34:18.595793 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:18.595796 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:18.595837 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:18.595937 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:18.596686 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:18.597217 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:18.598079 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:18.598300 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:18.598415 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:18.601753 (+ 3338us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46900: BlockingRecv error: recv got EOF from 127.0.0.1:46900 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 08 14:34:18 dist-test-slave-twwt krb5kdc[23262](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199658, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM
I20260808 14:34:18.612104 23394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:18.603400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46910 (local address 127.11.131.254:41101)
0808 14:34:18.603540 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:18.603545 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:18.603671 (+ 126us) server_negotiation.cc:407] Connection header received
0808 14:34:18.603825 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:18.603828 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:18.603874 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:18.603956 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:18.604549 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:18.605042 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:18.605881 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:18.606094 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:18.606179 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:18.608643 (+ 2464us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:18.608646 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:18.608649 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:18.608674 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:18.610152 (+ 1478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:18.610786 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:18.610793 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:18.610798 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:18.610888 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:18.611193 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:18.611196 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:18.611197 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:18.611369 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:18.611547 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:18.611800 (+ 253us) server_negotiation.cc:299] Negotiation successful
0808 14:34:18.611903 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 14:34:18.615303 23326 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46910:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:34:18.618391 23326 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:34:18.633901 24101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:18.627503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.194:40913 (local address 127.0.0.1:54170)
0808 14:34:18.628731 (+ 1228us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:18.628746 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:18.628847 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:18.629606 (+ 759us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:18.629609 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:18.629628 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:34:18.629766 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:18.629773 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:18.631214 (+ 1441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:18.631219 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:18.632285 (+ 1066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:18.632295 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:18.633284 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:18.633288 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:18.633406 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:18.633453 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 14:34:18.633585 (+ 132us) client_negotiation.cc:240] Negotiation successful
0808 14:34:18.633718 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1169,"mutex_wait_us":8,"thread_start_us":93,"threads_started":1}
I20260808 14:34:18.633955 24105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:18.628084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54170 (local address 127.11.131.194:40913)
0808 14:34:18.628487 (+ 403us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:18.628500 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:18.629023 (+ 523us) server_negotiation.cc:407] Connection header received
0808 14:34:18.629113 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:18.629118 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:18.629301 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:18.629442 (+ 141us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:34:18.629949 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:18.631078 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:18.632419 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:18.633150 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:18.633308 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:18.633453 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:18.633677 (+ 224us) server_negotiation.cc:299] Negotiation successful
0808 14:34:18.633800 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":281,"thread_start_us":143,"threads_started":1}
I20260808 14:34:18.634716 24102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:18.627438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48994 (local address 127.11.131.193:46203)
0808 14:34:18.627900 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:18.627909 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:18.628859 (+ 950us) server_negotiation.cc:407] Connection header received
0808 14:34:18.629109 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:18.629113 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:18.629327 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:18.629484 (+ 157us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:34:18.629908 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:18.630789 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:18.632965 (+ 2176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:18.633800 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:18.633927 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:18.634086 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:18.634459 (+ 373us) server_negotiation.cc:299] Negotiation successful
0808 14:34:18.634556 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":342,"thread_start_us":106,"threads_started":1}
I20260808 14:34:18.634737 24097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:18.627126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.195:34505 (local address 127.0.0.1:34652)
0808 14:34:18.628180 (+ 1054us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:18.628225 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:18.628394 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:18.629294 (+ 900us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:18.629302 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:18.629327 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:34:18.629495 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:18.629503 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:18.631016 (+ 1513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:18.631020 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:18.632678 (+ 1658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:18.632710 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:18.634260 (+ 1550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:18.634264 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:18.634374 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:18.634404 (+ 30us) client_negotiation.cc:769] Sending connection context
0808 14:34:18.634478 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 14:34:18.634551 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":870,"mutex_wait_us":130,"thread_start_us":105,"threads_started":1}
I20260808 14:34:18.634758 24103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:18.627233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:46203 (local address 127.0.0.1:48994)
0808 14:34:18.628750 (+ 1517us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:18.628768 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:18.628939 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:18.629653 (+ 714us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:18.629656 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:18.629672 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:34:18.629784 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:18.629788 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:18.631090 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:18.631094 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:18.632835 (+ 1741us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:18.632843 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:18.634166 (+ 1323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:18.634171 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:18.634286 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:18.634313 (+ 27us) client_negotiation.cc:769] Sending connection context
0808 14:34:18.634422 (+ 109us) client_negotiation.cc:240] Negotiation successful
0808 14:34:18.634507 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1381,"mutex_wait_us":306,"thread_start_us":115,"threads_started":1}
I20260808 14:34:18.635445 24106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:18.628104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34652 (local address 127.11.131.195:34505)
0808 14:34:18.628663 (+ 559us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:18.628676 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:18.628703 (+ 27us) server_negotiation.cc:407] Connection header received
0808 14:34:18.628792 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:18.628800 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:18.629113 (+ 313us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:18.629286 (+ 173us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:34:18.629627 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:18.630849 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:18.632852 (+ 2003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:18.633677 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:18.633839 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:18.633966 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:18.635233 (+ 1267us) server_negotiation.cc:299] Negotiation successful
0808 14:34:18.635336 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":443,"thread_start_us":133,"threads_started":1}
I20260808 14:34:18.637884 23746 tablet_service.cc:1467] Processing CreateTablet for tablet 7cf0183d9d8f4f0f9b684d49e9a332a4 (DEFAULT_TABLE table=test-table [id=0da962395bfe40649db7f7795b438a0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:34:18.637996 23533 tablet_service.cc:1467] Processing CreateTablet for tablet 7cf0183d9d8f4f0f9b684d49e9a332a4 (DEFAULT_TABLE table=test-table [id=0da962395bfe40649db7f7795b438a0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:34:18.638006 23952 tablet_service.cc:1467] Processing CreateTablet for tablet 7cf0183d9d8f4f0f9b684d49e9a332a4 (DEFAULT_TABLE table=test-table [id=0da962395bfe40649db7f7795b438a0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:34:18.638971 23746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7cf0183d9d8f4f0f9b684d49e9a332a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:34:18.639158 23533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7cf0183d9d8f4f0f9b684d49e9a332a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:34:18.639164 23952 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7cf0183d9d8f4f0f9b684d49e9a332a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:34:18.646709 24107 tablet_bootstrap.cc:492] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 03ef70a3a2d642fa9199381942e4b838: Bootstrap starting.
I20260808 14:34:18.648030 24108 tablet_bootstrap.cc:492] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P fb232188802a4b5eb680bcde792b54ad: Bootstrap starting.
I20260808 14:34:18.649284 24107 tablet_bootstrap.cc:654] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 03ef70a3a2d642fa9199381942e4b838: Neither blocks nor log segments found. Creating new log.
I20260808 14:34:18.649963 24108 tablet_bootstrap.cc:654] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P fb232188802a4b5eb680bcde792b54ad: Neither blocks nor log segments found. Creating new log.
I20260808 14:34:18.650050 24107 log.cc:824] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 03ef70a3a2d642fa9199381942e4b838: Log is configured to *not* fsync() on all Append() calls
I20260808 14:34:18.650960 24108 log.cc:824] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P fb232188802a4b5eb680bcde792b54ad: Log is configured to *not* fsync() on all Append() calls
I20260808 14:34:18.651000 24109 tablet_bootstrap.cc:492] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 0cc430c282114763a287d3dfc4baa59e: Bootstrap starting.
I20260808 14:34:18.652760 24109 tablet_bootstrap.cc:654] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 0cc430c282114763a287d3dfc4baa59e: Neither blocks nor log segments found. Creating new log.
I20260808 14:34:18.652999 24108 tablet_bootstrap.cc:492] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P fb232188802a4b5eb680bcde792b54ad: No bootstrap required, opened a new log
I20260808 14:34:18.653234 24108 ts_tablet_manager.cc:1397] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P fb232188802a4b5eb680bcde792b54ad: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 14:34:18.653523 24109 log.cc:824] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 0cc430c282114763a287d3dfc4baa59e: Log is configured to *not* fsync() on all Append() calls
I20260808 14:34:18.655171 24107 tablet_bootstrap.cc:492] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 03ef70a3a2d642fa9199381942e4b838: No bootstrap required, opened a new log
I20260808 14:34:18.655382 24107 ts_tablet_manager.cc:1397] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 03ef70a3a2d642fa9199381942e4b838: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.000s
I20260808 14:34:18.655630 24109 tablet_bootstrap.cc:492] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 0cc430c282114763a287d3dfc4baa59e: No bootstrap required, opened a new log
I20260808 14:34:18.655807 24109 ts_tablet_manager.cc:1397] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 0cc430c282114763a287d3dfc4baa59e: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260808 14:34:18.657846 24108 raft_consensus.cc:348] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P fb232188802a4b5eb680bcde792b54ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } } peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } }
I20260808 14:34:18.658282 24108 raft_consensus.cc:374] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P fb232188802a4b5eb680bcde792b54ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:34:18.658516 24108 raft_consensus.cc:729] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P fb232188802a4b5eb680bcde792b54ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb232188802a4b5eb680bcde792b54ad, State: Initialized, Role: FOLLOWER
I20260808 14:34:18.659091 24108 consensus_queue.cc:260] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P fb232188802a4b5eb680bcde792b54ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } } peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } }
I20260808 14:34:18.659827 23642 heartbeater.cc:503] Master 127.11.131.254:41101 was elected leader, sending a full tablet report...
I20260808 14:34:18.659699 24109 raft_consensus.cc:348] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 0cc430c282114763a287d3dfc4baa59e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } } peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } }
I20260808 14:34:18.659934 24109 raft_consensus.cc:374] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 0cc430c282114763a287d3dfc4baa59e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:34:18.660001 24109 raft_consensus.cc:729] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 0cc430c282114763a287d3dfc4baa59e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cc430c282114763a287d3dfc4baa59e, State: Initialized, Role: FOLLOWER
I20260808 14:34:18.660254 24108 ts_tablet_manager.cc:1428] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P fb232188802a4b5eb680bcde792b54ad: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260808 14:34:18.660429 24109 consensus_queue.cc:260] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 0cc430c282114763a287d3dfc4baa59e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } } peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } }
I20260808 14:34:18.659495 24107 raft_consensus.cc:348] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 03ef70a3a2d642fa9199381942e4b838 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } } peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } }
I20260808 14:34:18.661053 24107 raft_consensus.cc:374] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 03ef70a3a2d642fa9199381942e4b838 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:34:18.661108 24062 heartbeater.cc:503] Master 127.11.131.254:41101 was elected leader, sending a full tablet report...
I20260808 14:34:18.661149 24107 raft_consensus.cc:729] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 03ef70a3a2d642fa9199381942e4b838 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03ef70a3a2d642fa9199381942e4b838, State: Initialized, Role: FOLLOWER
I20260808 14:34:18.661453 24109 ts_tablet_manager.cc:1428] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 0cc430c282114763a287d3dfc4baa59e: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 14:34:18.661742 24107 consensus_queue.cc:260] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 03ef70a3a2d642fa9199381942e4b838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } } peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } }
I20260808 14:34:18.662510 23842 heartbeater.cc:503] Master 127.11.131.254:41101 was elected leader, sending a full tablet report...
I20260808 14:34:18.663200 24107 ts_tablet_manager.cc:1428] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 03ef70a3a2d642fa9199381942e4b838: Time spent starting tablet: real 0.008s user 0.003s sys 0.004s
W20260808 14:34:18.816507 24063 tablet.cc:2369] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 0cc430c282114763a287d3dfc4baa59e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:34:18.826062 24116 raft_consensus.cc:482] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 0cc430c282114763a287d3dfc4baa59e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:34:18.826306 24116 raft_consensus.cc:504] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 0cc430c282114763a287d3dfc4baa59e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } } peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } }
I20260808 14:34:18.827594 24116 leader_election.cc:288] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 0cc430c282114763a287d3dfc4baa59e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb232188802a4b5eb680bcde792b54ad (127.11.131.193:46203), 03ef70a3a2d642fa9199381942e4b838 (127.11.131.194:40913)
I20260808 14:34:18.831789 23892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:18.827879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.194:40913 (local address 127.11.131.195:58341)
0808 14:34:18.827999 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:18.828015 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:18.828234 (+ 219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:18.828628 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:18.828633 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:18.828650 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:34:18.828793 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:18.828799 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:18.829626 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:18.829628 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:18.830737 (+ 1109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:18.830748 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:18.831458 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:18.831460 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:18.831542 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:18.831564 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 14:34:18.831625 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 14:34:18.831681 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260808 14:34:18.831871 24105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:18.828133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:58341 (local address 127.11.131.194:40913)
0808 14:34:18.828368 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:18.828373 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:18.828385 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:34:18.828435 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:18.828437 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:18.828477 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:18.828586 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:34:18.828932 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:18.829507 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:18.830862 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:18.831335 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:18.831462 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:18.831519 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:18.831667 (+ 148us) server_negotiation.cc:299] Negotiation successful
0808 14:34:18.831743 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 14:34:18.832517 24120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:18.827885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:46203 (local address 127.11.131.195:57935)
0808 14:34:18.828426 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:18.828438 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:18.828532 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:18.828800 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:18.828804 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:18.828819 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:34:18.829305 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:18.829312 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:18.830121 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:18.830125 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:18.831130 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:18.831138 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:18.832141 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:18.832145 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:18.832248 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:18.832273 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 14:34:18.832346 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 14:34:18.832396 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":480,"mutex_wait_us":74,"thread_start_us":159,"threads_started":1}
I20260808 14:34:18.832615 24102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:18.827984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:57935 (local address 127.11.131.193:46203)
0808 14:34:18.828119 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:18.828124 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:18.828540 (+ 416us) server_negotiation.cc:407] Connection header received
0808 14:34:18.828640 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:18.828643 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:18.828697 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:18.828769 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:34:18.829464 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:18.830006 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:18.831255 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:18.831871 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:18.831995 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:18.832055 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:18.832405 (+ 350us) server_negotiation.cc:299] Negotiation successful
0808 14:34:18.832496 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 14:34:18.832569 23773 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cf0183d9d8f4f0f9b684d49e9a332a4" candidate_uuid: "0cc430c282114763a287d3dfc4baa59e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03ef70a3a2d642fa9199381942e4b838" is_pre_election: true
I20260808 14:34:18.832959 23773 raft_consensus.cc:2454] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 03ef70a3a2d642fa9199381942e4b838 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cc430c282114763a287d3dfc4baa59e in term 0.
I20260808 14:34:18.833389 23566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cf0183d9d8f4f0f9b684d49e9a332a4" candidate_uuid: "0cc430c282114763a287d3dfc4baa59e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb232188802a4b5eb680bcde792b54ad" is_pre_election: true
I20260808 14:34:18.833535 23883 leader_election.cc:302] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 0cc430c282114763a287d3dfc4baa59e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03ef70a3a2d642fa9199381942e4b838, 0cc430c282114763a287d3dfc4baa59e; no voters:
I20260808 14:34:18.833690 23566 raft_consensus.cc:2454] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P fb232188802a4b5eb680bcde792b54ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cc430c282114763a287d3dfc4baa59e in term 0.
I20260808 14:34:18.833882 24116 raft_consensus.cc:2781] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 0cc430c282114763a287d3dfc4baa59e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:34:18.834003 24116 raft_consensus.cc:482] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 0cc430c282114763a287d3dfc4baa59e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:34:18.834074 24116 raft_consensus.cc:3037] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 0cc430c282114763a287d3dfc4baa59e [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:34:18.835187 24116 raft_consensus.cc:504] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 0cc430c282114763a287d3dfc4baa59e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } } peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } }
I20260808 14:34:18.835565 24116 leader_election.cc:288] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 0cc430c282114763a287d3dfc4baa59e [CANDIDATE]: Term 1 election: Requested vote from peers fb232188802a4b5eb680bcde792b54ad (127.11.131.193:46203), 03ef70a3a2d642fa9199381942e4b838 (127.11.131.194:40913)
I20260808 14:34:18.835961 23773 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cf0183d9d8f4f0f9b684d49e9a332a4" candidate_uuid: "0cc430c282114763a287d3dfc4baa59e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03ef70a3a2d642fa9199381942e4b838"
I20260808 14:34:18.835985 23566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7cf0183d9d8f4f0f9b684d49e9a332a4" candidate_uuid: "0cc430c282114763a287d3dfc4baa59e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb232188802a4b5eb680bcde792b54ad"
I20260808 14:34:18.836091 23773 raft_consensus.cc:3037] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 03ef70a3a2d642fa9199381942e4b838 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:34:18.836125 23566 raft_consensus.cc:3037] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P fb232188802a4b5eb680bcde792b54ad [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:34:18.837261 23566 raft_consensus.cc:2454] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P fb232188802a4b5eb680bcde792b54ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cc430c282114763a287d3dfc4baa59e in term 1.
I20260808 14:34:18.837299 23773 raft_consensus.cc:2454] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 03ef70a3a2d642fa9199381942e4b838 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cc430c282114763a287d3dfc4baa59e in term 1.
I20260808 14:34:18.837634 23879 leader_election.cc:302] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 0cc430c282114763a287d3dfc4baa59e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cc430c282114763a287d3dfc4baa59e, fb232188802a4b5eb680bcde792b54ad; no voters:
I20260808 14:34:18.837857 24116 raft_consensus.cc:2781] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 0cc430c282114763a287d3dfc4baa59e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:34:18.838115 24116 raft_consensus.cc:686] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 0cc430c282114763a287d3dfc4baa59e [term 1 LEADER]: Becoming Leader. State: Replica: 0cc430c282114763a287d3dfc4baa59e, State: Running, Role: LEADER
I20260808 14:34:18.838445 24116 consensus_queue.cc:237] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 0cc430c282114763a287d3dfc4baa59e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } } peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } }
W20260808 14:34:18.840734 23843 tablet.cc:2369] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 03ef70a3a2d642fa9199381942e4b838: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:34:18.841921 23326 catalog_manager.cc:5495] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 0cc430c282114763a287d3dfc4baa59e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0cc430c282114763a287d3dfc4baa59e (127.11.131.195). New cstate: current_term: 1 leader_uuid: "0cc430c282114763a287d3dfc4baa59e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } health_report { overall_health: UNKNOWN } } }
W20260808 14:34:18.857601 23643 tablet.cc:2369] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P fb232188802a4b5eb680bcde792b54ad: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:34:18.869896 24106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:18.866364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34668 (local address 127.11.131.195:34505)
0808 14:34:18.866495 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:18.866499 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:18.866512 (+ 13us) server_negotiation.cc:407] Connection header received
0808 14:34:18.866597 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:18.866599 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:18.866723 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:18.866814 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:34:18.867083 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:18.867602 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:18.868481 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:18.868700 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:18.868784 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:18.869063 (+ 279us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:34:18.869520 (+ 457us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:34:18.869666 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:18.869719 (+ 53us) server_negotiation.cc:299] Negotiation successful
0808 14:34:18.869779 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 14:34:18.876097 23566 raft_consensus.cc:1261] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P fb232188802a4b5eb680bcde792b54ad [term 1 FOLLOWER]: Refusing update from remote peer 0cc430c282114763a287d3dfc4baa59e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:34:18.876096 23773 raft_consensus.cc:1261] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 03ef70a3a2d642fa9199381942e4b838 [term 1 FOLLOWER]: Refusing update from remote peer 0cc430c282114763a287d3dfc4baa59e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:34:18.876868 24116 consensus_queue.cc:1035] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 0cc430c282114763a287d3dfc4baa59e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:34:18.877089 24121 consensus_queue.cc:1035] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 0cc430c282114763a287d3dfc4baa59e [LEADER]: Connected to new peer: Peer: permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:34:18.886698 24127 mvcc.cc:205] Tried to move back new op lower bound from 7316273802748698624 to 7316273802604961792. Current Snapshot: MvccSnapshot[applied={T|T < 7316273802748698624}]
I20260808 14:34:18.893779 23325 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46910:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:34:18.894043 23325 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46910:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:34:18.896862 23325 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 549d638a80bc4b74b95025f8a750633b: Sending DeleteTablet for 3 replicas of tablet 7cf0183d9d8f4f0f9b684d49e9a332a4
I20260808 14:34:18.897783 23952 tablet_service.cc:1514] Processing DeleteTablet for tablet 7cf0183d9d8f4f0f9b684d49e9a332a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:34:18 UTC) from {username='oryx', principal='oryx/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:34652
I20260808 14:34:18.898005 23533 tablet_service.cc:1514] Processing DeleteTablet for tablet 7cf0183d9d8f4f0f9b684d49e9a332a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:34:18 UTC) from {username='oryx', principal='oryx/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:48994
I20260808 14:34:18.898494 23746 tablet_service.cc:1514] Processing DeleteTablet for tablet 7cf0183d9d8f4f0f9b684d49e9a332a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:34:18 UTC) from {username='oryx', principal='oryx/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:54170
I20260808 14:34:18.898538 24147 tablet_replica.cc:330] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P fb232188802a4b5eb680bcde792b54ad: stopping tablet replica
I20260808 14:34:18.898972 24147 raft_consensus.cc:2229] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P fb232188802a4b5eb680bcde792b54ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:34:18.898990 24148 tablet_replica.cc:330] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 03ef70a3a2d642fa9199381942e4b838: stopping tablet replica
I20260808 14:34:18.899350 24148 raft_consensus.cc:2229] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 03ef70a3a2d642fa9199381942e4b838 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:34:18.899504 24146 tablet_replica.cc:330] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 0cc430c282114763a287d3dfc4baa59e: stopping tablet replica
I20260808 14:34:18.899756 24148 raft_consensus.cc:2258] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 03ef70a3a2d642fa9199381942e4b838 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:34:18.899868 24146 raft_consensus.cc:2229] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 0cc430c282114763a287d3dfc4baa59e [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:34:18.899808 23325 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46910:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:34:18.900302 23325 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:34:18.900410 24146 raft_consensus.cc:2258] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 0cc430c282114763a287d3dfc4baa59e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:34:18.901793 24147 raft_consensus.cc:2258] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P fb232188802a4b5eb680bcde792b54ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:34:18.902923 24148 ts_tablet_manager.cc:1905] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 03ef70a3a2d642fa9199381942e4b838: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:34:18.904611 24147 ts_tablet_manager.cc:1905] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P fb232188802a4b5eb680bcde792b54ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:34:18.906199 24148 ts_tablet_manager.cc:1918] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 03ef70a3a2d642fa9199381942e4b838: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:34:18.906407 24148 log.cc:1196] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 03ef70a3a2d642fa9199381942e4b838: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-1/wal/wals/7cf0183d9d8f4f0f9b684d49e9a332a4
I20260808 14:34:18.906800 23746 tablet_service.cc:1467] Processing CreateTablet for tablet 763f2a3f73d44cc79e1b164c57634adc (DEFAULT_TABLE table=test-table [id=fdeedbc375eb4167bfb32b999f587a4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:34:18.906889 24148 ts_tablet_manager.cc:1939] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 03ef70a3a2d642fa9199381942e4b838: Deleting consensus metadata
I20260808 14:34:18.907085 23746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 763f2a3f73d44cc79e1b164c57634adc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:34:18.908109 24147 ts_tablet_manager.cc:1918] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P fb232188802a4b5eb680bcde792b54ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:34:18.908196 24147 log.cc:1196] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P fb232188802a4b5eb680bcde792b54ad: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-0/wal/wals/7cf0183d9d8f4f0f9b684d49e9a332a4
I20260808 14:34:18.908495 24147 ts_tablet_manager.cc:1939] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P fb232188802a4b5eb680bcde792b54ad: Deleting consensus metadata
I20260808 14:34:18.909097 24107 tablet_bootstrap.cc:492] T 763f2a3f73d44cc79e1b164c57634adc P 03ef70a3a2d642fa9199381942e4b838: Bootstrap starting.
I20260808 14:34:18.909324 23533 tablet_service.cc:1467] Processing CreateTablet for tablet 763f2a3f73d44cc79e1b164c57634adc (DEFAULT_TABLE table=test-table [id=fdeedbc375eb4167bfb32b999f587a4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:34:18.909584 23533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 763f2a3f73d44cc79e1b164c57634adc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:34:18.910071 24107 tablet_bootstrap.cc:654] T 763f2a3f73d44cc79e1b164c57634adc P 03ef70a3a2d642fa9199381942e4b838: Neither blocks nor log segments found. Creating new log.
I20260808 14:34:18.911638 23952 tablet_service.cc:1467] Processing CreateTablet for tablet 763f2a3f73d44cc79e1b164c57634adc (DEFAULT_TABLE table=test-table [id=fdeedbc375eb4167bfb32b999f587a4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:34:18.911780 23310 catalog_manager.cc:4841] TS 03ef70a3a2d642fa9199381942e4b838 (127.11.131.194:40913): tablet 7cf0183d9d8f4f0f9b684d49e9a332a4 (table test-table [id=0da962395bfe40649db7f7795b438a0b]) successfully deleted
I20260808 14:34:18.911940 23952 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 763f2a3f73d44cc79e1b164c57634adc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:34:18.912144 24108 tablet_bootstrap.cc:492] T 763f2a3f73d44cc79e1b164c57634adc P fb232188802a4b5eb680bcde792b54ad: Bootstrap starting.
I20260808 14:34:18.912663 24107 tablet_bootstrap.cc:492] T 763f2a3f73d44cc79e1b164c57634adc P 03ef70a3a2d642fa9199381942e4b838: No bootstrap required, opened a new log
I20260808 14:34:18.912762 24107 ts_tablet_manager.cc:1397] T 763f2a3f73d44cc79e1b164c57634adc P 03ef70a3a2d642fa9199381942e4b838: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260808 14:34:18.913137 24108 tablet_bootstrap.cc:654] T 763f2a3f73d44cc79e1b164c57634adc P fb232188802a4b5eb680bcde792b54ad: Neither blocks nor log segments found. Creating new log.
I20260808 14:34:18.913247 24107 raft_consensus.cc:348] T 763f2a3f73d44cc79e1b164c57634adc P 03ef70a3a2d642fa9199381942e4b838 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } } peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } }
I20260808 14:34:18.913368 24107 raft_consensus.cc:374] T 763f2a3f73d44cc79e1b164c57634adc P 03ef70a3a2d642fa9199381942e4b838 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:34:18.913405 24107 raft_consensus.cc:729] T 763f2a3f73d44cc79e1b164c57634adc P 03ef70a3a2d642fa9199381942e4b838 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03ef70a3a2d642fa9199381942e4b838, State: Initialized, Role: FOLLOWER
I20260808 14:34:18.913534 24107 consensus_queue.cc:260] T 763f2a3f73d44cc79e1b164c57634adc P 03ef70a3a2d642fa9199381942e4b838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } } peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } }
I20260808 14:34:18.914495 23305 catalog_manager.cc:4841] TS fb232188802a4b5eb680bcde792b54ad (127.11.131.193:46203): tablet 7cf0183d9d8f4f0f9b684d49e9a332a4 (table test-table [id=0da962395bfe40649db7f7795b438a0b]) successfully deleted
I20260808 14:34:18.915120 24146 ts_tablet_manager.cc:1905] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 0cc430c282114763a287d3dfc4baa59e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:34:18.915423 24109 tablet_bootstrap.cc:492] T 763f2a3f73d44cc79e1b164c57634adc P 0cc430c282114763a287d3dfc4baa59e: Bootstrap starting.
I20260808 14:34:18.916585 24109 tablet_bootstrap.cc:654] T 763f2a3f73d44cc79e1b164c57634adc P 0cc430c282114763a287d3dfc4baa59e: Neither blocks nor log segments found. Creating new log.
I20260808 14:34:18.917845 24109 tablet_bootstrap.cc:492] T 763f2a3f73d44cc79e1b164c57634adc P 0cc430c282114763a287d3dfc4baa59e: No bootstrap required, opened a new log
I20260808 14:34:18.917912 24146 ts_tablet_manager.cc:1918] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 0cc430c282114763a287d3dfc4baa59e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:34:18.917935 24109 ts_tablet_manager.cc:1397] T 763f2a3f73d44cc79e1b164c57634adc P 0cc430c282114763a287d3dfc4baa59e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 14:34:18.918179 24107 ts_tablet_manager.cc:1428] T 763f2a3f73d44cc79e1b164c57634adc P 03ef70a3a2d642fa9199381942e4b838: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260808 14:34:18.918015 24146 log.cc:1196] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 0cc430c282114763a287d3dfc4baa59e: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-2/wal/wals/7cf0183d9d8f4f0f9b684d49e9a332a4
I20260808 14:34:18.918510 24109 raft_consensus.cc:348] T 763f2a3f73d44cc79e1b164c57634adc P 0cc430c282114763a287d3dfc4baa59e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } } peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } }
I20260808 14:34:18.918670 24109 raft_consensus.cc:374] T 763f2a3f73d44cc79e1b164c57634adc P 0cc430c282114763a287d3dfc4baa59e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:34:18.918717 24109 raft_consensus.cc:729] T 763f2a3f73d44cc79e1b164c57634adc P 0cc430c282114763a287d3dfc4baa59e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cc430c282114763a287d3dfc4baa59e, State: Initialized, Role: FOLLOWER
I20260808 14:34:18.918749 24146 ts_tablet_manager.cc:1939] T 7cf0183d9d8f4f0f9b684d49e9a332a4 P 0cc430c282114763a287d3dfc4baa59e: Deleting consensus metadata
I20260808 14:34:18.918988 24109 consensus_queue.cc:260] T 763f2a3f73d44cc79e1b164c57634adc P 0cc430c282114763a287d3dfc4baa59e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } } peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } }
I20260808 14:34:18.919406 24109 ts_tablet_manager.cc:1428] T 763f2a3f73d44cc79e1b164c57634adc P 0cc430c282114763a287d3dfc4baa59e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:34:18.919870 23307 catalog_manager.cc:4841] TS 0cc430c282114763a287d3dfc4baa59e (127.11.131.195:34505): tablet 7cf0183d9d8f4f0f9b684d49e9a332a4 (table test-table [id=0da962395bfe40649db7f7795b438a0b]) successfully deleted
I20260808 14:34:18.920508 24108 tablet_bootstrap.cc:492] T 763f2a3f73d44cc79e1b164c57634adc P fb232188802a4b5eb680bcde792b54ad: No bootstrap required, opened a new log
I20260808 14:34:18.920594 24108 ts_tablet_manager.cc:1397] T 763f2a3f73d44cc79e1b164c57634adc P fb232188802a4b5eb680bcde792b54ad: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260808 14:34:18.921056 24108 raft_consensus.cc:348] T 763f2a3f73d44cc79e1b164c57634adc P fb232188802a4b5eb680bcde792b54ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } } peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } }
I20260808 14:34:18.921160 24108 raft_consensus.cc:374] T 763f2a3f73d44cc79e1b164c57634adc P fb232188802a4b5eb680bcde792b54ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:34:18.921190 24108 raft_consensus.cc:729] T 763f2a3f73d44cc79e1b164c57634adc P fb232188802a4b5eb680bcde792b54ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb232188802a4b5eb680bcde792b54ad, State: Initialized, Role: FOLLOWER
I20260808 14:34:18.921310 24108 consensus_queue.cc:260] T 763f2a3f73d44cc79e1b164c57634adc P fb232188802a4b5eb680bcde792b54ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } } peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } }
I20260808 14:34:18.921548 24108 ts_tablet_manager.cc:1428] T 763f2a3f73d44cc79e1b164c57634adc P fb232188802a4b5eb680bcde792b54ad: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260808 14:34:19.004467 24138 raft_consensus.cc:482] T 763f2a3f73d44cc79e1b164c57634adc P 0cc430c282114763a287d3dfc4baa59e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:34:19.004647 24138 raft_consensus.cc:504] T 763f2a3f73d44cc79e1b164c57634adc P 0cc430c282114763a287d3dfc4baa59e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } } peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } }
I20260808 14:34:19.005023 24115 raft_consensus.cc:482] T 763f2a3f73d44cc79e1b164c57634adc P fb232188802a4b5eb680bcde792b54ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:34:19.005167 24115 raft_consensus.cc:504] T 763f2a3f73d44cc79e1b164c57634adc P fb232188802a4b5eb680bcde792b54ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } } peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } }
I20260808 14:34:19.005213 24138 leader_election.cc:288] T 763f2a3f73d44cc79e1b164c57634adc P 0cc430c282114763a287d3dfc4baa59e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb232188802a4b5eb680bcde792b54ad (127.11.131.193:46203), 03ef70a3a2d642fa9199381942e4b838 (127.11.131.194:40913)
I20260808 14:34:19.005656 23566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "763f2a3f73d44cc79e1b164c57634adc" candidate_uuid: "0cc430c282114763a287d3dfc4baa59e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb232188802a4b5eb680bcde792b54ad" is_pre_election: true
I20260808 14:34:19.005785 23566 raft_consensus.cc:2454] T 763f2a3f73d44cc79e1b164c57634adc P fb232188802a4b5eb680bcde792b54ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cc430c282114763a287d3dfc4baa59e in term 0.
I20260808 14:34:19.005980 23773 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "763f2a3f73d44cc79e1b164c57634adc" candidate_uuid: "0cc430c282114763a287d3dfc4baa59e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03ef70a3a2d642fa9199381942e4b838" is_pre_election: true
I20260808 14:34:19.006145 23773 raft_consensus.cc:2454] T 763f2a3f73d44cc79e1b164c57634adc P 03ef70a3a2d642fa9199381942e4b838 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cc430c282114763a287d3dfc4baa59e in term 0.
I20260808 14:34:19.006282 23879 leader_election.cc:302] T 763f2a3f73d44cc79e1b164c57634adc P 0cc430c282114763a287d3dfc4baa59e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cc430c282114763a287d3dfc4baa59e, fb232188802a4b5eb680bcde792b54ad; no voters:
I20260808 14:34:19.006446 24115 leader_election.cc:288] T 763f2a3f73d44cc79e1b164c57634adc P fb232188802a4b5eb680bcde792b54ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03ef70a3a2d642fa9199381942e4b838 (127.11.131.194:40913), 0cc430c282114763a287d3dfc4baa59e (127.11.131.195:34505)
I20260808 14:34:19.006589 24138 raft_consensus.cc:2781] T 763f2a3f73d44cc79e1b164c57634adc P 0cc430c282114763a287d3dfc4baa59e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:34:19.006677 24138 raft_consensus.cc:482] T 763f2a3f73d44cc79e1b164c57634adc P 0cc430c282114763a287d3dfc4baa59e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:34:19.006731 24138 raft_consensus.cc:3037] T 763f2a3f73d44cc79e1b164c57634adc P 0cc430c282114763a287d3dfc4baa59e [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:34:19.008213 24138 raft_consensus.cc:504] T 763f2a3f73d44cc79e1b164c57634adc P 0cc430c282114763a287d3dfc4baa59e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } } peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } }
I20260808 14:34:19.008991 23773 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "763f2a3f73d44cc79e1b164c57634adc" candidate_uuid: "0cc430c282114763a287d3dfc4baa59e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03ef70a3a2d642fa9199381942e4b838"
I20260808 14:34:19.009109 23773 raft_consensus.cc:3037] T 763f2a3f73d44cc79e1b164c57634adc P 03ef70a3a2d642fa9199381942e4b838 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:34:19.010320 23773 raft_consensus.cc:2454] T 763f2a3f73d44cc79e1b164c57634adc P 03ef70a3a2d642fa9199381942e4b838 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cc430c282114763a287d3dfc4baa59e in term 1.
I20260808 14:34:19.010663 23883 leader_election.cc:302] T 763f2a3f73d44cc79e1b164c57634adc P 0cc430c282114763a287d3dfc4baa59e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03ef70a3a2d642fa9199381942e4b838, 0cc430c282114763a287d3dfc4baa59e; no voters:
I20260808 14:34:19.010839 24116 raft_consensus.cc:2781] T 763f2a3f73d44cc79e1b164c57634adc P 0cc430c282114763a287d3dfc4baa59e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:34:19.010923 24116 raft_consensus.cc:686] T 763f2a3f73d44cc79e1b164c57634adc P 0cc430c282114763a287d3dfc4baa59e [term 1 LEADER]: Becoming Leader. State: Replica: 0cc430c282114763a287d3dfc4baa59e, State: Running, Role: LEADER
I20260808 14:34:19.011092 24116 consensus_queue.cc:237] T 763f2a3f73d44cc79e1b164c57634adc P 0cc430c282114763a287d3dfc4baa59e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } } peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } }
I20260808 14:34:19.011850 24105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:19.006944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:49593 (local address 127.11.131.194:40913)
0808 14:34:19.007182 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:19.007187 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:19.007249 (+ 62us) server_negotiation.cc:407] Connection header received
0808 14:34:19.007470 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:19.007474 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:19.007524 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:19.007573 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:34:19.008035 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:19.008804 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:19.010394 (+ 1590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:19.011039 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:19.011136 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:19.011216 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:19.011641 (+ 425us) server_negotiation.cc:299] Negotiation successful
0808 14:34:19.011724 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142}
I20260808 14:34:19.012384 23566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "763f2a3f73d44cc79e1b164c57634adc" candidate_uuid: "0cc430c282114763a287d3dfc4baa59e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb232188802a4b5eb680bcde792b54ad"
I20260808 14:34:19.012538 23566 raft_consensus.cc:3037] T 763f2a3f73d44cc79e1b164c57634adc P fb232188802a4b5eb680bcde792b54ad [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:34:19.012553 24138 leader_election.cc:288] T 763f2a3f73d44cc79e1b164c57634adc P 0cc430c282114763a287d3dfc4baa59e [CANDIDATE]: Term 1 election: Requested vote from peers fb232188802a4b5eb680bcde792b54ad (127.11.131.193:46203), 03ef70a3a2d642fa9199381942e4b838 (127.11.131.194:40913)
I20260808 14:34:19.012907 24106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:19.007741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:45695 (local address 127.11.131.195:34505)
0808 14:34:19.007852 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:19.007857 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:19.008164 (+ 307us) server_negotiation.cc:407] Connection header received
0808 14:34:19.008361 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:19.008364 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:19.008426 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:19.008477 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:34:19.008926 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:19.009608 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:19.011069 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:19.011601 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:19.011717 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:19.011786 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:19.012659 (+ 873us) server_negotiation.cc:299] Negotiation successful
0808 14:34:19.012789 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 14:34:19.012428 24153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:19.006833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.194:40913 (local address 127.11.131.193:49593)
0808 14:34:19.007158 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:19.007174 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:19.007332 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:19.007726 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:19.007729 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:19.007749 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:34:19.007883 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:19.007890 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:19.008977 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:19.008980 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:19.010238 (+ 1258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:19.010250 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:19.011366 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:19.011370 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:19.011477 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:19.011503 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 14:34:19.012126 (+ 623us) client_negotiation.cc:240] Negotiation successful
0808 14:34:19.012217 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":234,"mutex_wait_us":1,"thread_start_us":116,"threads_started":1}
I20260808 14:34:19.013801 23566 raft_consensus.cc:2454] T 763f2a3f73d44cc79e1b164c57634adc P fb232188802a4b5eb680bcde792b54ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cc430c282114763a287d3dfc4baa59e in term 1.
I20260808 14:34:19.014379 23773 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "763f2a3f73d44cc79e1b164c57634adc" candidate_uuid: "fb232188802a4b5eb680bcde792b54ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03ef70a3a2d642fa9199381942e4b838" is_pre_election: true
I20260808 14:34:19.014464 24154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:19.007385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.195:34505 (local address 127.11.131.193:45695)
0808 14:34:19.008055 (+ 670us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:19.008072 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:19.008241 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:19.008625 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:19.008628 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:19.008648 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:34:19.008788 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:19.008795 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:19.009756 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:19.009760 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:19.010922 (+ 1162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:19.010936 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:19.012351 (+ 1415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:19.012355 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:19.012474 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:19.012506 (+ 32us) client_negotiation.cc:769] Sending connection context
0808 14:34:19.013607 (+ 1101us) client_negotiation.cc:240] Negotiation successful
0808 14:34:19.014323 (+ 716us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":582,"thread_start_us":110,"threads_started":1}
I20260808 14:34:19.014286 23326 catalog_manager.cc:5495] T 763f2a3f73d44cc79e1b164c57634adc P 0cc430c282114763a287d3dfc4baa59e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0cc430c282114763a287d3dfc4baa59e (127.11.131.195). New cstate: current_term: 1 leader_uuid: "0cc430c282114763a287d3dfc4baa59e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } health_report { overall_health: HEALTHY } } }
I20260808 14:34:19.014540 23773 raft_consensus.cc:2379] T 763f2a3f73d44cc79e1b164c57634adc P 03ef70a3a2d642fa9199381942e4b838 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fb232188802a4b5eb680bcde792b54ad in current term 1: Already voted for candidate 0cc430c282114763a287d3dfc4baa59e in this term.
I20260808 14:34:19.015456 23980 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "763f2a3f73d44cc79e1b164c57634adc" candidate_uuid: "fb232188802a4b5eb680bcde792b54ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cc430c282114763a287d3dfc4baa59e" is_pre_election: true
I20260808 14:34:19.016140 23455 leader_election.cc:302] T 763f2a3f73d44cc79e1b164c57634adc P fb232188802a4b5eb680bcde792b54ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fb232188802a4b5eb680bcde792b54ad; no voters: 03ef70a3a2d642fa9199381942e4b838, 0cc430c282114763a287d3dfc4baa59e
I20260808 14:34:19.016424 24115 raft_consensus.cc:2726] T 763f2a3f73d44cc79e1b164c57634adc P fb232188802a4b5eb680bcde792b54ad [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
Aug 08 14:34:19 dist-test-slave-twwt krb5kdc[23262](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199657, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.131.254@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM
I20260808 14:34:19.085477 24162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:19.076579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:41101 (local address 127.0.0.1:46918)
0808 14:34:19.076899 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:19.076926 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:19.077053 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:19.077337 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:19.077339 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:19.077758 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:19.077860 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:19.077866 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:19.078764 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:19.078767 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:19.079351 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:19.079360 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:19.079821 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:19.079823 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:19.079896 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:19.080461 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:19.080474 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:19.082111 (+ 1637us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:19.083975 (+ 1864us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:19.083984 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:19.083990 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:19.084251 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:19.084522 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:19.084524 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:19.084525 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:19.084608 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:19.084977 (+ 369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:19.084983 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:19.085096 (+ 113us) client_negotiation.cc:769] Sending connection context
0808 14:34:19.085190 (+ 94us) client_negotiation.cc:240] Negotiation successful
0808 14:34:19.085327 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":128,"threads_started":1}
I20260808 14:34:19.085512 23394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:19.076656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46918 (local address 127.11.131.254:41101)
0808 14:34:19.076875 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:19.076879 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:19.077016 (+ 137us) server_negotiation.cc:407] Connection header received
0808 14:34:19.077147 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:19.077150 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:19.077194 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:19.077295 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:19.078014 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:19.078546 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:19.079472 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:19.079686 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:19.079772 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:19.082276 (+ 2504us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:19.082279 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:19.082281 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:19.082304 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:19.083861 (+ 1557us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:19.084346 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:19.084348 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:19.084349 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:19.084437 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:19.084690 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:19.084692 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:19.084693 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:19.084875 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:19.084952 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:19.085252 (+ 300us) server_negotiation.cc:299] Negotiation successful
0808 14:34:19.085399 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":24,"server-negotiator.queue_time_us":114}
I20260808 14:34:19.089759 23326 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:46918:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 14:34:19.090694 23326 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:34:19.095728 23533 tablet_service.cc:1467] Processing CreateTablet for tablet 3872cec59f824e58a795d7c10ccb6fc3 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b56a81e8d82b4186bea03f5b90ee3202]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 14:34:19.095767 23746 tablet_service.cc:1467] Processing CreateTablet for tablet 3872cec59f824e58a795d7c10ccb6fc3 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b56a81e8d82b4186bea03f5b90ee3202]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 14:34:19.095878 23952 tablet_service.cc:1467] Processing CreateTablet for tablet 3872cec59f824e58a795d7c10ccb6fc3 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b56a81e8d82b4186bea03f5b90ee3202]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 14:34:19.096150 23533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3872cec59f824e58a795d7c10ccb6fc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:34:19.096210 23746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3872cec59f824e58a795d7c10ccb6fc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:34:19.096210 23952 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3872cec59f824e58a795d7c10ccb6fc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:34:19.098701 24108 tablet_bootstrap.cc:492] T 3872cec59f824e58a795d7c10ccb6fc3 P fb232188802a4b5eb680bcde792b54ad: Bootstrap starting.
I20260808 14:34:19.099160 24107 tablet_bootstrap.cc:492] T 3872cec59f824e58a795d7c10ccb6fc3 P 03ef70a3a2d642fa9199381942e4b838: Bootstrap starting.
I20260808 14:34:19.099763 24108 tablet_bootstrap.cc:654] T 3872cec59f824e58a795d7c10ccb6fc3 P fb232188802a4b5eb680bcde792b54ad: Neither blocks nor log segments found. Creating new log.
I20260808 14:34:19.100104 24107 tablet_bootstrap.cc:654] T 3872cec59f824e58a795d7c10ccb6fc3 P 03ef70a3a2d642fa9199381942e4b838: Neither blocks nor log segments found. Creating new log.
I20260808 14:34:19.100530 24109 tablet_bootstrap.cc:492] T 3872cec59f824e58a795d7c10ccb6fc3 P 0cc430c282114763a287d3dfc4baa59e: Bootstrap starting.
I20260808 14:34:19.101162 24108 tablet_bootstrap.cc:492] T 3872cec59f824e58a795d7c10ccb6fc3 P fb232188802a4b5eb680bcde792b54ad: No bootstrap required, opened a new log
I20260808 14:34:19.101244 24108 ts_tablet_manager.cc:1397] T 3872cec59f824e58a795d7c10ccb6fc3 P fb232188802a4b5eb680bcde792b54ad: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 14:34:19.101351 24107 tablet_bootstrap.cc:492] T 3872cec59f824e58a795d7c10ccb6fc3 P 03ef70a3a2d642fa9199381942e4b838: No bootstrap required, opened a new log
I20260808 14:34:19.101436 24107 ts_tablet_manager.cc:1397] T 3872cec59f824e58a795d7c10ccb6fc3 P 03ef70a3a2d642fa9199381942e4b838: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:34:19.101513 24109 tablet_bootstrap.cc:654] T 3872cec59f824e58a795d7c10ccb6fc3 P 0cc430c282114763a287d3dfc4baa59e: Neither blocks nor log segments found. Creating new log.
I20260808 14:34:19.101756 24108 raft_consensus.cc:348] T 3872cec59f824e58a795d7c10ccb6fc3 P fb232188802a4b5eb680bcde792b54ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } } peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } }
I20260808 14:34:19.101867 24108 raft_consensus.cc:374] T 3872cec59f824e58a795d7c10ccb6fc3 P fb232188802a4b5eb680bcde792b54ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:34:19.101908 24108 raft_consensus.cc:729] T 3872cec59f824e58a795d7c10ccb6fc3 P fb232188802a4b5eb680bcde792b54ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb232188802a4b5eb680bcde792b54ad, State: Initialized, Role: FOLLOWER
I20260808 14:34:19.101918 24107 raft_consensus.cc:348] T 3872cec59f824e58a795d7c10ccb6fc3 P 03ef70a3a2d642fa9199381942e4b838 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } } peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } }
I20260808 14:34:19.102044 24107 raft_consensus.cc:374] T 3872cec59f824e58a795d7c10ccb6fc3 P 03ef70a3a2d642fa9199381942e4b838 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:34:19.102085 24107 raft_consensus.cc:729] T 3872cec59f824e58a795d7c10ccb6fc3 P 03ef70a3a2d642fa9199381942e4b838 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03ef70a3a2d642fa9199381942e4b838, State: Initialized, Role: FOLLOWER
I20260808 14:34:19.102034 24108 consensus_queue.cc:260] T 3872cec59f824e58a795d7c10ccb6fc3 P fb232188802a4b5eb680bcde792b54ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } } peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } }
I20260808 14:34:19.102223 24107 consensus_queue.cc:260] T 3872cec59f824e58a795d7c10ccb6fc3 P 03ef70a3a2d642fa9199381942e4b838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } } peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } }
I20260808 14:34:19.102283 24115 tablet_replica.cc:439] T 3872cec59f824e58a795d7c10ccb6fc3 P fb232188802a4b5eb680bcde792b54ad: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } } peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } } }
I20260808 14:34:19.102437 24115 tablet_replica.cc:442] T 3872cec59f824e58a795d7c10ccb6fc3 P fb232188802a4b5eb680bcde792b54ad: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:34:19.102485 24107 ts_tablet_manager.cc:1428] T 3872cec59f824e58a795d7c10ccb6fc3 P 03ef70a3a2d642fa9199381942e4b838: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:34:19.102708 24108 ts_tablet_manager.cc:1428] T 3872cec59f824e58a795d7c10ccb6fc3 P fb232188802a4b5eb680bcde792b54ad: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260808 14:34:19.102772 24109 tablet_bootstrap.cc:492] T 3872cec59f824e58a795d7c10ccb6fc3 P 0cc430c282114763a287d3dfc4baa59e: No bootstrap required, opened a new log
I20260808 14:34:19.102874 24109 ts_tablet_manager.cc:1397] T 3872cec59f824e58a795d7c10ccb6fc3 P 0cc430c282114763a287d3dfc4baa59e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:34:19.102819 24119 tablet_replica.cc:439] T 3872cec59f824e58a795d7c10ccb6fc3 P 03ef70a3a2d642fa9199381942e4b838: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } } peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } } }
I20260808 14:34:19.102979 24119 tablet_replica.cc:442] T 3872cec59f824e58a795d7c10ccb6fc3 P 03ef70a3a2d642fa9199381942e4b838: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:34:19.103340 24109 raft_consensus.cc:348] T 3872cec59f824e58a795d7c10ccb6fc3 P 0cc430c282114763a287d3dfc4baa59e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } } peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } }
I20260808 14:34:19.103448 24109 raft_consensus.cc:374] T 3872cec59f824e58a795d7c10ccb6fc3 P 0cc430c282114763a287d3dfc4baa59e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:34:19.103477 24109 raft_consensus.cc:729] T 3872cec59f824e58a795d7c10ccb6fc3 P 0cc430c282114763a287d3dfc4baa59e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cc430c282114763a287d3dfc4baa59e, State: Initialized, Role: FOLLOWER
I20260808 14:34:19.103578 24109 consensus_queue.cc:260] T 3872cec59f824e58a795d7c10ccb6fc3 P 0cc430c282114763a287d3dfc4baa59e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } } peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } }
I20260808 14:34:19.103814 24109 ts_tablet_manager.cc:1428] T 3872cec59f824e58a795d7c10ccb6fc3 P 0cc430c282114763a287d3dfc4baa59e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260808 14:34:19.103958 24138 tablet_replica.cc:439] T 3872cec59f824e58a795d7c10ccb6fc3 P 0cc430c282114763a287d3dfc4baa59e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } } peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } } }
I20260808 14:34:19.104079 24138 tablet_replica.cc:442] T 3872cec59f824e58a795d7c10ccb6fc3 P 0cc430c282114763a287d3dfc4baa59e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:34:19.139420 24115 raft_consensus.cc:482] T 3872cec59f824e58a795d7c10ccb6fc3 P fb232188802a4b5eb680bcde792b54ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:34:19.139560 24115 raft_consensus.cc:504] T 3872cec59f824e58a795d7c10ccb6fc3 P fb232188802a4b5eb680bcde792b54ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } } peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } }
I20260808 14:34:19.140136 24115 leader_election.cc:288] T 3872cec59f824e58a795d7c10ccb6fc3 P fb232188802a4b5eb680bcde792b54ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03ef70a3a2d642fa9199381942e4b838 (127.11.131.194:40913), 0cc430c282114763a287d3dfc4baa59e (127.11.131.195:34505)
I20260808 14:34:19.140611 23773 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3872cec59f824e58a795d7c10ccb6fc3" candidate_uuid: "fb232188802a4b5eb680bcde792b54ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03ef70a3a2d642fa9199381942e4b838" is_pre_election: true
I20260808 14:34:19.140630 23980 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3872cec59f824e58a795d7c10ccb6fc3" candidate_uuid: "fb232188802a4b5eb680bcde792b54ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cc430c282114763a287d3dfc4baa59e" is_pre_election: true
I20260808 14:34:19.140815 23773 raft_consensus.cc:2454] T 3872cec59f824e58a795d7c10ccb6fc3 P 03ef70a3a2d642fa9199381942e4b838 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb232188802a4b5eb680bcde792b54ad in term 0.
I20260808 14:34:19.140858 23980 raft_consensus.cc:2454] T 3872cec59f824e58a795d7c10ccb6fc3 P 0cc430c282114763a287d3dfc4baa59e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb232188802a4b5eb680bcde792b54ad in term 0.
I20260808 14:34:19.141158 23457 leader_election.cc:302] T 3872cec59f824e58a795d7c10ccb6fc3 P fb232188802a4b5eb680bcde792b54ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03ef70a3a2d642fa9199381942e4b838, fb232188802a4b5eb680bcde792b54ad; no voters:
I20260808 14:34:19.141410 24115 raft_consensus.cc:2781] T 3872cec59f824e58a795d7c10ccb6fc3 P fb232188802a4b5eb680bcde792b54ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:34:19.141460 24115 raft_consensus.cc:482] T 3872cec59f824e58a795d7c10ccb6fc3 P fb232188802a4b5eb680bcde792b54ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:34:19.141511 24115 raft_consensus.cc:3037] T 3872cec59f824e58a795d7c10ccb6fc3 P fb232188802a4b5eb680bcde792b54ad [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:34:19.142660 24115 raft_consensus.cc:504] T 3872cec59f824e58a795d7c10ccb6fc3 P fb232188802a4b5eb680bcde792b54ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } } peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } }
I20260808 14:34:19.143069 24115 leader_election.cc:288] T 3872cec59f824e58a795d7c10ccb6fc3 P fb232188802a4b5eb680bcde792b54ad [CANDIDATE]: Term 1 election: Requested vote from peers 03ef70a3a2d642fa9199381942e4b838 (127.11.131.194:40913), 0cc430c282114763a287d3dfc4baa59e (127.11.131.195:34505)
I20260808 14:34:19.143446 23980 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3872cec59f824e58a795d7c10ccb6fc3" candidate_uuid: "fb232188802a4b5eb680bcde792b54ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cc430c282114763a287d3dfc4baa59e"
I20260808 14:34:19.143492 23773 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3872cec59f824e58a795d7c10ccb6fc3" candidate_uuid: "fb232188802a4b5eb680bcde792b54ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03ef70a3a2d642fa9199381942e4b838"
I20260808 14:34:19.143620 23980 raft_consensus.cc:3037] T 3872cec59f824e58a795d7c10ccb6fc3 P 0cc430c282114763a287d3dfc4baa59e [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:34:19.143661 23773 raft_consensus.cc:3037] T 3872cec59f824e58a795d7c10ccb6fc3 P 03ef70a3a2d642fa9199381942e4b838 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:34:19.144613 23980 raft_consensus.cc:2454] T 3872cec59f824e58a795d7c10ccb6fc3 P 0cc430c282114763a287d3dfc4baa59e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb232188802a4b5eb680bcde792b54ad in term 1.
I20260808 14:34:19.144774 23773 raft_consensus.cc:2454] T 3872cec59f824e58a795d7c10ccb6fc3 P 03ef70a3a2d642fa9199381942e4b838 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb232188802a4b5eb680bcde792b54ad in term 1.
I20260808 14:34:19.144906 23455 leader_election.cc:302] T 3872cec59f824e58a795d7c10ccb6fc3 P fb232188802a4b5eb680bcde792b54ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cc430c282114763a287d3dfc4baa59e, fb232188802a4b5eb680bcde792b54ad; no voters:
I20260808 14:34:19.145098 24115 raft_consensus.cc:2781] T 3872cec59f824e58a795d7c10ccb6fc3 P fb232188802a4b5eb680bcde792b54ad [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:34:19.145337 24115 raft_consensus.cc:686] T 3872cec59f824e58a795d7c10ccb6fc3 P fb232188802a4b5eb680bcde792b54ad [term 1 LEADER]: Becoming Leader. State: Replica: fb232188802a4b5eb680bcde792b54ad, State: Running, Role: LEADER
I20260808 14:34:19.145635 24115 consensus_queue.cc:237] T 3872cec59f824e58a795d7c10ccb6fc3 P fb232188802a4b5eb680bcde792b54ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } } peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } }
I20260808 14:34:19.146988 24170 tablet_replica.cc:439] T 3872cec59f824e58a795d7c10ccb6fc3 P fb232188802a4b5eb680bcde792b54ad: TxnStatusTablet state changed. Reason: New leader fb232188802a4b5eb680bcde792b54ad. Latest consensus state: current_term: 1 leader_uuid: "fb232188802a4b5eb680bcde792b54ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } } peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } } }
I20260808 14:34:19.147125 24170 tablet_replica.cc:442] T 3872cec59f824e58a795d7c10ccb6fc3 P fb232188802a4b5eb680bcde792b54ad: This TxnStatusTablet replica's current role is: LEADER
I20260808 14:34:19.147434 24173 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 14:34:19.147604 24173 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 14:34:19.148360 23326 catalog_manager.cc:5495] T 3872cec59f824e58a795d7c10ccb6fc3 P fb232188802a4b5eb680bcde792b54ad reported cstate change: term changed from 0 to 1, leader changed from <none> to fb232188802a4b5eb680bcde792b54ad (127.11.131.193). New cstate: current_term: 1 leader_uuid: "fb232188802a4b5eb680bcde792b54ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } health_report { overall_health: UNKNOWN } } }
I20260808 14:34:19.170969 24162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:19.166986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:46203 (local address 127.0.0.1:49000)
0808 14:34:19.167156 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:19.167175 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:19.167297 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:19.167666 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:19.167669 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:19.167678 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:34:19.167794 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:19.167800 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:19.168540 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:19.168544 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:19.169177 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:19.169186 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:19.169669 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:19.169673 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:19.169769 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:19.169817 (+ 48us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:34:19.170641 (+ 824us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:34:19.170661 (+ 20us) client_negotiation.cc:769] Sending connection context
0808 14:34:19.170738 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 14:34:19.170838 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260808 14:34:19.170965 24102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:19.167151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49000 (local address 127.11.131.193:46203)
0808 14:34:19.167284 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:19.167289 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:19.167305 (+ 16us) server_negotiation.cc:407] Connection header received
0808 14:34:19.167484 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:19.167486 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:19.167546 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:19.167653 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:34:19.167909 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:19.168424 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:19.169305 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:19.169544 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:19.169654 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:19.169989 (+ 335us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:34:19.170515 (+ 526us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:34:19.170675 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:19.170751 (+ 76us) server_negotiation.cc:299] Negotiation successful
0808 14:34:19.170809 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 14:34:19.174233 23773 raft_consensus.cc:1261] T 3872cec59f824e58a795d7c10ccb6fc3 P 03ef70a3a2d642fa9199381942e4b838 [term 1 FOLLOWER]: Refusing update from remote peer fb232188802a4b5eb680bcde792b54ad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:34:19.174350 23980 raft_consensus.cc:1261] T 3872cec59f824e58a795d7c10ccb6fc3 P 0cc430c282114763a287d3dfc4baa59e [term 1 FOLLOWER]: Refusing update from remote peer fb232188802a4b5eb680bcde792b54ad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:34:19.174886 24115 consensus_queue.cc:1035] T 3872cec59f824e58a795d7c10ccb6fc3 P fb232188802a4b5eb680bcde792b54ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:34:19.175105 24170 consensus_queue.cc:1035] T 3872cec59f824e58a795d7c10ccb6fc3 P fb232188802a4b5eb680bcde792b54ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:34:19.176627 24119 tablet_replica.cc:439] T 3872cec59f824e58a795d7c10ccb6fc3 P 03ef70a3a2d642fa9199381942e4b838: TxnStatusTablet state changed. Reason: New leader fb232188802a4b5eb680bcde792b54ad. Latest consensus state: current_term: 1 leader_uuid: "fb232188802a4b5eb680bcde792b54ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } } peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } } }
I20260808 14:34:19.176750 24119 tablet_replica.cc:442] T 3872cec59f824e58a795d7c10ccb6fc3 P 03ef70a3a2d642fa9199381942e4b838: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:34:19.176872 24138 tablet_replica.cc:439] T 3872cec59f824e58a795d7c10ccb6fc3 P 0cc430c282114763a287d3dfc4baa59e: TxnStatusTablet state changed. Reason: New leader fb232188802a4b5eb680bcde792b54ad. Latest consensus state: current_term: 1 leader_uuid: "fb232188802a4b5eb680bcde792b54ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } } peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } } }
I20260808 14:34:19.176986 24138 tablet_replica.cc:442] T 3872cec59f824e58a795d7c10ccb6fc3 P 0cc430c282114763a287d3dfc4baa59e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:34:19.181504 24119 tablet_replica.cc:439] T 3872cec59f824e58a795d7c10ccb6fc3 P 03ef70a3a2d642fa9199381942e4b838: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fb232188802a4b5eb680bcde792b54ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } } peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } } }
I20260808 14:34:19.181650 24119 tablet_replica.cc:442] T 3872cec59f824e58a795d7c10ccb6fc3 P 03ef70a3a2d642fa9199381942e4b838: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:34:19.181684 24180 tablet_replica.cc:439] T 3872cec59f824e58a795d7c10ccb6fc3 P fb232188802a4b5eb680bcde792b54ad: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fb232188802a4b5eb680bcde792b54ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } } peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } } }
I20260808 14:34:19.181882 24180 tablet_replica.cc:442] T 3872cec59f824e58a795d7c10ccb6fc3 P fb232188802a4b5eb680bcde792b54ad: This TxnStatusTablet replica's current role is: LEADER
I20260808 14:34:19.182576 24128 mvcc.cc:205] Tried to move back new op lower bound from 7316273803971977216 to 7316273803863277568. Current Snapshot: MvccSnapshot[applied={T|T < 7316273803971977216 or (T in {7316273803971977216})}]
I20260808 14:34:19.182735 24170 tablet_replica.cc:439] T 3872cec59f824e58a795d7c10ccb6fc3 P fb232188802a4b5eb680bcde792b54ad: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fb232188802a4b5eb680bcde792b54ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } } peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } } }
I20260808 14:34:19.182861 24170 tablet_replica.cc:442] T 3872cec59f824e58a795d7c10ccb6fc3 P fb232188802a4b5eb680bcde792b54ad: This TxnStatusTablet replica's current role is: LEADER
I20260808 14:34:19.184640 24138 tablet_replica.cc:439] T 3872cec59f824e58a795d7c10ccb6fc3 P 0cc430c282114763a287d3dfc4baa59e: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fb232188802a4b5eb680bcde792b54ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } } peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } } }
I20260808 14:34:19.184790 24138 tablet_replica.cc:442] T 3872cec59f824e58a795d7c10ccb6fc3 P 0cc430c282114763a287d3dfc4baa59e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 14:34:19.184928 24126 mvcc.cc:205] Tried to move back new op lower bound from 7316273803971977216 to 7316273803863277568. Current Snapshot: MvccSnapshot[applied={T|T < 7316273803971977216 or (T in {7316273803971977216})}]
I20260808 14:34:19.198016 24102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:19.194369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:42177 (local address 127.11.131.193:46203)
0808 14:34:19.194505 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:19.194509 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:19.194650 (+ 141us) server_negotiation.cc:407] Connection header received
0808 14:34:19.194809 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:19.194811 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:19.194860 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:19.194929 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:34:19.195221 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:19.195727 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:19.196971 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:19.197182 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:19.197258 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:19.197604 (+ 346us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:34:19.197673 (+ 69us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:34:19.197726 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:19.197856 (+ 130us) server_negotiation.cc:299] Negotiation successful
0808 14:34:19.197904 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 14:34:19.198097 24187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:19.194175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:46203 (local address 127.11.131.195:42177)
0808 14:34:19.194544 (+ 369us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:19.194559 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:19.194692 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:19.194974 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:19.194977 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:19.194986 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:34:19.195111 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:19.195117 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:19.195838 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:19.195841 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:19.196842 (+ 1001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:19.196857 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:19.197301 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:19.197305 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:19.197403 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:19.197468 (+ 65us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:34:19.197763 (+ 295us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:34:19.197771 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 14:34:19.197838 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 14:34:19.197932 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":139,"threads_started":1}
I20260808 14:34:19.205103 23566 raft_consensus.cc:1261] T 763f2a3f73d44cc79e1b164c57634adc P fb232188802a4b5eb680bcde792b54ad [term 1 FOLLOWER]: Refusing update from remote peer 0cc430c282114763a287d3dfc4baa59e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:34:19.205106 23773 raft_consensus.cc:1261] T 763f2a3f73d44cc79e1b164c57634adc P 03ef70a3a2d642fa9199381942e4b838 [term 1 FOLLOWER]: Refusing update from remote peer 0cc430c282114763a287d3dfc4baa59e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:34:19.205533 24121 consensus_queue.cc:1035] T 763f2a3f73d44cc79e1b164c57634adc P 0cc430c282114763a287d3dfc4baa59e [LEADER]: Connected to new peer: Peer: permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:34:19.205693 24138 consensus_queue.cc:1035] T 763f2a3f73d44cc79e1b164c57634adc P 0cc430c282114763a287d3dfc4baa59e [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:34:19.232314 24106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:19.227559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:44967 (local address 127.11.131.195:34505)
0808 14:34:19.227686 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:19.227697 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:19.227968 (+ 271us) server_negotiation.cc:407] Connection header received
0808 14:34:19.228143 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:19.228146 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:19.228203 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:19.228250 (+ 47us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:34:19.228675 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:19.229450 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:19.230747 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:19.230960 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:19.231047 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:19.231804 (+ 757us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:34:19.231896 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:34:19.231942 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:19.232101 (+ 159us) server_negotiation.cc:299] Negotiation successful
0808 14:34:19.232162 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 14:34:19.232829 24194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:19.227474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.195:34505 (local address 127.11.131.193:44967)
0808 14:34:19.227883 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:19.227898 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:19.228009 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:19.228389 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:19.228392 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:19.228426 (+ 34us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:34:19.228553 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:19.228559 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:19.229570 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:19.229574 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:19.230572 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:19.230584 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:19.231471 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:19.231475 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:19.231577 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:19.231637 (+ 60us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:34:19.232004 (+ 367us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:34:19.232010 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 14:34:19.232540 (+ 530us) client_negotiation.cc:240] Negotiation successful
0808 14:34:19.232633 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":121,"threads_started":1}
I20260808 14:34:19.260226 23327 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46910:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:34:19.260435 23327 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46910:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:34:19.262787 23327 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 549d638a80bc4b74b95025f8a750633b: Sending DeleteTablet for 3 replicas of tablet 763f2a3f73d44cc79e1b164c57634adc
I20260808 14:34:19.263453 23533 tablet_service.cc:1514] Processing DeleteTablet for tablet 763f2a3f73d44cc79e1b164c57634adc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:34:19 UTC) from {username='oryx', principal='oryx/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:48994
I20260808 14:34:19.263520 23746 tablet_service.cc:1514] Processing DeleteTablet for tablet 763f2a3f73d44cc79e1b164c57634adc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:34:19 UTC) from {username='oryx', principal='oryx/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:54170
I20260808 14:34:19.263556 23952 tablet_service.cc:1514] Processing DeleteTablet for tablet 763f2a3f73d44cc79e1b164c57634adc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:34:19 UTC) from {username='oryx', principal='oryx/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:34652
I20260808 14:34:19.263726 24148 tablet_replica.cc:330] T 763f2a3f73d44cc79e1b164c57634adc P 03ef70a3a2d642fa9199381942e4b838: stopping tablet replica
I20260808 14:34:19.263748 24147 tablet_replica.cc:330] T 763f2a3f73d44cc79e1b164c57634adc P fb232188802a4b5eb680bcde792b54ad: stopping tablet replica
I20260808 14:34:19.263851 24148 raft_consensus.cc:2229] T 763f2a3f73d44cc79e1b164c57634adc P 03ef70a3a2d642fa9199381942e4b838 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:34:19.263871 24147 raft_consensus.cc:2229] T 763f2a3f73d44cc79e1b164c57634adc P fb232188802a4b5eb680bcde792b54ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:34:19.263984 24148 raft_consensus.cc:2258] T 763f2a3f73d44cc79e1b164c57634adc P 03ef70a3a2d642fa9199381942e4b838 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:34:19.264019 24147 raft_consensus.cc:2258] T 763f2a3f73d44cc79e1b164c57634adc P fb232188802a4b5eb680bcde792b54ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:34:19.264251 24146 tablet_replica.cc:330] T 763f2a3f73d44cc79e1b164c57634adc P 0cc430c282114763a287d3dfc4baa59e: stopping tablet replica
I20260808 14:34:19.264393 24146 raft_consensus.cc:2229] T 763f2a3f73d44cc79e1b164c57634adc P 0cc430c282114763a287d3dfc4baa59e [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:34:19.264627 24146 raft_consensus.cc:2258] T 763f2a3f73d44cc79e1b164c57634adc P 0cc430c282114763a287d3dfc4baa59e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:34:19.264802 24148 ts_tablet_manager.cc:1905] T 763f2a3f73d44cc79e1b164c57634adc P 03ef70a3a2d642fa9199381942e4b838: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:34:19.264969 24147 ts_tablet_manager.cc:1905] T 763f2a3f73d44cc79e1b164c57634adc P fb232188802a4b5eb680bcde792b54ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:34:19.265583 24146 ts_tablet_manager.cc:1905] T 763f2a3f73d44cc79e1b164c57634adc P 0cc430c282114763a287d3dfc4baa59e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:34:19.268092 24148 ts_tablet_manager.cc:1918] T 763f2a3f73d44cc79e1b164c57634adc P 03ef70a3a2d642fa9199381942e4b838: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:34:19.268124 24147 ts_tablet_manager.cc:1918] T 763f2a3f73d44cc79e1b164c57634adc P fb232188802a4b5eb680bcde792b54ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:34:19.268165 24148 log.cc:1196] T 763f2a3f73d44cc79e1b164c57634adc P 03ef70a3a2d642fa9199381942e4b838: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-1/wal/wals/763f2a3f73d44cc79e1b164c57634adc
I20260808 14:34:19.268198 24147 log.cc:1196] T 763f2a3f73d44cc79e1b164c57634adc P fb232188802a4b5eb680bcde792b54ad: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-0/wal/wals/763f2a3f73d44cc79e1b164c57634adc
I20260808 14:34:19.268455 24148 ts_tablet_manager.cc:1939] T 763f2a3f73d44cc79e1b164c57634adc P 03ef70a3a2d642fa9199381942e4b838: Deleting consensus metadata
I20260808 14:34:19.268488 24147 ts_tablet_manager.cc:1939] T 763f2a3f73d44cc79e1b164c57634adc P fb232188802a4b5eb680bcde792b54ad: Deleting consensus metadata
I20260808 14:34:19.268488 24146 ts_tablet_manager.cc:1918] T 763f2a3f73d44cc79e1b164c57634adc P 0cc430c282114763a287d3dfc4baa59e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:34:19.268561 24146 log.cc:1196] T 763f2a3f73d44cc79e1b164c57634adc P 0cc430c282114763a287d3dfc4baa59e: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-2/wal/wals/763f2a3f73d44cc79e1b164c57634adc
I20260808 14:34:19.268806 24146 ts_tablet_manager.cc:1939] T 763f2a3f73d44cc79e1b164c57634adc P 0cc430c282114763a287d3dfc4baa59e: Deleting consensus metadata
I20260808 14:34:19.269234 23310 catalog_manager.cc:4841] TS 03ef70a3a2d642fa9199381942e4b838 (127.11.131.194:40913): tablet 763f2a3f73d44cc79e1b164c57634adc (table test-table [id=fdeedbc375eb4167bfb32b999f587a4e]) successfully deleted
I20260808 14:34:19.269244 23305 catalog_manager.cc:4841] TS fb232188802a4b5eb680bcde792b54ad (127.11.131.193:46203): tablet 763f2a3f73d44cc79e1b164c57634adc (table test-table [id=fdeedbc375eb4167bfb32b999f587a4e]) successfully deleted
I20260808 14:34:19.270130 23307 catalog_manager.cc:4841] TS 0cc430c282114763a287d3dfc4baa59e (127.11.131.195:34505): tablet 763f2a3f73d44cc79e1b164c57634adc (table test-table [id=fdeedbc375eb4167bfb32b999f587a4e]) successfully deleted
Aug 08 14:34:19 dist-test-slave-twwt krb5kdc[23262](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199659, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 14:34:19 dist-test-slave-twwt krb5kdc[23262](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:19 dist-test-slave-twwt krb5kdc[23262](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 14:34:19.298960 23394 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:19.291696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46924 (local address 127.11.131.254:41101)
0808 14:34:19.291876 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:19.291881 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:19.292121 (+ 240us) server_negotiation.cc:407] Connection header received
0808 14:34:19.292274 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:19.292277 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:19.292324 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:19.292399 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:19.293347 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:19.293876 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:19.295100 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:19.295314 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:19.295398 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:19.298805 (+ 3407us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46924: BlockingRecv error: recv got EOF from 127.0.0.1:46924 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 08 14:34:19 dist-test-slave-twwt krb5kdc[23262](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199659, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM
I20260808 14:34:19.309502 23394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:19.300696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46930 (local address 127.11.131.254:41101)
0808 14:34:19.300813 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:19.300817 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:19.300856 (+ 39us) server_negotiation.cc:407] Connection header received
0808 14:34:19.300998 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:19.301001 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:19.301054 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:19.301150 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:19.301731 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:19.302506 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:19.303336 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:19.303680 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:19.303798 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:19.306207 (+ 2409us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:19.306210 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:19.306213 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:19.306241 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:19.307799 (+ 1558us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:19.308237 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:19.308241 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:19.308242 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:19.308331 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:19.308619 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:19.308623 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:19.308624 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:19.308813 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:19.308969 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:19.309205 (+ 236us) server_negotiation.cc:299] Negotiation successful
0808 14:34:19.309321 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 14:34:19.312367 23327 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46930:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:34:19.312867 23327 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:34:19.317799 23533 tablet_service.cc:1467] Processing CreateTablet for tablet dc942238e01e4ac9af822bae3822ec5e (DEFAULT_TABLE table=test-table [id=b1b5bd8b9c75482abf18ac082283167a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:34:19.317972 23952 tablet_service.cc:1467] Processing CreateTablet for tablet dc942238e01e4ac9af822bae3822ec5e (DEFAULT_TABLE table=test-table [id=b1b5bd8b9c75482abf18ac082283167a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:34:19.318147 23533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc942238e01e4ac9af822bae3822ec5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:34:19.318239 23952 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc942238e01e4ac9af822bae3822ec5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:34:19.320732 24108 tablet_bootstrap.cc:492] T dc942238e01e4ac9af822bae3822ec5e P fb232188802a4b5eb680bcde792b54ad: Bootstrap starting.
I20260808 14:34:19.320911 23746 tablet_service.cc:1467] Processing CreateTablet for tablet dc942238e01e4ac9af822bae3822ec5e (DEFAULT_TABLE table=test-table [id=b1b5bd8b9c75482abf18ac082283167a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:34:19.321298 23746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc942238e01e4ac9af822bae3822ec5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:34:19.321724 24108 tablet_bootstrap.cc:654] T dc942238e01e4ac9af822bae3822ec5e P fb232188802a4b5eb680bcde792b54ad: Neither blocks nor log segments found. Creating new log.
I20260808 14:34:19.323201 24108 tablet_bootstrap.cc:492] T dc942238e01e4ac9af822bae3822ec5e P fb232188802a4b5eb680bcde792b54ad: No bootstrap required, opened a new log
I20260808 14:34:19.323299 24108 ts_tablet_manager.cc:1397] T dc942238e01e4ac9af822bae3822ec5e P fb232188802a4b5eb680bcde792b54ad: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 14:34:19.323673 24107 tablet_bootstrap.cc:492] T dc942238e01e4ac9af822bae3822ec5e P 03ef70a3a2d642fa9199381942e4b838: Bootstrap starting.
I20260808 14:34:19.323680 24108 raft_consensus.cc:348] T dc942238e01e4ac9af822bae3822ec5e P fb232188802a4b5eb680bcde792b54ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } } peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } }
I20260808 14:34:19.323786 24108 raft_consensus.cc:374] T dc942238e01e4ac9af822bae3822ec5e P fb232188802a4b5eb680bcde792b54ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:34:19.323791 24109 tablet_bootstrap.cc:492] T dc942238e01e4ac9af822bae3822ec5e P 0cc430c282114763a287d3dfc4baa59e: Bootstrap starting.
I20260808 14:34:19.323813 24108 raft_consensus.cc:729] T dc942238e01e4ac9af822bae3822ec5e P fb232188802a4b5eb680bcde792b54ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb232188802a4b5eb680bcde792b54ad, State: Initialized, Role: FOLLOWER
I20260808 14:34:19.323926 24108 consensus_queue.cc:260] T dc942238e01e4ac9af822bae3822ec5e P fb232188802a4b5eb680bcde792b54ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } } peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } }
I20260808 14:34:19.324152 24108 ts_tablet_manager.cc:1428] T dc942238e01e4ac9af822bae3822ec5e P fb232188802a4b5eb680bcde792b54ad: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260808 14:34:19.324623 24107 tablet_bootstrap.cc:654] T dc942238e01e4ac9af822bae3822ec5e P 03ef70a3a2d642fa9199381942e4b838: Neither blocks nor log segments found. Creating new log.
I20260808 14:34:19.324625 24109 tablet_bootstrap.cc:654] T dc942238e01e4ac9af822bae3822ec5e P 0cc430c282114763a287d3dfc4baa59e: Neither blocks nor log segments found. Creating new log.
I20260808 14:34:19.326285 24109 tablet_bootstrap.cc:492] T dc942238e01e4ac9af822bae3822ec5e P 0cc430c282114763a287d3dfc4baa59e: No bootstrap required, opened a new log
I20260808 14:34:19.326401 24109 ts_tablet_manager.cc:1397] T dc942238e01e4ac9af822bae3822ec5e P 0cc430c282114763a287d3dfc4baa59e: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260808 14:34:19.326853 24109 raft_consensus.cc:348] T dc942238e01e4ac9af822bae3822ec5e P 0cc430c282114763a287d3dfc4baa59e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } } peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } }
I20260808 14:34:19.327003 24109 raft_consensus.cc:374] T dc942238e01e4ac9af822bae3822ec5e P 0cc430c282114763a287d3dfc4baa59e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:34:19.327036 24109 raft_consensus.cc:729] T dc942238e01e4ac9af822bae3822ec5e P 0cc430c282114763a287d3dfc4baa59e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cc430c282114763a287d3dfc4baa59e, State: Initialized, Role: FOLLOWER
I20260808 14:34:19.327217 24107 tablet_bootstrap.cc:492] T dc942238e01e4ac9af822bae3822ec5e P 03ef70a3a2d642fa9199381942e4b838: No bootstrap required, opened a new log
I20260808 14:34:19.327175 24109 consensus_queue.cc:260] T dc942238e01e4ac9af822bae3822ec5e P 0cc430c282114763a287d3dfc4baa59e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } } peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } }
I20260808 14:34:19.327289 24107 ts_tablet_manager.cc:1397] T dc942238e01e4ac9af822bae3822ec5e P 03ef70a3a2d642fa9199381942e4b838: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260808 14:34:19.327461 24109 ts_tablet_manager.cc:1428] T dc942238e01e4ac9af822bae3822ec5e P 0cc430c282114763a287d3dfc4baa59e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260808 14:34:19.327726 24107 raft_consensus.cc:348] T dc942238e01e4ac9af822bae3822ec5e P 03ef70a3a2d642fa9199381942e4b838 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } } peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } }
I20260808 14:34:19.327836 24107 raft_consensus.cc:374] T dc942238e01e4ac9af822bae3822ec5e P 03ef70a3a2d642fa9199381942e4b838 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:34:19.327864 24107 raft_consensus.cc:729] T dc942238e01e4ac9af822bae3822ec5e P 03ef70a3a2d642fa9199381942e4b838 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03ef70a3a2d642fa9199381942e4b838, State: Initialized, Role: FOLLOWER
I20260808 14:34:19.327972 24107 consensus_queue.cc:260] T dc942238e01e4ac9af822bae3822ec5e P 03ef70a3a2d642fa9199381942e4b838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } } peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } }
I20260808 14:34:19.328198 24107 ts_tablet_manager.cc:1428] T dc942238e01e4ac9af822bae3822ec5e P 03ef70a3a2d642fa9199381942e4b838: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:34:19.484534 24119 raft_consensus.cc:482] T dc942238e01e4ac9af822bae3822ec5e P 03ef70a3a2d642fa9199381942e4b838 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:34:19.484670 24119 raft_consensus.cc:504] T dc942238e01e4ac9af822bae3822ec5e P 03ef70a3a2d642fa9199381942e4b838 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } } peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } }
I20260808 14:34:19.485742 24119 leader_election.cc:288] T dc942238e01e4ac9af822bae3822ec5e P 03ef70a3a2d642fa9199381942e4b838 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb232188802a4b5eb680bcde792b54ad (127.11.131.193:46203), 0cc430c282114763a287d3dfc4baa59e (127.11.131.195:34505)
I20260808 14:34:19.489789 24106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:19.486142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:43299 (local address 127.11.131.195:34505)
0808 14:34:19.486291 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:19.486294 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:19.486443 (+ 149us) server_negotiation.cc:407] Connection header received
0808 14:34:19.486636 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:19.486643 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:19.486708 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:19.486794 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:34:19.487070 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:19.487576 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:19.488675 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:19.489208 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:19.489337 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:19.489394 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:19.489593 (+ 199us) server_negotiation.cc:299] Negotiation successful
0808 14:34:19.489668 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 14:34:19.489811 24219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:19.486009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.195:34505 (local address 127.11.131.194:43299)
0808 14:34:19.486335 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:19.486348 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:19.486464 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:19.486822 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:19.486825 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:19.486844 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:34:19.486954 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:19.486959 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:19.487691 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:19.487696 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:19.488543 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:19.488553 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:19.489348 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:19.489352 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:19.489455 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:19.489479 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 14:34:19.489563 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 14:34:19.489640 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"mutex_wait_us":22,"thread_start_us":82,"threads_started":1}
I20260808 14:34:19.489940 24102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:19.486110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:59133 (local address 127.11.131.193:46203)
0808 14:34:19.486264 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:19.486269 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:19.486744 (+ 475us) server_negotiation.cc:407] Connection header received
0808 14:34:19.486902 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:19.486907 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:19.486960 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:19.487045 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:34:19.487291 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:19.487779 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:19.488850 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:19.489334 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:19.489463 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:19.489520 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:19.489728 (+ 208us) server_negotiation.cc:299] Negotiation successful
0808 14:34:19.489798 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 14:34:19.489998 24220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:19.486009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:46203 (local address 127.11.131.194:59133)
0808 14:34:19.486597 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:19.486655 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:19.486787 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:19.487055 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:19.487058 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:19.487075 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:34:19.487172 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:19.487178 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:19.487907 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:19.487911 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:19.488724 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:19.488733 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:19.489463 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:19.489467 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:19.489587 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:19.489620 (+ 33us) client_negotiation.cc:769] Sending connection context
0808 14:34:19.489707 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 14:34:19.489777 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":516,"mutex_wait_us":297,"thread_start_us":118,"threads_started":1}
I20260808 14:34:19.490265 23980 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc942238e01e4ac9af822bae3822ec5e" candidate_uuid: "03ef70a3a2d642fa9199381942e4b838" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cc430c282114763a287d3dfc4baa59e" is_pre_election: true
I20260808 14:34:19.490414 23566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc942238e01e4ac9af822bae3822ec5e" candidate_uuid: "03ef70a3a2d642fa9199381942e4b838" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb232188802a4b5eb680bcde792b54ad" is_pre_election: true
I20260808 14:34:19.490465 23980 raft_consensus.cc:2454] T dc942238e01e4ac9af822bae3822ec5e P 0cc430c282114763a287d3dfc4baa59e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03ef70a3a2d642fa9199381942e4b838 in term 0.
I20260808 14:34:19.490561 23566 raft_consensus.cc:2454] T dc942238e01e4ac9af822bae3822ec5e P fb232188802a4b5eb680bcde792b54ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 03ef70a3a2d642fa9199381942e4b838 in term 0.
I20260808 14:34:19.490859 23674 leader_election.cc:302] T dc942238e01e4ac9af822bae3822ec5e P 03ef70a3a2d642fa9199381942e4b838 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03ef70a3a2d642fa9199381942e4b838, 0cc430c282114763a287d3dfc4baa59e; no voters:
I20260808 14:34:19.491161 24119 raft_consensus.cc:2781] T dc942238e01e4ac9af822bae3822ec5e P 03ef70a3a2d642fa9199381942e4b838 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:34:19.491279 24119 raft_consensus.cc:482] T dc942238e01e4ac9af822bae3822ec5e P 03ef70a3a2d642fa9199381942e4b838 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:34:19.491336 24119 raft_consensus.cc:3037] T dc942238e01e4ac9af822bae3822ec5e P 03ef70a3a2d642fa9199381942e4b838 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:34:19.492390 24119 raft_consensus.cc:504] T dc942238e01e4ac9af822bae3822ec5e P 03ef70a3a2d642fa9199381942e4b838 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } } peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } }
I20260808 14:34:19.492746 24119 leader_election.cc:288] T dc942238e01e4ac9af822bae3822ec5e P 03ef70a3a2d642fa9199381942e4b838 [CANDIDATE]: Term 1 election: Requested vote from peers fb232188802a4b5eb680bcde792b54ad (127.11.131.193:46203), 0cc430c282114763a287d3dfc4baa59e (127.11.131.195:34505)
I20260808 14:34:19.493137 23566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc942238e01e4ac9af822bae3822ec5e" candidate_uuid: "03ef70a3a2d642fa9199381942e4b838" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb232188802a4b5eb680bcde792b54ad"
I20260808 14:34:19.493137 23980 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc942238e01e4ac9af822bae3822ec5e" candidate_uuid: "03ef70a3a2d642fa9199381942e4b838" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cc430c282114763a287d3dfc4baa59e"
I20260808 14:34:19.493265 23566 raft_consensus.cc:3037] T dc942238e01e4ac9af822bae3822ec5e P fb232188802a4b5eb680bcde792b54ad [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:34:19.493265 23980 raft_consensus.cc:3037] T dc942238e01e4ac9af822bae3822ec5e P 0cc430c282114763a287d3dfc4baa59e [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:34:19.494398 23980 raft_consensus.cc:2454] T dc942238e01e4ac9af822bae3822ec5e P 0cc430c282114763a287d3dfc4baa59e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03ef70a3a2d642fa9199381942e4b838 in term 1.
I20260808 14:34:19.494390 23566 raft_consensus.cc:2454] T dc942238e01e4ac9af822bae3822ec5e P fb232188802a4b5eb680bcde792b54ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 03ef70a3a2d642fa9199381942e4b838 in term 1.
I20260808 14:34:19.494776 23670 leader_election.cc:302] T dc942238e01e4ac9af822bae3822ec5e P 03ef70a3a2d642fa9199381942e4b838 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 03ef70a3a2d642fa9199381942e4b838, 0cc430c282114763a287d3dfc4baa59e, fb232188802a4b5eb680bcde792b54ad; no voters:
I20260808 14:34:19.494989 24119 raft_consensus.cc:2781] T dc942238e01e4ac9af822bae3822ec5e P 03ef70a3a2d642fa9199381942e4b838 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:34:19.495164 24119 raft_consensus.cc:686] T dc942238e01e4ac9af822bae3822ec5e P 03ef70a3a2d642fa9199381942e4b838 [term 1 LEADER]: Becoming Leader. State: Replica: 03ef70a3a2d642fa9199381942e4b838, State: Running, Role: LEADER
I20260808 14:34:19.495417 24119 consensus_queue.cc:237] T dc942238e01e4ac9af822bae3822ec5e P 03ef70a3a2d642fa9199381942e4b838 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } } peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } }
I20260808 14:34:19.497892 23327 catalog_manager.cc:5495] T dc942238e01e4ac9af822bae3822ec5e P 03ef70a3a2d642fa9199381942e4b838 reported cstate change: term changed from 0 to 1, leader changed from <none> to 03ef70a3a2d642fa9199381942e4b838 (127.11.131.194). New cstate: current_term: 1 leader_uuid: "03ef70a3a2d642fa9199381942e4b838" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } health_report { overall_health: UNKNOWN } } }
I20260808 14:34:19.519537 24225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:19.515789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54186 (local address 127.11.131.194:40913)
0808 14:34:19.516028 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:19.516033 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:19.516048 (+ 15us) server_negotiation.cc:407] Connection header received
0808 14:34:19.516143 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:19.516145 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:19.516199 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:19.516326 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:34:19.516584 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:19.517096 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:19.517958 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:19.518187 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:19.518306 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:19.518666 (+ 360us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:34:19.519135 (+ 469us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:34:19.519277 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:19.519317 (+ 40us) server_negotiation.cc:299] Negotiation successful
0808 14:34:19.519382 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":74,"threads_started":1}
I20260808 14:34:19.522146 23566 raft_consensus.cc:1261] T dc942238e01e4ac9af822bae3822ec5e P fb232188802a4b5eb680bcde792b54ad [term 1 FOLLOWER]: Refusing update from remote peer 03ef70a3a2d642fa9199381942e4b838: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:34:19.522163 23980 raft_consensus.cc:1261] T dc942238e01e4ac9af822bae3822ec5e P 0cc430c282114763a287d3dfc4baa59e [term 1 FOLLOWER]: Refusing update from remote peer 03ef70a3a2d642fa9199381942e4b838: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:34:19.522737 24221 consensus_queue.cc:1035] T dc942238e01e4ac9af822bae3822ec5e P 03ef70a3a2d642fa9199381942e4b838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:34:19.522933 24119 consensus_queue.cc:1035] T dc942238e01e4ac9af822bae3822ec5e P 03ef70a3a2d642fa9199381942e4b838 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:34:19.534330 23327 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46930:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:34:19.534499 23327 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46930:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:34:19.536609 23327 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 549d638a80bc4b74b95025f8a750633b: Sending DeleteTablet for 3 replicas of tablet dc942238e01e4ac9af822bae3822ec5e
I20260808 14:34:19.537184 23533 tablet_service.cc:1514] Processing DeleteTablet for tablet dc942238e01e4ac9af822bae3822ec5e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:34:19 UTC) from {username='oryx', principal='oryx/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:48994
I20260808 14:34:19.537297 23952 tablet_service.cc:1514] Processing DeleteTablet for tablet dc942238e01e4ac9af822bae3822ec5e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:34:19 UTC) from {username='oryx', principal='oryx/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:34652
I20260808 14:34:19.537379 24147 tablet_replica.cc:330] T dc942238e01e4ac9af822bae3822ec5e P fb232188802a4b5eb680bcde792b54ad: stopping tablet replica
I20260808 14:34:19.537333 23746 tablet_service.cc:1514] Processing DeleteTablet for tablet dc942238e01e4ac9af822bae3822ec5e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:34:19 UTC) from {username='oryx', principal='oryx/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:54170
I20260808 14:34:19.537460 24146 tablet_replica.cc:330] T dc942238e01e4ac9af822bae3822ec5e P 0cc430c282114763a287d3dfc4baa59e: stopping tablet replica
I20260808 14:34:19.537518 24147 raft_consensus.cc:2229] T dc942238e01e4ac9af822bae3822ec5e P fb232188802a4b5eb680bcde792b54ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:34:19.537560 24146 raft_consensus.cc:2229] T dc942238e01e4ac9af822bae3822ec5e P 0cc430c282114763a287d3dfc4baa59e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:34:19.537653 24147 raft_consensus.cc:2258] T dc942238e01e4ac9af822bae3822ec5e P fb232188802a4b5eb680bcde792b54ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:34:19.537667 24146 raft_consensus.cc:2258] T dc942238e01e4ac9af822bae3822ec5e P 0cc430c282114763a287d3dfc4baa59e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:34:19.537834 24148 tablet_replica.cc:330] T dc942238e01e4ac9af822bae3822ec5e P 03ef70a3a2d642fa9199381942e4b838: stopping tablet replica
I20260808 14:34:19.537957 24148 raft_consensus.cc:2229] T dc942238e01e4ac9af822bae3822ec5e P 03ef70a3a2d642fa9199381942e4b838 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:34:19.538252 24148 raft_consensus.cc:2258] T dc942238e01e4ac9af822bae3822ec5e P 03ef70a3a2d642fa9199381942e4b838 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:34:19.538754 24146 ts_tablet_manager.cc:1905] T dc942238e01e4ac9af822bae3822ec5e P 0cc430c282114763a287d3dfc4baa59e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:34:19.539135 24147 ts_tablet_manager.cc:1905] T dc942238e01e4ac9af822bae3822ec5e P fb232188802a4b5eb680bcde792b54ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:34:19.541561 24146 ts_tablet_manager.cc:1918] T dc942238e01e4ac9af822bae3822ec5e P 0cc430c282114763a287d3dfc4baa59e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:34:19.541638 24146 log.cc:1196] T dc942238e01e4ac9af822bae3822ec5e P 0cc430c282114763a287d3dfc4baa59e: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-2/wal/wals/dc942238e01e4ac9af822bae3822ec5e
I20260808 14:34:19.541651 24147 ts_tablet_manager.cc:1918] T dc942238e01e4ac9af822bae3822ec5e P fb232188802a4b5eb680bcde792b54ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:34:19.541723 24147 log.cc:1196] T dc942238e01e4ac9af822bae3822ec5e P fb232188802a4b5eb680bcde792b54ad: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-0/wal/wals/dc942238e01e4ac9af822bae3822ec5e
I20260808 14:34:19.541952 24146 ts_tablet_manager.cc:1939] T dc942238e01e4ac9af822bae3822ec5e P 0cc430c282114763a287d3dfc4baa59e: Deleting consensus metadata
I20260808 14:34:19.541965 24147 ts_tablet_manager.cc:1939] T dc942238e01e4ac9af822bae3822ec5e P fb232188802a4b5eb680bcde792b54ad: Deleting consensus metadata
I20260808 14:34:19.542734 23305 catalog_manager.cc:4841] TS fb232188802a4b5eb680bcde792b54ad (127.11.131.193:46203): tablet dc942238e01e4ac9af822bae3822ec5e (table test-table [id=b1b5bd8b9c75482abf18ac082283167a]) successfully deleted
I20260808 14:34:19.542999 23307 catalog_manager.cc:4841] TS 0cc430c282114763a287d3dfc4baa59e (127.11.131.195:34505): tablet dc942238e01e4ac9af822bae3822ec5e (table test-table [id=b1b5bd8b9c75482abf18ac082283167a]) successfully deleted
I20260808 14:34:19.543059 24148 ts_tablet_manager.cc:1905] T dc942238e01e4ac9af822bae3822ec5e P 03ef70a3a2d642fa9199381942e4b838: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:34:19.543499 23327 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46930:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:34:19.544200 23327 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:34:19.545544 24148 ts_tablet_manager.cc:1918] T dc942238e01e4ac9af822bae3822ec5e P 03ef70a3a2d642fa9199381942e4b838: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:34:19.545636 24148 log.cc:1196] T dc942238e01e4ac9af822bae3822ec5e P 03ef70a3a2d642fa9199381942e4b838: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-1/wal/wals/dc942238e01e4ac9af822bae3822ec5e
I20260808 14:34:19.545995 24148 ts_tablet_manager.cc:1939] T dc942238e01e4ac9af822bae3822ec5e P 03ef70a3a2d642fa9199381942e4b838: Deleting consensus metadata
I20260808 14:34:19.546772 23310 catalog_manager.cc:4841] TS 03ef70a3a2d642fa9199381942e4b838 (127.11.131.194:40913): tablet dc942238e01e4ac9af822bae3822ec5e (table test-table [id=b1b5bd8b9c75482abf18ac082283167a]) successfully deleted
I20260808 14:34:19.549284 23746 tablet_service.cc:1467] Processing CreateTablet for tablet d59a5bff79474252954b811b4c6eee4a (DEFAULT_TABLE table=test-table [id=c64ab8bb67d6484586f77bb6a3454548]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:34:19.549340 23533 tablet_service.cc:1467] Processing CreateTablet for tablet d59a5bff79474252954b811b4c6eee4a (DEFAULT_TABLE table=test-table [id=c64ab8bb67d6484586f77bb6a3454548]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:34:19.549413 23952 tablet_service.cc:1467] Processing CreateTablet for tablet d59a5bff79474252954b811b4c6eee4a (DEFAULT_TABLE table=test-table [id=c64ab8bb67d6484586f77bb6a3454548]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:34:19.549536 23746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d59a5bff79474252954b811b4c6eee4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:34:19.549620 23533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d59a5bff79474252954b811b4c6eee4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:34:19.549635 23952 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d59a5bff79474252954b811b4c6eee4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:34:19.551927 24107 tablet_bootstrap.cc:492] T d59a5bff79474252954b811b4c6eee4a P 03ef70a3a2d642fa9199381942e4b838: Bootstrap starting.
I20260808 14:34:19.551935 24109 tablet_bootstrap.cc:492] T d59a5bff79474252954b811b4c6eee4a P 0cc430c282114763a287d3dfc4baa59e: Bootstrap starting.
I20260808 14:34:19.552821 24107 tablet_bootstrap.cc:654] T d59a5bff79474252954b811b4c6eee4a P 03ef70a3a2d642fa9199381942e4b838: Neither blocks nor log segments found. Creating new log.
I20260808 14:34:19.552821 24109 tablet_bootstrap.cc:654] T d59a5bff79474252954b811b4c6eee4a P 0cc430c282114763a287d3dfc4baa59e: Neither blocks nor log segments found. Creating new log.
I20260808 14:34:19.553440 24108 tablet_bootstrap.cc:492] T d59a5bff79474252954b811b4c6eee4a P fb232188802a4b5eb680bcde792b54ad: Bootstrap starting.
I20260808 14:34:19.554008 24109 tablet_bootstrap.cc:492] T d59a5bff79474252954b811b4c6eee4a P 0cc430c282114763a287d3dfc4baa59e: No bootstrap required, opened a new log
I20260808 14:34:19.554083 24109 ts_tablet_manager.cc:1397] T d59a5bff79474252954b811b4c6eee4a P 0cc430c282114763a287d3dfc4baa59e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:34:19.554279 24108 tablet_bootstrap.cc:654] T d59a5bff79474252954b811b4c6eee4a P fb232188802a4b5eb680bcde792b54ad: Neither blocks nor log segments found. Creating new log.
I20260808 14:34:19.554529 24109 raft_consensus.cc:348] T d59a5bff79474252954b811b4c6eee4a P 0cc430c282114763a287d3dfc4baa59e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } } peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } }
I20260808 14:34:19.554663 24109 raft_consensus.cc:374] T d59a5bff79474252954b811b4c6eee4a P 0cc430c282114763a287d3dfc4baa59e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:34:19.554705 24109 raft_consensus.cc:729] T d59a5bff79474252954b811b4c6eee4a P 0cc430c282114763a287d3dfc4baa59e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cc430c282114763a287d3dfc4baa59e, State: Initialized, Role: FOLLOWER
I20260808 14:34:19.554848 24109 consensus_queue.cc:260] T d59a5bff79474252954b811b4c6eee4a P 0cc430c282114763a287d3dfc4baa59e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } } peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } }
I20260808 14:34:19.555184 24109 ts_tablet_manager.cc:1428] T d59a5bff79474252954b811b4c6eee4a P 0cc430c282114763a287d3dfc4baa59e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:34:19.555977 24107 tablet_bootstrap.cc:492] T d59a5bff79474252954b811b4c6eee4a P 03ef70a3a2d642fa9199381942e4b838: No bootstrap required, opened a new log
I20260808 14:34:19.556074 24107 ts_tablet_manager.cc:1397] T d59a5bff79474252954b811b4c6eee4a P 03ef70a3a2d642fa9199381942e4b838: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260808 14:34:19.556474 24107 raft_consensus.cc:348] T d59a5bff79474252954b811b4c6eee4a P 03ef70a3a2d642fa9199381942e4b838 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } } peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } }
I20260808 14:34:19.556593 24107 raft_consensus.cc:374] T d59a5bff79474252954b811b4c6eee4a P 03ef70a3a2d642fa9199381942e4b838 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:34:19.556633 24107 raft_consensus.cc:729] T d59a5bff79474252954b811b4c6eee4a P 03ef70a3a2d642fa9199381942e4b838 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03ef70a3a2d642fa9199381942e4b838, State: Initialized, Role: FOLLOWER
I20260808 14:34:19.556762 24107 consensus_queue.cc:260] T d59a5bff79474252954b811b4c6eee4a P 03ef70a3a2d642fa9199381942e4b838 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } } peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } }
I20260808 14:34:19.557053 24107 ts_tablet_manager.cc:1428] T d59a5bff79474252954b811b4c6eee4a P 03ef70a3a2d642fa9199381942e4b838: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:34:19.558308 24108 tablet_bootstrap.cc:492] T d59a5bff79474252954b811b4c6eee4a P fb232188802a4b5eb680bcde792b54ad: No bootstrap required, opened a new log
I20260808 14:34:19.558411 24108 ts_tablet_manager.cc:1397] T d59a5bff79474252954b811b4c6eee4a P fb232188802a4b5eb680bcde792b54ad: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260808 14:34:19.558820 24108 raft_consensus.cc:348] T d59a5bff79474252954b811b4c6eee4a P fb232188802a4b5eb680bcde792b54ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } } peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } }
I20260808 14:34:19.558938 24108 raft_consensus.cc:374] T d59a5bff79474252954b811b4c6eee4a P fb232188802a4b5eb680bcde792b54ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:34:19.558971 24108 raft_consensus.cc:729] T d59a5bff79474252954b811b4c6eee4a P fb232188802a4b5eb680bcde792b54ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb232188802a4b5eb680bcde792b54ad, State: Initialized, Role: FOLLOWER
I20260808 14:34:19.559093 24108 consensus_queue.cc:260] T d59a5bff79474252954b811b4c6eee4a P fb232188802a4b5eb680bcde792b54ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } } peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } }
I20260808 14:34:19.559342 24108 ts_tablet_manager.cc:1428] T d59a5bff79474252954b811b4c6eee4a P fb232188802a4b5eb680bcde792b54ad: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 14:34:19.807991 24170 raft_consensus.cc:482] T d59a5bff79474252954b811b4c6eee4a P fb232188802a4b5eb680bcde792b54ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:34:19.808145 24170 raft_consensus.cc:504] T d59a5bff79474252954b811b4c6eee4a P fb232188802a4b5eb680bcde792b54ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } } peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } }
I20260808 14:34:19.808568 24170 leader_election.cc:288] T d59a5bff79474252954b811b4c6eee4a P fb232188802a4b5eb680bcde792b54ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03ef70a3a2d642fa9199381942e4b838 (127.11.131.194:40913), 0cc430c282114763a287d3dfc4baa59e (127.11.131.195:34505)
I20260808 14:34:19.809122 23980 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d59a5bff79474252954b811b4c6eee4a" candidate_uuid: "fb232188802a4b5eb680bcde792b54ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cc430c282114763a287d3dfc4baa59e" is_pre_election: true
I20260808 14:34:19.809122 23773 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d59a5bff79474252954b811b4c6eee4a" candidate_uuid: "fb232188802a4b5eb680bcde792b54ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03ef70a3a2d642fa9199381942e4b838" is_pre_election: true
I20260808 14:34:19.809291 23773 raft_consensus.cc:2454] T d59a5bff79474252954b811b4c6eee4a P 03ef70a3a2d642fa9199381942e4b838 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb232188802a4b5eb680bcde792b54ad in term 0.
I20260808 14:34:19.809291 23980 raft_consensus.cc:2454] T d59a5bff79474252954b811b4c6eee4a P 0cc430c282114763a287d3dfc4baa59e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb232188802a4b5eb680bcde792b54ad in term 0.
I20260808 14:34:19.809646 23457 leader_election.cc:302] T d59a5bff79474252954b811b4c6eee4a P fb232188802a4b5eb680bcde792b54ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03ef70a3a2d642fa9199381942e4b838, fb232188802a4b5eb680bcde792b54ad; no voters:
I20260808 14:34:19.809894 24170 raft_consensus.cc:2781] T d59a5bff79474252954b811b4c6eee4a P fb232188802a4b5eb680bcde792b54ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:34:19.809968 24170 raft_consensus.cc:482] T d59a5bff79474252954b811b4c6eee4a P fb232188802a4b5eb680bcde792b54ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:34:19.810009 24170 raft_consensus.cc:3037] T d59a5bff79474252954b811b4c6eee4a P fb232188802a4b5eb680bcde792b54ad [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:34:19.811201 24170 raft_consensus.cc:504] T d59a5bff79474252954b811b4c6eee4a P fb232188802a4b5eb680bcde792b54ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } } peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } }
I20260808 14:34:19.811558 24170 leader_election.cc:288] T d59a5bff79474252954b811b4c6eee4a P fb232188802a4b5eb680bcde792b54ad [CANDIDATE]: Term 1 election: Requested vote from peers 03ef70a3a2d642fa9199381942e4b838 (127.11.131.194:40913), 0cc430c282114763a287d3dfc4baa59e (127.11.131.195:34505)
I20260808 14:34:19.811946 23773 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d59a5bff79474252954b811b4c6eee4a" candidate_uuid: "fb232188802a4b5eb680bcde792b54ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03ef70a3a2d642fa9199381942e4b838"
I20260808 14:34:19.811945 23980 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d59a5bff79474252954b811b4c6eee4a" candidate_uuid: "fb232188802a4b5eb680bcde792b54ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cc430c282114763a287d3dfc4baa59e"
I20260808 14:34:19.812077 23773 raft_consensus.cc:3037] T d59a5bff79474252954b811b4c6eee4a P 03ef70a3a2d642fa9199381942e4b838 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:34:19.812077 23980 raft_consensus.cc:3037] T d59a5bff79474252954b811b4c6eee4a P 0cc430c282114763a287d3dfc4baa59e [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:34:19.813244 23773 raft_consensus.cc:2454] T d59a5bff79474252954b811b4c6eee4a P 03ef70a3a2d642fa9199381942e4b838 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb232188802a4b5eb680bcde792b54ad in term 1.
I20260808 14:34:19.813246 23980 raft_consensus.cc:2454] T d59a5bff79474252954b811b4c6eee4a P 0cc430c282114763a287d3dfc4baa59e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb232188802a4b5eb680bcde792b54ad in term 1.
I20260808 14:34:19.813589 23455 leader_election.cc:302] T d59a5bff79474252954b811b4c6eee4a P fb232188802a4b5eb680bcde792b54ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 03ef70a3a2d642fa9199381942e4b838, 0cc430c282114763a287d3dfc4baa59e, fb232188802a4b5eb680bcde792b54ad; no voters:
I20260808 14:34:19.813772 24170 raft_consensus.cc:2781] T d59a5bff79474252954b811b4c6eee4a P fb232188802a4b5eb680bcde792b54ad [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:34:19.813937 24170 raft_consensus.cc:686] T d59a5bff79474252954b811b4c6eee4a P fb232188802a4b5eb680bcde792b54ad [term 1 LEADER]: Becoming Leader. State: Replica: fb232188802a4b5eb680bcde792b54ad, State: Running, Role: LEADER
I20260808 14:34:19.814100 24170 consensus_queue.cc:237] T d59a5bff79474252954b811b4c6eee4a P fb232188802a4b5eb680bcde792b54ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } } peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } }
I20260808 14:34:19.815824 23326 catalog_manager.cc:5495] T d59a5bff79474252954b811b4c6eee4a P fb232188802a4b5eb680bcde792b54ad reported cstate change: term changed from 0 to 1, leader changed from <none> to fb232188802a4b5eb680bcde792b54ad (127.11.131.193). New cstate: current_term: 1 leader_uuid: "fb232188802a4b5eb680bcde792b54ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb232188802a4b5eb680bcde792b54ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 46203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 } health_report { overall_health: UNKNOWN } } }
I20260808 14:34:19.860200 24102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:19.857152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49004 (local address 127.11.131.193:46203)
0808 14:34:19.857265 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:19.857269 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:19.857282 (+ 13us) server_negotiation.cc:407] Connection header received
0808 14:34:19.857374 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:19.857376 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:19.857418 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:19.857475 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:34:19.857654 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:19.858146 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:19.859082 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:19.859302 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:19.859384 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:19.859686 (+ 302us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:34:19.859787 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:34:19.859859 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:19.859980 (+ 121us) server_negotiation.cc:299] Negotiation successful
0808 14:34:19.860023 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 14:34:19.869053 24102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:19.866051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:52997 (local address 127.11.131.193:46203)
0808 14:34:19.866166 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:19.866169 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:19.866284 (+ 115us) server_negotiation.cc:407] Connection header received
0808 14:34:19.866375 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:19.866377 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:19.866419 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:19.866481 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:34:19.866731 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:19.867256 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:19.868089 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:19.868343 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:19.868423 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:19.868648 (+ 225us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:34:19.868711 (+ 63us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:34:19.868779 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:19.868890 (+ 111us) server_negotiation.cc:299] Negotiation successful
0808 14:34:19.868934 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":46}
I20260808 14:34:19.869069 24247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:19.865947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:46203 (local address 127.11.131.193:52997)
0808 14:34:19.866196 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:19.866215 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:19.866299 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:19.866504 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:19.866507 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:19.866512 (+ 5us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 14:34:19.866636 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:19.866641 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:19.867368 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:19.867371 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:19.867981 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:19.867990 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:19.868453 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:19.868456 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:19.868520 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:19.868545 (+ 25us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 14:34:19.868820 (+ 275us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 14:34:19.868827 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 14:34:19.868884 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 14:34:19.868950 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"mutex_wait_us":14,"thread_start_us":100,"threads_started":1}
I20260808 14:34:19.875422 23773 raft_consensus.cc:1261] T d59a5bff79474252954b811b4c6eee4a P 03ef70a3a2d642fa9199381942e4b838 [term 1 FOLLOWER]: Refusing update from remote peer fb232188802a4b5eb680bcde792b54ad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:34:19.875468 23980 raft_consensus.cc:1261] T d59a5bff79474252954b811b4c6eee4a P 0cc430c282114763a287d3dfc4baa59e [term 1 FOLLOWER]: Refusing update from remote peer fb232188802a4b5eb680bcde792b54ad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:34:19.875897 24241 consensus_queue.cc:1035] T d59a5bff79474252954b811b4c6eee4a P fb232188802a4b5eb680bcde792b54ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "03ef70a3a2d642fa9199381942e4b838" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 40913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:34:19.876101 24243 consensus_queue.cc:1035] T d59a5bff79474252954b811b4c6eee4a P fb232188802a4b5eb680bcde792b54ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cc430c282114763a287d3dfc4baa59e" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:34:19.910177 23326 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46930:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:34:19.910370 23326 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46930:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:34:19.912892 23326 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 549d638a80bc4b74b95025f8a750633b: Sending DeleteTablet for 3 replicas of tablet d59a5bff79474252954b811b4c6eee4a
I20260808 14:34:19.913443 23532 tablet_service.cc:1514] Processing DeleteTablet for tablet d59a5bff79474252954b811b4c6eee4a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:34:19 UTC) from {username='oryx', principal='oryx/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:48994
I20260808 14:34:19.913591 23746 tablet_service.cc:1514] Processing DeleteTablet for tablet d59a5bff79474252954b811b4c6eee4a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:34:19 UTC) from {username='oryx', principal='oryx/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:54170
I20260808 14:34:19.913650 24147 tablet_replica.cc:330] T d59a5bff79474252954b811b4c6eee4a P fb232188802a4b5eb680bcde792b54ad: stopping tablet replica
I20260808 14:34:19.913765 24147 raft_consensus.cc:2229] T d59a5bff79474252954b811b4c6eee4a P fb232188802a4b5eb680bcde792b54ad [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:34:19.913810 24148 tablet_replica.cc:330] T d59a5bff79474252954b811b4c6eee4a P 03ef70a3a2d642fa9199381942e4b838: stopping tablet replica
I20260808 14:34:19.913800 23952 tablet_service.cc:1514] Processing DeleteTablet for tablet d59a5bff79474252954b811b4c6eee4a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:34:19 UTC) from {username='oryx', principal='oryx/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:34652
I20260808 14:34:19.913945 24148 raft_consensus.cc:2229] T d59a5bff79474252954b811b4c6eee4a P 03ef70a3a2d642fa9199381942e4b838 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:34:19.913967 24146 tablet_replica.cc:330] T d59a5bff79474252954b811b4c6eee4a P 0cc430c282114763a287d3dfc4baa59e: stopping tablet replica
I20260808 14:34:19.914062 24148 raft_consensus.cc:2258] T d59a5bff79474252954b811b4c6eee4a P 03ef70a3a2d642fa9199381942e4b838 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:34:19.914067 24147 raft_consensus.cc:2258] T d59a5bff79474252954b811b4c6eee4a P fb232188802a4b5eb680bcde792b54ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:34:19.914078 24146 raft_consensus.cc:2229] T d59a5bff79474252954b811b4c6eee4a P 0cc430c282114763a287d3dfc4baa59e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:34:19.914186 24146 raft_consensus.cc:2258] T d59a5bff79474252954b811b4c6eee4a P 0cc430c282114763a287d3dfc4baa59e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:34:19.914871 24147 ts_tablet_manager.cc:1905] T d59a5bff79474252954b811b4c6eee4a P fb232188802a4b5eb680bcde792b54ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:34:19.914882 24148 ts_tablet_manager.cc:1905] T d59a5bff79474252954b811b4c6eee4a P 03ef70a3a2d642fa9199381942e4b838: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:34:19.915755 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 23431
I20260808 14:34:19.917644 24148 ts_tablet_manager.cc:1918] T d59a5bff79474252954b811b4c6eee4a P 03ef70a3a2d642fa9199381942e4b838: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:34:19.917721 24148 log.cc:1196] T d59a5bff79474252954b811b4c6eee4a P 03ef70a3a2d642fa9199381942e4b838: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-1/wal/wals/d59a5bff79474252954b811b4c6eee4a
I20260808 14:34:19.918040 24148 ts_tablet_manager.cc:1939] T d59a5bff79474252954b811b4c6eee4a P 03ef70a3a2d642fa9199381942e4b838: Deleting consensus metadata
I20260808 14:34:19.918740 23310 catalog_manager.cc:4841] TS 03ef70a3a2d642fa9199381942e4b838 (127.11.131.194:40913): tablet d59a5bff79474252954b811b4c6eee4a (table test-table [id=c64ab8bb67d6484586f77bb6a3454548]) successfully deleted
I20260808 14:34:19.927042 24146 ts_tablet_manager.cc:1905] T d59a5bff79474252954b811b4c6eee4a P 0cc430c282114763a287d3dfc4baa59e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:34:19.929256 24146 ts_tablet_manager.cc:1918] T d59a5bff79474252954b811b4c6eee4a P 0cc430c282114763a287d3dfc4baa59e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 14:34:19.929316 24146 log.cc:1196] T d59a5bff79474252954b811b4c6eee4a P 0cc430c282114763a287d3dfc4baa59e: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786199615258783-11791-0/minicluster-data/ts-2/wal/wals/d59a5bff79474252954b811b4c6eee4a
I20260808 14:34:19.929517 24146 ts_tablet_manager.cc:1939] T d59a5bff79474252954b811b4c6eee4a P 0cc430c282114763a287d3dfc4baa59e: Deleting consensus metadata
I20260808 14:34:19.930487 23307 catalog_manager.cc:4841] TS 0cc430c282114763a287d3dfc4baa59e (127.11.131.195:34505): tablet d59a5bff79474252954b811b4c6eee4a (table test-table [id=c64ab8bb67d6484586f77bb6a3454548]) successfully deleted
W20260808 14:34:19.936434 23305 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.131.193:46203 (error 108)
I20260808 14:34:19.936851 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 23651
I20260808 14:34:19.941654 24253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:19.941062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:46203 (local address 127.0.0.1:49006)
0808 14:34:19.941449 (+ 387us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:19.941539 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.193:46203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":69,"threads_started":1}
W20260808 14:34:19.941882 23305 catalog_manager.cc:4584] TS fb232188802a4b5eb680bcde792b54ad (127.11.131.193:46203): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d59a5bff79474252954b811b4c6eee4a: Network error: Client connection negotiation failed: client connection to 127.11.131.193:46203: connect: Connection refused (error 111)
I20260808 14:34:19.950948 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 23854
I20260808 14:34:19.966774 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 23278
2026-08-08T14:34:19Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3729 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786199615258783-11791-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:34:20 dist-test-slave-twwt krb5kdc[24258](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:34:20 dist-test-slave-twwt krb5kdc[24258](info): set up 2 sockets
Aug 08 14:34:20 dist-test-slave-twwt krb5kdc[24258](info): commencing operation
krb5kdc: starting...
W20260808 14:34:21.219055 11791 mini_kdc.cc:121] Time spent starting KDC: real 1.222s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Aug 08 14:34:21 dist-test-slave-twwt krb5kdc[24258](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199661, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:34:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:34:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.131.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
I20260808 14:34:21.351512 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:43863
--webserver_interface=127.11.131.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:42093
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:43863
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:34:21.464993 24277 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:34:21.465294 24277 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:34:21.465369 24277 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:34:21.469343 24277 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:34:21.469431 24277 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:34:21.469470 24277 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:34:21.469530 24277 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:34:21.469571 24277 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:34:21.475485 24277 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:42093
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786199615258783-11791-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:43863
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:43863
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.131.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24277
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:34:21.476591 24277 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:34:21.477658 24277 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:34:21.486586 24291 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:21.486567 24287 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:21.486691 24288 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:21.486799 24277 server_base.cc:1034] running on GCE node
I20260808 14:34:21.487493 24277 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:34:21.488605 24277 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:34:21.489804 24277 hybrid_clock.cc:648] HybridClock initialized: now 1786199661489787 us; error 35 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-08T14:34:21Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1527 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:34:21 dist-test-slave-twwt krb5kdc[24299](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:34:21 dist-test-slave-twwt krb5kdc[24299](info): set up 2 sockets
Aug 08 14:34:21 dist-test-slave-twwt krb5kdc[24299](info): commencing operation
krb5kdc: starting...
W20260808 14:34:22.780874 11791 mini_kdc.cc:121] Time spent starting KDC: real 1.257s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Aug 08 14:34:22 dist-test-slave-twwt krb5kdc[24299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199662, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:34:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:34:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.131.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
I20260808 14:34:22.909790 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:35395
--webserver_interface=127.11.131.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:44429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:35395
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:34:23.027479 24322 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:34:23.027779 24322 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:34:23.027823 24322 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:34:23.032027 24322 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:34:23.032097 24322 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:34:23.032116 24322 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:34:23.032135 24322 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:34:23.032150 24322 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:34:23.037936 24322 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:44429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:35395
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:35395
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.131.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24322
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:34:23.039130 24322 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:34:23.040207 24322 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:34:23.049630 24328 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:23.049602 24333 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:23.049589 24322 server_base.cc:1034] running on GCE node
W20260808 14:34:23.049589 24329 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:23.050482 24322 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:34:23.051661 24322 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:34:23.052855 24322 hybrid_clock.cc:648] HybridClock initialized: now 1786199663052841 us; error 34 us; skew 500 ppm
Aug 08 14:34:23 dist-test-slave-twwt krb5kdc[24299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199663, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:34:23.060181 24322 init.cc:377] Logged in from keytab as kudu/127.11.131.254@KRBTEST.COM (short username kudu)
I20260808 14:34:23.061122 24322 webserver.cc:460] Webserver started at http://127.11.131.254:40049/ using document root <none> and password file <none>
I20260808 14:34:23.061681 24322 fs_manager.cc:359] Metadata directory not provided
I20260808 14:34:23.061741 24322 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:34:23.062000 24322 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:34:23.064172 24322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/master-0/data/instance:
uuid: "5107e47c9f294523a5ea9b4010fb7e0d"
format_stamp: "Formatted at 2026-08-08 14:34:23 on dist-test-slave-twwt"
server_key: "58a90c074f03bc748bccd8483e2074a3"
server_key_iv: "02277c42c0545acd069447673ae67783"
server_key_version: "encryptionkey@0"
I20260808 14:34:23.064706 24322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/master-0/wal/instance:
uuid: "5107e47c9f294523a5ea9b4010fb7e0d"
format_stamp: "Formatted at 2026-08-08 14:34:23 on dist-test-slave-twwt"
server_key: "58a90c074f03bc748bccd8483e2074a3"
server_key_iv: "02277c42c0545acd069447673ae67783"
server_key_version: "encryptionkey@0"
I20260808 14:34:23.068517 24322 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 14:34:23.071022 24342 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:23.072283 24322 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 14:34:23.072412 24322 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "5107e47c9f294523a5ea9b4010fb7e0d"
format_stamp: "Formatted at 2026-08-08 14:34:23 on dist-test-slave-twwt"
server_key: "58a90c074f03bc748bccd8483e2074a3"
server_key_iv: "02277c42c0545acd069447673ae67783"
server_key_version: "encryptionkey@0"
I20260808 14:34:23.072518 24322 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:34:23.115954 24322 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:34:23.119653 24322 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:34:23.119940 24322 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:34:23.127604 24322 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.254:35395
I20260808 14:34:23.127696 24422 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.254:35395 every 8 connection(s)
I20260808 14:34:23.128638 24322 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:34:23.131655 24423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:34:23.137406 24423 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5107e47c9f294523a5ea9b4010fb7e0d: Bootstrap starting.
I20260808 14:34:23.137756 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 24322
I20260808 14:34:23.137928 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/master-0/wal/instance
I20260808 14:34:23.138237 11791 external_mini_cluster.cc:1428] Setting key 7283262d6529965ea1e6f262140a5e89
I20260808 14:34:23.140367 24423 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5107e47c9f294523a5ea9b4010fb7e0d: Neither blocks nor log segments found. Creating new log.
I20260808 14:34:23.141120 24423 log.cc:824] T 00000000000000000000000000000000 P 5107e47c9f294523a5ea9b4010fb7e0d: Log is configured to *not* fsync() on all Append() calls
I20260808 14:34:23.143374 24423 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5107e47c9f294523a5ea9b4010fb7e0d: No bootstrap required, opened a new log
Aug 08 14:34:23 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199662, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:34:23.148114 24423 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5107e47c9f294523a5ea9b4010fb7e0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5107e47c9f294523a5ea9b4010fb7e0d" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 35395 } }
I20260808 14:34:23.148339 24423 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5107e47c9f294523a5ea9b4010fb7e0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:34:23.148401 24423 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5107e47c9f294523a5ea9b4010fb7e0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5107e47c9f294523a5ea9b4010fb7e0d, State: Initialized, Role: FOLLOWER
I20260808 14:34:23.148914 24423 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5107e47c9f294523a5ea9b4010fb7e0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5107e47c9f294523a5ea9b4010fb7e0d" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 35395 } }
I20260808 14:34:23.149089 24423 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5107e47c9f294523a5ea9b4010fb7e0d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:34:23.149191 24423 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5107e47c9f294523a5ea9b4010fb7e0d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:34:23.149295 24423 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5107e47c9f294523a5ea9b4010fb7e0d [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:34:23.150291 24423 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5107e47c9f294523a5ea9b4010fb7e0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5107e47c9f294523a5ea9b4010fb7e0d" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 35395 } }
I20260808 14:34:23.150709 24423 leader_election.cc:302] T 00000000000000000000000000000000 P 5107e47c9f294523a5ea9b4010fb7e0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5107e47c9f294523a5ea9b4010fb7e0d; no voters:
I20260808 14:34:23.151062 24423 leader_election.cc:288] T 00000000000000000000000000000000 P 5107e47c9f294523a5ea9b4010fb7e0d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:34:23.151141 24431 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5107e47c9f294523a5ea9b4010fb7e0d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:34:23.151396 24431 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5107e47c9f294523a5ea9b4010fb7e0d [term 1 LEADER]: Becoming Leader. State: Replica: 5107e47c9f294523a5ea9b4010fb7e0d, State: Running, Role: LEADER
I20260808 14:34:23.151762 24431 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5107e47c9f294523a5ea9b4010fb7e0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5107e47c9f294523a5ea9b4010fb7e0d" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 35395 } }
I20260808 14:34:23.152451 24423 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5107e47c9f294523a5ea9b4010fb7e0d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:34:23.153663 24433 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5107e47c9f294523a5ea9b4010fb7e0d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5107e47c9f294523a5ea9b4010fb7e0d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5107e47c9f294523a5ea9b4010fb7e0d" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 35395 } } }
I20260808 14:34:23.153791 24433 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5107e47c9f294523a5ea9b4010fb7e0d [sys.catalog]: This master's current role is: LEADER
I20260808 14:34:23.154053 24427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:23.139710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38184 (local address 127.11.131.254:35395)
0808 14:34:23.140183 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:23.140198 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:23.140235 (+ 37us) server_negotiation.cc:407] Connection header received
0808 14:34:23.140946 (+ 711us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:23.140964 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:23.141357 (+ 393us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:23.141719 (+ 362us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:23.142564 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:23.143675 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:23.144820 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:23.145290 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:23.145406 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:23.148353 (+ 2947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:23.148361 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:23.148381 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:23.148420 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:23.150412 (+ 1992us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:23.150989 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:23.151001 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:23.151006 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:23.151146 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:23.151518 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:23.151521 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:23.151523 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:23.152026 (+ 503us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:23.152247 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:23.152521 (+ 274us) server_negotiation.cc:299] Negotiation successful
0808 14:34:23.153042 (+ 521us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":328,"thread_start_us":157,"threads_started":1}
I20260808 14:34:23.154119 24434 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5107e47c9f294523a5ea9b4010fb7e0d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5107e47c9f294523a5ea9b4010fb7e0d. Latest consensus state: current_term: 1 leader_uuid: "5107e47c9f294523a5ea9b4010fb7e0d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5107e47c9f294523a5ea9b4010fb7e0d" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 35395 } } }
I20260808 14:34:23.154282 24434 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5107e47c9f294523a5ea9b4010fb7e0d [sys.catalog]: This master's current role is: LEADER
W20260808 14:34:23.158649 24458 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5107e47c9f294523a5ea9b4010fb7e0d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:34:23.158731 24458 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:34:23.158846 24447 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:34:23.159677 24447 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:34:23.165501 24447 catalog_manager.cc:1347] Generated new cluster ID: b811fe89d5054b46a792d40f51f48749
I20260808 14:34:23.165581 24447 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:34:23.174742 24447 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:34:23.175985 24447 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:34:23.181591 24447 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5107e47c9f294523a5ea9b4010fb7e0d: Generated new TSK 0
I20260808 14:34:23.182283 24447 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.131.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab.
Entry for principal kudu/127.11.131.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab.
I20260808 14:34:23.216073 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.193:0
--local_ip_for_outbound_sockets=127.11.131.193
--webserver_interface=127.11.131.193
--webserver_port=0
--tserver_master_addrs=127.11.131.254:35395
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab
--principal=kudu/127.11.131.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:44429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:34:23.336809 24464 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:34:23.337069 24464 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:34:23.337157 24464 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:34:23.341552 24464 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:34:23.341619 24464 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:34:23.341733 24464 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.193
I20260808 14:34:23.347241 24464 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:44429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab
--principal=kudu/127.11.131.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.131.193
--webserver_port=0
--tserver_master_addrs=127.11.131.254:35395
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24464
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.193
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:34:23.348352 24464 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:34:23.349438 24464 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 14:34:23.359866 24464 server_base.cc:1034] running on GCE node
W20260808 14:34:23.359839 24476 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:23.359898 24477 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:23.360003 24479 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:23.360462 24464 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:34:23.361030 24464 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:34:23.362221 24464 hybrid_clock.cc:648] HybridClock initialized: now 1786199663362196 us; error 37 us; skew 500 ppm
Aug 08 14:34:23 dist-test-slave-twwt krb5kdc[24299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199663, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:34:23.365183 24464 init.cc:377] Logged in from keytab as kudu/127.11.131.193@KRBTEST.COM (short username kudu)
I20260808 14:34:23.366056 24464 webserver.cc:460] Webserver started at http://127.11.131.193:39791/ using document root <none> and password file <none>
I20260808 14:34:23.366701 24464 fs_manager.cc:359] Metadata directory not provided
I20260808 14:34:23.366798 24464 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:34:23.367046 24464 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:34:23.369122 24464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-0/data/instance:
uuid: "e498cb878c564931a5e1c4820f947b9a"
format_stamp: "Formatted at 2026-08-08 14:34:23 on dist-test-slave-twwt"
server_key: "2753506ab3ab6a343570588a700a889e"
server_key_iv: "23fd6b89d7a2539fefc58add436c0151"
server_key_version: "encryptionkey@0"
I20260808 14:34:23.369711 24464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-0/wal/instance:
uuid: "e498cb878c564931a5e1c4820f947b9a"
format_stamp: "Formatted at 2026-08-08 14:34:23 on dist-test-slave-twwt"
server_key: "2753506ab3ab6a343570588a700a889e"
server_key_iv: "23fd6b89d7a2539fefc58add436c0151"
server_key_version: "encryptionkey@0"
I20260808 14:34:23.373519 24464 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260808 14:34:23.376070 24489 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:23.377316 24464 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 14:34:23.377454 24464 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-0/wal
uuid: "e498cb878c564931a5e1c4820f947b9a"
format_stamp: "Formatted at 2026-08-08 14:34:23 on dist-test-slave-twwt"
server_key: "2753506ab3ab6a343570588a700a889e"
server_key_iv: "23fd6b89d7a2539fefc58add436c0151"
server_key_version: "encryptionkey@0"
I20260808 14:34:23.377568 24464 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:34:23.390844 24464 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:34:23.394253 24464 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:34:23.394472 24464 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:34:23.395192 24464 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:34:23.396063 24464 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:34:23.396136 24464 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:23.396209 24464 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:34:23.396250 24464 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:23.406133 24464 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.193:46385
I20260808 14:34:23.406153 24652 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.193:46385 every 8 connection(s)
I20260808 14:34:23.407220 24464 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
I20260808 14:34:23.414155 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 24464
I20260808 14:34:23.414304 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-0/wal/instance
I20260808 14:34:23.414703 11791 external_mini_cluster.cc:1428] Setting key 0d797a409981401e1f5a72a05a20a2b4
Aug 08 14:34:23 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199663, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.193@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:34:23.421947 24427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:23.409183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:58585 (local address 127.11.131.254:35395)
0808 14:34:23.409369 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:23.409375 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:23.410493 (+ 1118us) server_negotiation.cc:407] Connection header received
0808 14:34:23.411419 (+ 926us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:23.411421 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:23.411470 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:23.411547 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:23.412746 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:23.413268 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:23.414561 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:23.414952 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:23.415066 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:23.417772 (+ 2706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:23.417778 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:23.417784 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:23.417819 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:23.419480 (+ 1661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:23.420115 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:23.420118 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:23.420119 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:23.420200 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:23.420658 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:23.420660 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:23.420662 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:23.420874 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:23.420955 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:23.421649 (+ 694us) server_negotiation.cc:299] Negotiation successful
0808 14:34:23.421760 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 14:34:23.423157 24658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:23.409617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.193:58585)
0808 14:34:23.410319 (+ 702us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:23.410363 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:23.411209 (+ 846us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:23.411719 (+ 510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:23.411726 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:23.412090 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:23.412600 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:23.412614 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:23.413392 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:23.413395 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:23.414441 (+ 1046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:23.414452 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:23.415123 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:23.415129 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:23.415352 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:23.415992 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:23.416015 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:23.417601 (+ 1586us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:23.419609 (+ 2008us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:23.419615 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:23.419631 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:23.420004 (+ 373us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:23.420301 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:23.420307 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:23.420311 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:23.420559 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:23.420991 (+ 432us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:23.421001 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:23.421346 (+ 345us) client_negotiation.cc:769] Sending connection context
0808 14:34:23.421629 (+ 283us) client_negotiation.cc:240] Negotiation successful
0808 14:34:23.422035 (+ 406us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":495,"thread_start_us":127,"threads_started":1}
I20260808 14:34:23.424685 24656 heartbeater.cc:347] Connected to a master server at 127.11.131.254:35395
I20260808 14:34:23.424970 24656 heartbeater.cc:464] Registering TS with master...
I20260808 14:34:23.425513 24656 heartbeater.cc:511] Master 127.11.131.254:35395 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.11.131.194@KRBTEST.COM; defaulting to no policy
I20260808 14:34:23.427399 24377 ts_manager.cc:194] Registered new tserver with Master: e498cb878c564931a5e1c4820f947b9a (127.11.131.193:46385)
I20260808 14:34:23.428588 24377 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.193@KRBTEST.COM'} at 127.11.131.193:58585
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab.
Entry for principal kudu/127.11.131.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab.
I20260808 14:34:23.445748 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.194:0
--local_ip_for_outbound_sockets=127.11.131.194
--webserver_interface=127.11.131.194
--webserver_port=0
--tserver_master_addrs=127.11.131.254:35395
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab
--principal=kudu/127.11.131.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:44429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:34:23.563192 24663 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:34:23.563511 24663 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:34:23.563625 24663 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:34:23.568449 24663 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:34:23.568517 24663 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:34:23.568627 24663 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.194
I20260808 14:34:23.574016 24663 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:44429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab
--principal=kudu/127.11.131.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.131.194
--webserver_port=0
--tserver_master_addrs=127.11.131.254:35395
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24663
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.194
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:34:23.575198 24663 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:34:23.576313 24663 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:34:23.586352 24671 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:23.586335 24672 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:23.586426 24663 server_base.cc:1034] running on GCE node
W20260808 14:34:23.586335 24674 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:23.587245 24663 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:34:23.587903 24663 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:34:23.589099 24663 hybrid_clock.cc:648] HybridClock initialized: now 1786199663589076 us; error 32 us; skew 500 ppm
Aug 08 14:34:23 dist-test-slave-twwt krb5kdc[24299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199663, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:34:23.592088 24663 init.cc:377] Logged in from keytab as kudu/127.11.131.194@KRBTEST.COM (short username kudu)
I20260808 14:34:23.592995 24663 webserver.cc:460] Webserver started at http://127.11.131.194:46397/ using document root <none> and password file <none>
I20260808 14:34:23.593581 24663 fs_manager.cc:359] Metadata directory not provided
I20260808 14:34:23.593675 24663 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:34:23.593928 24663 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:34:23.596082 24663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-1/data/instance:
uuid: "1cc1c589ed6e44dc89d26c3f36c34ef1"
format_stamp: "Formatted at 2026-08-08 14:34:23 on dist-test-slave-twwt"
server_key: "e755c4facdacfd7e0b6f8295998efead"
server_key_iv: "00b2c4d3640ab95d40c18ebc1c8e544e"
server_key_version: "encryptionkey@0"
I20260808 14:34:23.596676 24663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-1/wal/instance:
uuid: "1cc1c589ed6e44dc89d26c3f36c34ef1"
format_stamp: "Formatted at 2026-08-08 14:34:23 on dist-test-slave-twwt"
server_key: "e755c4facdacfd7e0b6f8295998efead"
server_key_iv: "00b2c4d3640ab95d40c18ebc1c8e544e"
server_key_version: "encryptionkey@0"
I20260808 14:34:23.600550 24663 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 14:34:23.603034 24683 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:23.604280 24663 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 14:34:23.604425 24663 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-1/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-1/wal
uuid: "1cc1c589ed6e44dc89d26c3f36c34ef1"
format_stamp: "Formatted at 2026-08-08 14:34:23 on dist-test-slave-twwt"
server_key: "e755c4facdacfd7e0b6f8295998efead"
server_key_iv: "00b2c4d3640ab95d40c18ebc1c8e544e"
server_key_version: "encryptionkey@0"
I20260808 14:34:23.604545 24663 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:34:23.625285 24663 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:34:23.628993 24663 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:34:23.629197 24663 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:34:23.629823 24663 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:34:23.630771 24663 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:34:23.630844 24663 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:23.630928 24663 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:34:23.630980 24663 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:23.640726 24663 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.194:41145
I20260808 14:34:23.640777 24854 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.194:41145 every 8 connection(s)
I20260808 14:34:23.641731 24663 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
I20260808 14:34:23.642900 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 24663
I20260808 14:34:23.643055 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-1/wal/instance
I20260808 14:34:23.643388 11791 external_mini_cluster.cc:1428] Setting key cd7feed0e786d7542145a8bfb3a4d487
Aug 08 14:34:23 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199663, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.194@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.131.195@KRBTEST.COM; defaulting to no policy
I20260808 14:34:23.658531 24427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:23.643866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:49077 (local address 127.11.131.254:35395)
0808 14:34:23.644028 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:23.644035 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:23.645289 (+ 1254us) server_negotiation.cc:407] Connection header received
0808 14:34:23.646293 (+ 1004us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:23.646300 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:23.646366 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:23.646464 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:23.648181 (+ 1717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:23.648703 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:23.650572 (+ 1869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:23.650855 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:23.650950 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:23.654376 (+ 3426us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:23.654379 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:23.654381 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:23.654407 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:23.656251 (+ 1844us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:23.656867 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:23.656873 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:23.656875 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:23.656971 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:23.657344 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:23.657347 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:23.657348 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:23.657541 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:23.657623 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:23.658284 (+ 661us) server_negotiation.cc:299] Negotiation successful
0808 14:34:23.658400 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.195@KRBTEST.COM" created.
I20260808 14:34:23.659570 24857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:23.644304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.194:49077)
0808 14:34:23.645142 (+ 838us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:23.645187 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:23.646019 (+ 832us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:23.646689 (+ 670us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:23.646732 (+ 43us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:23.647174 (+ 442us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:23.647999 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:23.648023 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:23.648866 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:23.648873 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:23.650420 (+ 1547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:23.650437 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:23.651047 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:23.651052 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:23.651332 (+ 280us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:23.651996 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:23.652025 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:23.654192 (+ 2167us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:23.656364 (+ 2172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:23.656371 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:23.656385 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:23.656653 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:23.657077 (+ 424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:23.657080 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:23.657082 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:23.657239 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:23.657639 (+ 400us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:23.657645 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:23.657905 (+ 260us) client_negotiation.cc:769] Sending connection context
0808 14:34:23.658131 (+ 226us) client_negotiation.cc:240] Negotiation successful
0808 14:34:23.658451 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":599,"thread_start_us":136,"threads_started":1}
I20260808 14:34:23.660828 24855 heartbeater.cc:347] Connected to a master server at 127.11.131.254:35395
I20260808 14:34:23.661106 24855 heartbeater.cc:464] Registering TS with master...
I20260808 14:34:23.661646 24855 heartbeater.cc:511] Master 127.11.131.254:35395 requested a full tablet report, sending...
I20260808 14:34:23.662873 24377 ts_manager.cc:194] Registered new tserver with Master: 1cc1c589ed6e44dc89d26c3f36c34ef1 (127.11.131.194:41145)
I20260808 14:34:23.663779 24377 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.194@KRBTEST.COM'} at 127.11.131.194:49077
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab.
Entry for principal kudu/127.11.131.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab.
I20260808 14:34:23.677318 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.195:0
--local_ip_for_outbound_sockets=127.11.131.195
--webserver_interface=127.11.131.195
--webserver_port=0
--tserver_master_addrs=127.11.131.254:35395
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab
--principal=kudu/127.11.131.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:44429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:34:23.797618 24862 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:34:23.797881 24862 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:34:23.797973 24862 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:34:23.802066 24862 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:34:23.802125 24862 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:34:23.802240 24862 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.195
I20260808 14:34:23.807646 24862 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:44429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab
--principal=kudu/127.11.131.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.131.195
--webserver_port=0
--tserver_master_addrs=127.11.131.254:35395
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24862
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.195
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:34:23.808841 24862 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:34:23.809948 24862 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:34:23.819950 24869 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:23.819983 24872 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:23.819949 24870 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:23.820178 24862 server_base.cc:1034] running on GCE node
I20260808 14:34:23.820684 24862 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:34:23.821321 24862 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:34:23.822520 24862 hybrid_clock.cc:648] HybridClock initialized: now 1786199663822503 us; error 29 us; skew 500 ppm
Aug 08 14:34:23 dist-test-slave-twwt krb5kdc[24299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199663, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:34:23.825438 24862 init.cc:377] Logged in from keytab as kudu/127.11.131.195@KRBTEST.COM (short username kudu)
I20260808 14:34:23.826354 24862 webserver.cc:460] Webserver started at http://127.11.131.195:35725/ using document root <none> and password file <none>
I20260808 14:34:23.827000 24862 fs_manager.cc:359] Metadata directory not provided
I20260808 14:34:23.827095 24862 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:34:23.827353 24862 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:34:23.829448 24862 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-2/data/instance:
uuid: "891196ec3a044df09cd9bcf0d87d74ca"
format_stamp: "Formatted at 2026-08-08 14:34:23 on dist-test-slave-twwt"
server_key: "a373c8217859aace330391e89d47da32"
server_key_iv: "d1b32115a3644165c6983eccf66129c3"
server_key_version: "encryptionkey@0"
I20260808 14:34:23.830045 24862 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-2/wal/instance:
uuid: "891196ec3a044df09cd9bcf0d87d74ca"
format_stamp: "Formatted at 2026-08-08 14:34:23 on dist-test-slave-twwt"
server_key: "a373c8217859aace330391e89d47da32"
server_key_iv: "d1b32115a3644165c6983eccf66129c3"
server_key_version: "encryptionkey@0"
I20260808 14:34:23.833887 24862 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 14:34:23.836462 24882 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:23.837740 24862 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 14:34:23.837910 24862 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-2/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-2/wal
uuid: "891196ec3a044df09cd9bcf0d87d74ca"
format_stamp: "Formatted at 2026-08-08 14:34:23 on dist-test-slave-twwt"
server_key: "a373c8217859aace330391e89d47da32"
server_key_iv: "d1b32115a3644165c6983eccf66129c3"
server_key_version: "encryptionkey@0"
I20260808 14:34:23.838027 24862 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:34:23.856490 24862 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:34:23.859689 24862 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:34:23.859907 24862 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:34:23.860817 24862 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:34:23.861732 24862 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:34:23.861856 24862 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:23.861954 24862 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:34:23.862013 24862 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:23.871454 24862 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.195:45213
I20260808 14:34:23.871475 25053 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.195:45213 every 8 connection(s)
I20260808 14:34:23.872570 24862 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
I20260808 14:34:23.874965 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 24862
I20260808 14:34:23.875123 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-2/wal/instance
I20260808 14:34:23.875453 11791 external_mini_cluster.cc:1428] Setting key 8959e20b527380e41929bbc2b76df018
Aug 08 14:34:23 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199663, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.195@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:34:23.886978 24427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:23.874676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:48945 (local address 127.11.131.254:35395)
0808 14:34:23.874881 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:23.874886 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:23.876347 (+ 1461us) server_negotiation.cc:407] Connection header received
0808 14:34:23.877637 (+ 1290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:23.877639 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:23.877684 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:23.877789 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:23.879068 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:23.879595 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:23.880859 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:23.881070 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:23.881150 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:23.883715 (+ 2565us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:23.883719 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:23.883722 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:23.883749 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:23.885001 (+ 1252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:23.885513 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:23.885517 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:23.885518 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:23.885596 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:23.885938 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:23.885941 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:23.885942 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:23.886132 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:23.886215 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:23.886746 (+ 531us) server_negotiation.cc:299] Negotiation successful
0808 14:34:23.886851 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 14:34:23.887771 25059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:23.875021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.195:48945)
0808 14:34:23.876176 (+ 1155us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:23.876231 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:23.877412 (+ 1181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:23.877984 (+ 572us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:23.877993 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:23.878377 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:23.878936 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:23.878950 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:23.879749 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:23.879752 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:23.880748 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:23.880760 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:23.881211 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:23.881215 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:23.881422 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:23.882007 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:23.882024 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:23.883531 (+ 1507us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:23.885116 (+ 1585us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:23.885121 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:23.885134 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:23.885409 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:23.885679 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:23.885681 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:23.885683 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:23.885816 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:23.886229 (+ 413us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:23.886234 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:23.886468 (+ 234us) client_negotiation.cc:769] Sending connection context
0808 14:34:23.886673 (+ 205us) client_negotiation.cc:240] Negotiation successful
0808 14:34:23.886940 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":926,"thread_start_us":188,"threads_started":1}
I20260808 14:34:23.889125 25054 heartbeater.cc:347] Connected to a master server at 127.11.131.254:35395
I20260808 14:34:23.889400 25054 heartbeater.cc:464] Registering TS with master...
I20260808 14:34:23.889993 25054 heartbeater.cc:511] Master 127.11.131.254:35395 requested a full tablet report, sending...
I20260808 14:34:23.891083 24377 ts_manager.cc:194] Registered new tserver with Master: 891196ec3a044df09cd9bcf0d87d74ca (127.11.131.195:45213)
I20260808 14:34:23.891660 24377 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.195@KRBTEST.COM'} at 127.11.131.195:48945
I20260808 14:34:23.901891 11791 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.11.131.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.131.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.131.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.193.keytab.
Entry for principal oryx/127.11.131.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.193.keytab.
WARNING: no policy specified for oryx/127.11.131.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.131.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.131.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.194.keytab.
Entry for principal oryx/127.11.131.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.194.keytab.
WARNING: no policy specified for oryx/127.11.131.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.131.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.131.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.195.keytab.
Entry for principal oryx/127.11.131.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.195.keytab.
I20260808 14:34:23.986069 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 24464
I20260808 14:34:24.014111 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 24663
I20260808 14:34:24.026722 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 24862
I20260808 14:34:24.038597 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 24322
I20260808 14:34:24.052201 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:35395
--webserver_interface=127.11.131.254
--webserver_port=40049
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:44429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:35395
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:34:24.175961 25066 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:34:24.176313 25066 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:34:24.176396 25066 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:34:24.180487 25066 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:34:24.180594 25066 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:34:24.180634 25066 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:34:24.180672 25066 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:34:24.180716 25066 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:34:24.186270 25066 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:44429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:35395
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:35395
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.131.254
--webserver_port=40049
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25066
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:34:24.187556 25066 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:34:24.188728 25066 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:34:24.197767 25072 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:24.197937 25066 server_base.cc:1034] running on GCE node
W20260808 14:34:24.197767 25075 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:24.197836 25077 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:24.198837 25066 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:34:24.200021 25066 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:34:24.201224 25066 hybrid_clock.cc:648] HybridClock initialized: now 1786199664201204 us; error 31 us; skew 500 ppm
Aug 08 14:34:24 dist-test-slave-twwt krb5kdc[24299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199664, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:34:24.204334 25066 init.cc:377] Logged in from keytab as kudu/127.11.131.254@KRBTEST.COM (short username kudu)
I20260808 14:34:24.205366 25066 webserver.cc:460] Webserver started at http://127.11.131.254:40049/ using document root <none> and password file <none>
I20260808 14:34:24.205971 25066 fs_manager.cc:359] Metadata directory not provided
I20260808 14:34:24.206092 25066 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:34:24.210160 25066 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260808 14:34:24.212584 25090 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:24.213847 25066 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 14:34:24.213999 25066 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "5107e47c9f294523a5ea9b4010fb7e0d"
format_stamp: "Formatted at 2026-08-08 14:34:23 on dist-test-slave-twwt"
server_key: "58a90c074f03bc748bccd8483e2074a3"
server_key_iv: "02277c42c0545acd069447673ae67783"
server_key_version: "encryptionkey@0"
I20260808 14:34:24.214607 25066 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:34:24.235329 25066 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:34:24.238955 25066 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:34:24.239187 25066 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:34:24.247078 25066 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.254:35395
I20260808 14:34:24.247162 25162 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.254:35395 every 8 connection(s)
I20260808 14:34:24.248247 25066 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:34:24.252892 25163 sys_catalog.cc:263] Verifying existing consensus state
I20260808 14:34:24.253408 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 25066
I20260808 14:34:24.253882 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.193:46385
--local_ip_for_outbound_sockets=127.11.131.193
--tserver_master_addrs=127.11.131.254:35395
--webserver_port=39791
--webserver_interface=127.11.131.193
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab
--principal=kudu/127.11.131.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:44429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.11.131.193
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.193.keytab with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:34:24.254913 25163 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5107e47c9f294523a5ea9b4010fb7e0d: Bootstrap starting.
I20260808 14:34:24.279731 25163 log.cc:824] T 00000000000000000000000000000000 P 5107e47c9f294523a5ea9b4010fb7e0d: Log is configured to *not* fsync() on all Append() calls
I20260808 14:34:24.288589 25163 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5107e47c9f294523a5ea9b4010fb7e0d: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:34:24.289031 25163 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5107e47c9f294523a5ea9b4010fb7e0d: Bootstrap complete.
I20260808 14:34:24.295028 25163 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5107e47c9f294523a5ea9b4010fb7e0d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5107e47c9f294523a5ea9b4010fb7e0d" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 35395 } }
I20260808 14:34:24.295562 25163 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5107e47c9f294523a5ea9b4010fb7e0d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5107e47c9f294523a5ea9b4010fb7e0d, State: Initialized, Role: FOLLOWER
I20260808 14:34:24.296134 25163 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5107e47c9f294523a5ea9b4010fb7e0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5107e47c9f294523a5ea9b4010fb7e0d" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 35395 } }
I20260808 14:34:24.296288 25163 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5107e47c9f294523a5ea9b4010fb7e0d [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:34:24.296370 25163 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5107e47c9f294523a5ea9b4010fb7e0d [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:34:24.296470 25163 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5107e47c9f294523a5ea9b4010fb7e0d [term 1 FOLLOWER]: Advancing to term 2
I20260808 14:34:24.299083 25163 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5107e47c9f294523a5ea9b4010fb7e0d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5107e47c9f294523a5ea9b4010fb7e0d" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 35395 } }
I20260808 14:34:24.299501 25163 leader_election.cc:302] T 00000000000000000000000000000000 P 5107e47c9f294523a5ea9b4010fb7e0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5107e47c9f294523a5ea9b4010fb7e0d; no voters:
I20260808 14:34:24.299906 25163 leader_election.cc:288] T 00000000000000000000000000000000 P 5107e47c9f294523a5ea9b4010fb7e0d [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 14:34:24.300037 25170 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5107e47c9f294523a5ea9b4010fb7e0d [term 2 FOLLOWER]: Leader election won for term 2
I20260808 14:34:24.300405 25170 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5107e47c9f294523a5ea9b4010fb7e0d [term 2 LEADER]: Becoming Leader. State: Replica: 5107e47c9f294523a5ea9b4010fb7e0d, State: Running, Role: LEADER
I20260808 14:34:24.300770 25170 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5107e47c9f294523a5ea9b4010fb7e0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5107e47c9f294523a5ea9b4010fb7e0d" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 35395 } }
I20260808 14:34:24.301321 25163 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5107e47c9f294523a5ea9b4010fb7e0d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:34:24.302352 25174 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5107e47c9f294523a5ea9b4010fb7e0d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5107e47c9f294523a5ea9b4010fb7e0d. Latest consensus state: current_term: 2 leader_uuid: "5107e47c9f294523a5ea9b4010fb7e0d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5107e47c9f294523a5ea9b4010fb7e0d" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 35395 } } }
I20260808 14:34:24.302352 25173 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5107e47c9f294523a5ea9b4010fb7e0d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "5107e47c9f294523a5ea9b4010fb7e0d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5107e47c9f294523a5ea9b4010fb7e0d" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 35395 } } }
I20260808 14:34:24.302512 25174 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5107e47c9f294523a5ea9b4010fb7e0d [sys.catalog]: This master's current role is: LEADER
I20260808 14:34:24.302512 25173 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5107e47c9f294523a5ea9b4010fb7e0d [sys.catalog]: This master's current role is: LEADER
I20260808 14:34:24.303555 25181 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:34:24.306840 25181 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:34:24.307511 25181 catalog_manager.cc:1259] Loaded cluster ID: b811fe89d5054b46a792d40f51f48749
I20260808 14:34:24.307574 25181 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:34:24.309968 25181 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:34:24.310701 25181 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 5107e47c9f294523a5ea9b4010fb7e0d: Loaded TSK: 0
I20260808 14:34:24.311929 25181 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 14:34:24.388675 25167 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:34:24.388986 25167 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:34:24.389066 25167 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:34:24.393666 25167 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:34:24.393762 25167 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:34:24.393890 25167 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.193
I20260808 14:34:24.399319 25167 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:44429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.193.keytab
--principal=oryx/127.11.131.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.193:46385
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.131.193
--webserver_port=39791
--tserver_master_addrs=127.11.131.254:35395
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25167
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.193
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:34:24.400386 25167 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:34:24.401453 25167 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:34:24.412304 25206 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:24.412268 25204 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:24.412551 25208 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:24.412813 25167 server_base.cc:1034] running on GCE node
I20260808 14:34:24.413281 25167 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:34:24.413965 25167 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:34:24.415179 25167 hybrid_clock.cc:648] HybridClock initialized: now 1786199664415144 us; error 50 us; skew 500 ppm
Aug 08 14:34:24 dist-test-slave-twwt krb5kdc[24299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199664, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.131.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:34:24.418306 25167 init.cc:377] Logged in from keytab as oryx/127.11.131.193@KRBTEST.COM (short username oryx)
I20260808 14:34:24.419500 25167 webserver.cc:460] Webserver started at http://127.11.131.193:39791/ using document root <none> and password file <none>
I20260808 14:34:24.420102 25167 fs_manager.cc:359] Metadata directory not provided
I20260808 14:34:24.420219 25167 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:34:24.424396 25167 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 14:34:24.426719 25216 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:24.428064 25167 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 14:34:24.428207 25167 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-0/wal
uuid: "e498cb878c564931a5e1c4820f947b9a"
format_stamp: "Formatted at 2026-08-08 14:34:23 on dist-test-slave-twwt"
server_key: "2753506ab3ab6a343570588a700a889e"
server_key_iv: "23fd6b89d7a2539fefc58add436c0151"
server_key_version: "encryptionkey@0"
I20260808 14:34:24.428789 25167 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:34:24.440935 25167 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:34:24.444389 25167 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:34:24.444592 25167 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:34:24.445201 25167 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:34:24.446111 25167 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:34:24.446183 25167 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:24.446256 25167 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:34:24.446305 25167 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:24.455600 25167 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.193:46385
I20260808 14:34:24.455689 25393 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.193:46385 every 8 connection(s)
I20260808 14:34:24.456668 25167 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
I20260808 14:34:24.463119 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 25167
I20260808 14:34:24.463622 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.194:41145
--local_ip_for_outbound_sockets=127.11.131.194
--tserver_master_addrs=127.11.131.254:35395
--webserver_port=46397
--webserver_interface=127.11.131.194
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab
--principal=kudu/127.11.131.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:44429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.11.131.194
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.194.keytab with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 14:34:24 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.193@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:24 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.193@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 14:34:24.471836 25396 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:24.458869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:59297 (local address 127.11.131.254:35395)
0808 14:34:24.459474 (+ 605us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:24.459499 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:24.459974 (+ 475us) server_negotiation.cc:407] Connection header received
0808 14:34:24.461120 (+ 1146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:24.461132 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:24.461423 (+ 291us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:24.461763 (+ 340us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:24.463055 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:24.464225 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:24.465933 (+ 1708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:24.466775 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:24.466979 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:24.471117 (+ 4138us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.131.193:59297: BlockingRecv error: recv got EOF from 127.11.131.193:59297 (error 108)
Metrics: {"server-negotiator.queue_time_us":399,"thread_start_us":141,"threads_started":1}
I20260808 14:34:24.471992 25397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:24.458999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.193:59297)
0808 14:34:24.459799 (+ 800us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:24.459843 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:24.460701 (+ 858us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:24.461851 (+ 1150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:24.461859 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:24.462306 (+ 447us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:24.462847 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:24.462870 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:24.464380 (+ 1510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:24.464387 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:24.465785 (+ 1398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:24.465797 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:24.466957 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:24.466960 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:24.467110 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:24.467748 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:24.467775 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:24.470904 (+ 3129us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":574,"thread_start_us":150,"threads_started":1}
W20260808 14:34:24.472761 25394 heartbeater.cc:644] Failed to heartbeat to 127.11.131.254:35395 (0 consecutive failures): Not authorized: Failed to ping master at 127.11.131.254:35395: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Aug 08 14:34:24 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.193@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:24 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.193@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:34:24.478470 25397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:24.473261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.193:48711)
0808 14:34:24.473373 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:24.473389 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:24.473477 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:24.473739 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:24.473742 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:24.473909 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:24.474016 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:24.474021 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:24.474826 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:24.474832 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:24.475395 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:24.475404 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:24.475874 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:24.475878 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:24.475973 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:24.476488 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:24.476501 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:24.478342 (+ 1841us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":31}
W20260808 14:34:24.478757 25396 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:24.473375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:48711 (local address 127.11.131.254:35395)
0808 14:34:24.473521 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:24.473528 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:24.473543 (+ 15us) server_negotiation.cc:407] Connection header received
0808 14:34:24.473590 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:24.473592 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:24.473633 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:24.473723 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:24.474133 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:24.474717 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:24.475523 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:24.475757 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:24.475878 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:24.478477 (+ 2599us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.131.193:48711: BlockingRecv error: recv got EOF from 127.11.131.193:48711 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 08 14:34:24 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.193@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:24 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.193@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:34:24.484328 25397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:24.479122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.193:59287)
0808 14:34:24.479275 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:24.479289 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:24.479359 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:24.479654 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:24.479657 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:24.479825 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:24.479916 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:24.479921 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:24.480590 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:24.480593 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:24.481458 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:24.481467 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:24.481866 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:24.481869 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:24.481952 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:24.482398 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:24.482411 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:24.484239 (+ 1828us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":92}
W20260808 14:34:24.484578 25394 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 14:34:24.484792 25396 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:24.479211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:59287 (local address 127.11.131.254:35395)
0808 14:34:24.479321 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:24.479324 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:24.479336 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:34:24.479486 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:24.479493 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:24.479550 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:24.479613 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:24.480021 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:24.480490 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:24.481567 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:24.481764 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:24.481837 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:24.484392 (+ 2555us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.131.193:59287: BlockingRecv error: recv got EOF from 127.11.131.193:59287 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
W20260808 14:34:24.587092 25400 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:34:24.587365 25400 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:34:24.587412 25400 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:34:24.591794 25400 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:34:24.591846 25400 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:34:24.591908 25400 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.194
I20260808 14:34:24.597352 25400 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:44429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.194.keytab
--principal=oryx/127.11.131.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.194:41145
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.131.194
--webserver_port=46397
--tserver_master_addrs=127.11.131.254:35395
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25400
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.194
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:34:24.598327 25400 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:34:24.599305 25400 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:34:24.609126 25407 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:24.609131 25408 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:24.609122 25412 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:24.609478 25400 server_base.cc:1034] running on GCE node
I20260808 14:34:24.609967 25400 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:34:24.610707 25400 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:34:24.611924 25400 hybrid_clock.cc:648] HybridClock initialized: now 1786199664611888 us; error 26 us; skew 500 ppm
Aug 08 14:34:24 dist-test-slave-twwt krb5kdc[24299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199664, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.131.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:34:24.615013 25400 init.cc:377] Logged in from keytab as oryx/127.11.131.194@KRBTEST.COM (short username oryx)
I20260808 14:34:24.615935 25400 webserver.cc:460] Webserver started at http://127.11.131.194:46397/ using document root <none> and password file <none>
I20260808 14:34:24.616532 25400 fs_manager.cc:359] Metadata directory not provided
I20260808 14:34:24.616652 25400 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:34:24.621089 25400 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 14:34:24.623487 25420 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:24.624882 25400 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 14:34:24.625036 25400 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-1/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-1/wal
uuid: "1cc1c589ed6e44dc89d26c3f36c34ef1"
format_stamp: "Formatted at 2026-08-08 14:34:23 on dist-test-slave-twwt"
server_key: "e755c4facdacfd7e0b6f8295998efead"
server_key_iv: "00b2c4d3640ab95d40c18ebc1c8e544e"
server_key_version: "encryptionkey@0"
I20260808 14:34:24.625672 25400 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:34:24.637715 25400 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:34:24.641193 25400 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:34:24.641408 25400 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:34:24.642154 25400 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:34:24.643241 25400 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:34:24.643323 25400 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:24.643402 25400 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:34:24.643443 25400 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:24.653127 25400 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.194:41145
I20260808 14:34:24.653159 25597 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.194:41145 every 8 connection(s)
I20260808 14:34:24.654135 25400 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
I20260808 14:34:24.662385 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 25400
I20260808 14:34:24.663003 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.195:45213
--local_ip_for_outbound_sockets=127.11.131.195
--tserver_master_addrs=127.11.131.254:35395
--webserver_port=35725
--webserver_interface=127.11.131.195
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab
--principal=kudu/127.11.131.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:44429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.11.131.195
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.195.keytab with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 14:34:24 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.194@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:24 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.194@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 14:34:24.665601 25396 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:24.655967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:38029 (local address 127.11.131.254:35395)
0808 14:34:24.656144 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:24.656149 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:24.657183 (+ 1034us) server_negotiation.cc:407] Connection header received
0808 14:34:24.658036 (+ 853us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:24.658039 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:24.658092 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:24.658170 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:24.659405 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:24.659962 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:24.661041 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:24.661254 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:24.661336 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:24.665443 (+ 4107us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.131.194:38029: BlockingRecv error: recv got EOF from 127.11.131.194:38029 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 14:34:24.666065 25601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:24.656375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.194:38029)
0808 14:34:24.657033 (+ 658us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:24.657075 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:24.657828 (+ 753us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:24.658343 (+ 515us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:24.658350 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:24.658771 (+ 421us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:24.659267 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:24.659282 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:24.660077 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:24.660080 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:24.660932 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:24.660942 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:24.661388 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:24.661391 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:24.661525 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:24.662177 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:24.662201 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:24.665243 (+ 3042us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":107,"threads_started":1}
W20260808 14:34:24.666712 25599 heartbeater.cc:644] Failed to heartbeat to 127.11.131.254:35395 (0 consecutive failures): Not authorized: Failed to ping master at 127.11.131.254:35395: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Aug 08 14:34:24 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.194@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:24 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.194@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:34:24.672341 25601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:24.667159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.194:36809)
0808 14:34:24.667275 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:24.667292 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:24.667366 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:24.667633 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:24.667636 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:24.667791 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:24.667909 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:24.667914 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:24.668640 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:24.668645 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:24.669187 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:24.669194 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:24.669661 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:24.669664 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:24.669760 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:24.670243 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:24.670255 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:24.672154 (+ 1899us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":48}
W20260808 14:34:24.672370 25396 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:24.667290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:36809 (local address 127.11.131.254:35395)
0808 14:34:24.667430 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:24.667437 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:24.667449 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:34:24.667493 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:24.667495 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:24.667529 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:24.667615 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:24.668027 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:24.668527 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:24.669310 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:24.669541 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:24.669648 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:24.672270 (+ 2622us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.131.194:36809: BlockingRecv error: recv got EOF from 127.11.131.194:36809 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 08 14:34:24 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.194@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:24 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.194@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:34:24.677807 25601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:24.672966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.194:58793)
0808 14:34:24.673083 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:24.673098 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:24.673196 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:24.673431 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:24.673434 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:24.673584 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:24.673650 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:24.673655 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:24.674368 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:24.674371 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:24.674931 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:24.674940 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:24.675401 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:24.675405 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:24.675487 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:24.675935 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:24.675947 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:24.677676 (+ 1729us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":49}
W20260808 14:34:24.677898 25396 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:24.673094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:58793 (local address 127.11.131.254:35395)
0808 14:34:24.673226 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:24.673232 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:24.673247 (+ 15us) server_negotiation.cc:407] Connection header received
0808 14:34:24.673289 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:24.673291 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:24.673323 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:24.673417 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:24.673764 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:24.674247 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:24.675067 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:24.675269 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:24.675378 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:24.677785 (+ 2407us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.131.194:58793: BlockingRecv error: recv got EOF from 127.11.131.194:58793 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
W20260808 14:34:24.678169 25599 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 14:34:24.783542 25602 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:34:24.783798 25602 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:34:24.783842 25602 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:34:24.787765 25602 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:34:24.787822 25602 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:34:24.787883 25602 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.195
I20260808 14:34:24.793109 25602 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:44429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/krb5kdc/oryx_127.11.131.195.keytab
--principal=oryx/127.11.131.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.195:45213
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.131.195
--webserver_port=35725
--tserver_master_addrs=127.11.131.254:35395
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25602
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.195
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:34:24.794126 25602 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:34:24.795221 25602 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:34:24.805469 25608 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:24.805478 25614 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:24.805511 25609 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:24.805961 25602 server_base.cc:1034] running on GCE node
I20260808 14:34:24.806429 25602 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:34:24.807155 25602 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:34:24.808363 25602 hybrid_clock.cc:648] HybridClock initialized: now 1786199664808345 us; error 34 us; skew 500 ppm
Aug 08 14:34:24 dist-test-slave-twwt krb5kdc[24299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199664, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.131.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:34:24.811292 25602 init.cc:377] Logged in from keytab as oryx/127.11.131.195@KRBTEST.COM (short username oryx)
I20260808 14:34:24.812156 25602 webserver.cc:460] Webserver started at http://127.11.131.195:35725/ using document root <none> and password file <none>
I20260808 14:34:24.812755 25602 fs_manager.cc:359] Metadata directory not provided
I20260808 14:34:24.812870 25602 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:34:24.816766 25602 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 14:34:24.818948 25629 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:24.820164 25602 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 14:34:24.820303 25602 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-2/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-2/wal
uuid: "891196ec3a044df09cd9bcf0d87d74ca"
format_stamp: "Formatted at 2026-08-08 14:34:23 on dist-test-slave-twwt"
server_key: "a373c8217859aace330391e89d47da32"
server_key_iv: "d1b32115a3644165c6983eccf66129c3"
server_key_version: "encryptionkey@0"
I20260808 14:34:24.820878 25602 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:34:24.838996 25602 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:34:24.842651 25602 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:34:24.842871 25602 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:34:24.843532 25602 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:34:24.844486 25602 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:34:24.844573 25602 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:24.844672 25602 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:34:24.844724 25602 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:24.854235 25602 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.195:45213
I20260808 14:34:24.854266 25822 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.195:45213 every 8 connection(s)
I20260808 14:34:24.855341 25602 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
I20260808 14:34:24.861697 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 25602
Aug 08 14:34:24 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.195@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:24 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.195@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 14:34:24.872705 25396 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:24.857282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:35275 (local address 127.11.131.254:35395)
0808 14:34:24.857433 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:24.857438 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:24.858431 (+ 993us) server_negotiation.cc:407] Connection header received
0808 14:34:24.859369 (+ 938us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:24.859371 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:24.859419 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:24.859495 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:24.860698 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:24.861230 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:24.862510 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:24.862913 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:24.863020 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:24.872560 (+ 9540us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.131.195:35275: BlockingRecv error: recv got EOF from 127.11.131.195:35275 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 14:34:24.873423 25825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:24.857614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.195:35275)
0808 14:34:24.858279 (+ 665us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:24.858337 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:24.859171 (+ 834us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:24.859673 (+ 502us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:24.859680 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:24.860042 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:24.860555 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:24.860568 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:24.861353 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:24.861355 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:24.862372 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:24.862383 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:24.863185 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:24.863188 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:24.863422 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:24.869326 (+ 5904us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:24.869354 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:24.872449 (+ 3095us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":110,"threads_started":1}
W20260808 14:34:24.874066 25823 heartbeater.cc:644] Failed to heartbeat to 127.11.131.254:35395 (0 consecutive failures): Not authorized: Failed to ping master at 127.11.131.254:35395: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
I20260808 14:34:24.874979 25830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:24.862823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38194 (local address 127.11.131.254:35395)
0808 14:34:24.863064 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:24.863068 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:24.863087 (+ 19us) server_negotiation.cc:407] Connection header received
0808 14:34:24.863124 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:24.863127 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:24.863162 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:24.863235 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:24.864191 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:24.864728 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:24.865553 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:24.865763 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:24.865838 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:24.870388 (+ 4550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:24.870394 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:24.870412 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:24.870443 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:24.872394 (+ 1951us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:24.873028 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:24.873034 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:24.873039 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:24.873167 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:24.873469 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:24.873473 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:24.873475 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:24.873977 (+ 502us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:24.874180 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:24.874483 (+ 303us) server_negotiation.cc:299] Negotiation successful
0808 14:34:24.874765 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171,"thread_start_us":105,"threads_started":1}
Aug 08 14:34:24 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.195@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:24 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.195@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:34:24.879912 25825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:24.874586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.195:40717)
0808 14:34:24.874779 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:24.874795 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:24.874884 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:24.875240 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:24.875243 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:24.875380 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:24.875476 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:24.875481 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:24.876227 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:24.876231 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:24.876829 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:24.876839 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:24.877401 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:24.877404 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:24.877481 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:24.877958 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:24.877970 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:24.879818 (+ 1848us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":113}
W20260808 14:34:24.880116 25396 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:24.874688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:40717 (local address 127.11.131.254:35395)
0808 14:34:24.874804 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:24.874808 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:24.874840 (+ 32us) server_negotiation.cc:407] Connection header received
0808 14:34:24.874985 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:24.874991 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:24.875044 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:24.875127 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:24.875594 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:24.876110 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:24.876957 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:24.877268 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:24.877381 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:24.879982 (+ 2601us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.131.195:40717: BlockingRecv error: recv got EOF from 127.11.131.195:40717 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 08 14:34:24 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.195@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:24 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.195@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:34:24.885453 25825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:24.880551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.195:52189)
0808 14:34:24.880650 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:24.880685 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:24.880768 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:24.880994 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:24.880998 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:24.881146 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:24.881218 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:24.881222 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:24.881944 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:24.881947 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:24.882456 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:24.882464 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:24.882990 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:24.882994 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:24.883082 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:24.883507 (+ 425us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:24.883519 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:24.885302 (+ 1783us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":30}
W20260808 14:34:24.885535 25396 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:24.880610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:52189 (local address 127.11.131.254:35395)
0808 14:34:24.880774 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:24.880778 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:24.880812 (+ 34us) server_negotiation.cc:407] Connection header received
0808 14:34:24.880849 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:24.880852 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:24.880888 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:24.880979 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:24.881343 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:24.881835 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:24.882578 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:24.882873 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:24.882987 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:24.885422 (+ 2435us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.131.195:52189: BlockingRecv error: recv got EOF from 127.11.131.195:52189 (error 108)
Metrics: {"server-negotiator.queue_time_us":95}
W20260808 14:34:24.885712 25823 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 08 14:34:25 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.193@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:25 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.193@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:34:25.490968 25831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:25.485214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.193:45715)
0808 14:34:25.485515 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:25.485529 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:25.485620 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:25.485892 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:25.485895 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:25.486079 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:25.486205 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:25.486211 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:25.487039 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:25.487042 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:25.487644 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:25.487654 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:25.488128 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:25.488131 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:25.488210 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:25.488756 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:25.488775 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:25.490840 (+ 2065us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":106,"threads_started":1}
W20260808 14:34:25.491230 25834 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:25.485320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:45715 (local address 127.11.131.254:35395)
0808 14:34:25.485593 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:25.485597 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:25.485609 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:34:25.485704 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:25.485706 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:25.485753 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:25.485853 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:25.486349 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:25.486928 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:25.487759 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:25.487994 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:25.488078 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:25.491053 (+ 2975us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.131.193:45715: BlockingRecv error: recv got EOF from 127.11.131.193:45715 (error 108)
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":117,"threads_started":1}
Aug 08 14:34:25 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.194@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:25 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.194@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:34:25.684785 25835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:25.678985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.194:47713)
0808 14:34:25.679311 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:25.679326 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:25.679433 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:25.679681 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:25.679683 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:25.679888 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:25.680015 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:25.680021 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:25.680788 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:25.680791 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:25.681524 (+ 733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:25.681540 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:25.682063 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:25.682066 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:25.682179 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:25.682759 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:25.682771 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:25.684659 (+ 1888us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":137,"threads_started":1}
W20260808 14:34:25.685070 25834 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:25.679099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:47713 (local address 127.11.131.254:35395)
0808 14:34:25.679255 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:25.679259 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:25.679458 (+ 199us) server_negotiation.cc:407] Connection header received
0808 14:34:25.679511 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:25.679513 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:25.679563 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:25.679642 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:25.680126 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:25.680664 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:25.681654 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:25.681915 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:25.682025 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:25.684807 (+ 2782us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.131.194:47713: BlockingRecv error: recv got EOF from 127.11.131.194:47713 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 08 14:34:25 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.195@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:25 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.195@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:34:25.892781 25836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:25.886462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.195:54749)
0808 14:34:25.886858 (+ 396us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:25.886873 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:25.886989 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:25.887369 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:25.887372 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:25.887569 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:25.887672 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:25.887678 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:25.888487 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:25.888491 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:25.889156 (+ 665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:25.889167 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:25.889654 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:25.889657 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:25.889731 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:25.890283 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:25.890295 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:25.892576 (+ 2281us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":128,"threads_started":1}
W20260808 14:34:25.892860 25834 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:25.886575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:54749 (local address 127.11.131.254:35395)
0808 14:34:25.886829 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:25.886833 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:25.886954 (+ 121us) server_negotiation.cc:407] Connection header received
0808 14:34:25.887119 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:25.887122 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:25.887186 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:25.887264 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:25.887796 (+ 532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:25.888341 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:25.889303 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:25.889534 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:25.889623 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:25.892747 (+ 3124us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.131.195:54749: BlockingRecv error: recv got EOF from 127.11.131.195:54749 (error 108)
Metrics: {"server-negotiator.queue_time_us":104}
Aug 08 14:34:26 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.193@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:26 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.193@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:34:26.498028 25837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:26.492113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.193:39393)
0808 14:34:26.492435 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:26.492450 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:26.492547 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:26.492817 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:26.492820 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:26.493010 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:26.493111 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:26.493116 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:26.493855 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:26.493857 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:26.494415 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:26.494422 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:26.494934 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:26.494937 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:26.495003 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:26.495517 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:26.495528 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:26.497840 (+ 2312us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":79,"threads_started":1}
W20260808 14:34:26.498061 25840 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:26.492174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:39393 (local address 127.11.131.254:35395)
0808 14:34:26.492487 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:26.492491 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:26.492506 (+ 15us) server_negotiation.cc:407] Connection header received
0808 14:34:26.492638 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:26.492640 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:26.492695 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:26.492783 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:26.493213 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:26.493760 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:26.494515 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:26.494821 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:26.494905 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:26.497942 (+ 3037us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.131.193:39393: BlockingRecv error: recv got EOF from 127.11.131.193:39393 (error 108)
Metrics: {"server-negotiator.queue_time_us":230,"thread_start_us":121,"threads_started":1}
Aug 08 14:34:26 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.194@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:26 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.194@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:34:26.691303 25842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:26.685698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.194:50731)
0808 14:34:26.686039 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:26.686053 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:26.686164 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:26.686397 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:26.686400 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:26.686629 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:26.686742 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:26.686747 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:26.687472 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:26.687474 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:26.688051 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:26.688060 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:26.688497 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:26.688501 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:26.688576 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:26.689182 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:26.689195 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:26.691165 (+ 1970us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":132,"threads_started":1}
W20260808 14:34:26.691481 25840 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:26.685830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:50731 (local address 127.11.131.254:35395)
0808 14:34:26.685999 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:26.686003 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:26.686129 (+ 126us) server_negotiation.cc:407] Connection header received
0808 14:34:26.686233 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:26.686235 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:26.686280 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:26.686351 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:26.686842 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:26.687371 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:26.688162 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:26.688379 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:26.688455 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:26.691318 (+ 2863us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.131.194:50731: BlockingRecv error: recv got EOF from 127.11.131.194:50731 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 08 14:34:26 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.195@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:26 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.195@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:34:26.899837 25843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:26.893852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.195:60897)
0808 14:34:26.894260 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:26.894276 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:26.894450 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:26.894825 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:26.894827 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:26.895016 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:26.895118 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:26.895124 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:26.896013 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:26.896016 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:26.896588 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:26.896597 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:26.897049 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:26.897052 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:26.897118 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:26.897629 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:26.897640 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:26.899687 (+ 2047us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":129,"threads_started":1}
W20260808 14:34:26.900012 25840 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:26.894091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:60897 (local address 127.11.131.254:35395)
0808 14:34:26.894234 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:26.894239 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:26.894370 (+ 131us) server_negotiation.cc:407] Connection header received
0808 14:34:26.894584 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:26.894591 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:26.894701 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:26.894804 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:26.895212 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:26.895907 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:26.896697 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:26.896931 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:26.897019 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:26.899840 (+ 2821us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.131.195:60897: BlockingRecv error: recv got EOF from 127.11.131.195:60897 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 08 14:34:27 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.193@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:27 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.193@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:34:27.504906 25844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:27.499081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.193:57949)
0808 14:34:27.499402 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:27.499416 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:27.499522 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:27.499772 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:27.499774 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:27.499969 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:27.500070 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:27.500076 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:27.500805 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:27.500807 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:27.501378 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:27.501386 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:27.501940 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:27.501943 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:27.502018 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:27.502729 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:27.502751 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:27.504715 (+ 1964us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":93,"threads_started":1}
W20260808 14:34:27.504995 25845 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:27.499134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:57949 (local address 127.11.131.254:35395)
0808 14:34:27.499396 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:27.499400 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:27.499496 (+ 96us) server_negotiation.cc:407] Connection header received
0808 14:34:27.499606 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:27.499608 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:27.499654 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:27.499734 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:27.500174 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:27.500708 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:27.501476 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:27.501823 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:27.501912 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:27.504849 (+ 2937us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.131.193:57949: BlockingRecv error: recv got EOF from 127.11.131.193:57949 (error 108)
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":67,"threads_started":1}
Aug 08 14:34:27 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.194@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:27 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.194@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:34:27.698028 25848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:27.692243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.194:59329)
0808 14:34:27.692555 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:27.692569 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:27.692677 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:27.692928 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:27.692930 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:27.693118 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:27.693220 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:27.693225 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:27.693974 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:27.693977 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:27.694556 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:27.694564 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:27.695193 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:27.695196 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:27.695279 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:27.695972 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:27.695984 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:27.697839 (+ 1855us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":115,"threads_started":1}
W20260808 14:34:27.698089 25845 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:27.692338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:59329 (local address 127.11.131.254:35395)
0808 14:34:27.692514 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:27.692518 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:27.692628 (+ 110us) server_negotiation.cc:407] Connection header received
0808 14:34:27.692761 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:27.692764 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:27.692807 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:27.692891 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:27.693328 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:27.693867 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:27.694747 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:27.695055 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:27.695164 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:27.697976 (+ 2812us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.131.194:59329: BlockingRecv error: recv got EOF from 127.11.131.194:59329 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Aug 08 14:34:27 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.195@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:27 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.195@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:34:27.907080 25850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:27.900817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.195:38577)
0808 14:34:27.901162 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:27.901178 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:27.901309 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:27.901632 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:27.901635 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:27.901935 (+ 300us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:27.902050 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:27.902057 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:27.902994 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:27.902998 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:27.903667 (+ 669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:27.903682 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:27.904278 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:27.904281 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:27.904354 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:27.904949 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:27.904962 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:27.906954 (+ 1992us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":146,"threads_started":1}
W20260808 14:34:27.907313 25845 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:27.900872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:38577 (local address 127.11.131.254:35395)
0808 14:34:27.901022 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:27.901026 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:27.901293 (+ 267us) server_negotiation.cc:407] Connection header received
0808 14:34:27.901396 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:27.901399 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:27.901454 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:27.901538 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:27.902213 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:27.902870 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:27.903811 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:27.904124 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:27.904243 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:27.907096 (+ 2853us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.131.195:38577: BlockingRecv error: recv got EOF from 127.11.131.195:38577 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 08 14:34:28 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.193@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:28 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.193@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:34:28.515062 25851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:28.505784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.193:50817)
0808 14:34:28.506084 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:28.506107 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:28.506204 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:28.506478 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:28.506480 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:28.506695 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:28.506801 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:28.506806 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:28.507604 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:28.507606 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:28.508169 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:28.508177 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:28.508662 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:28.508664 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:28.508725 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:28.512621 (+ 3896us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:28.512634 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:28.514880 (+ 2246us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":99,"threads_started":1}
W20260808 14:34:28.515167 25852 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:28.505852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:50817 (local address 127.11.131.254:35395)
0808 14:34:28.506134 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:28.506138 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:28.506156 (+ 18us) server_negotiation.cc:407] Connection header received
0808 14:34:28.506296 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:28.506298 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:28.506346 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:28.506435 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:28.506943 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:28.507502 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:28.508299 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:28.508536 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:28.508643 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:28.515023 (+ 6380us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.131.193:50817: BlockingRecv error: recv got EOF from 127.11.131.193:50817 (error 108)
Metrics: {"server-negotiator.queue_time_us":204,"thread_start_us":108,"threads_started":1}
Aug 08 14:34:28 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.194@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:28 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.194@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:34:28.704753 25853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:28.698935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.194:47379)
0808 14:34:28.699212 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:28.699228 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:28.699339 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:28.699581 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:28.699583 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:28.699765 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:28.699866 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:28.699872 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:28.700606 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:28.700608 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:28.701155 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:28.701162 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:28.701625 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:28.701628 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:28.701739 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:28.702334 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:28.702346 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:28.704578 (+ 2232us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":100,"threads_started":1}
W20260808 14:34:28.704818 25852 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:28.698985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:47379 (local address 127.11.131.254:35395)
0808 14:34:28.699146 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:28.699150 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:28.699317 (+ 167us) server_negotiation.cc:407] Connection header received
0808 14:34:28.699438 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:28.699440 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:28.699487 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:28.699570 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:28.699965 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:28.700506 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:28.701264 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:28.701511 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:28.701601 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:28.704705 (+ 3104us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.131.194:47379: BlockingRecv error: recv got EOF from 127.11.131.194:47379 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 08 14:34:28 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.195@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:28 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.195@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:34:28.913671 25854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:28.907910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.195:54655)
0808 14:34:28.908225 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:28.908239 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:28.908371 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:28.908656 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:28.908659 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:28.908886 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:28.908991 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:28.908997 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:28.909788 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:28.909793 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:28.910352 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:28.910361 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:28.910907 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:28.910912 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:28.911004 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:28.911509 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:28.911527 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:28.913551 (+ 2024us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":115,"threads_started":1}
W20260808 14:34:28.913790 25852 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:28.907962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:54655 (local address 127.11.131.254:35395)
0808 14:34:28.908132 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:28.908137 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:28.908316 (+ 179us) server_negotiation.cc:407] Connection header received
0808 14:34:28.908479 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:28.908483 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:28.908543 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:28.908626 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:28.909117 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:28.909670 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:28.910475 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:28.910782 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:28.910895 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:28.913692 (+ 2797us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.131.195:54655: BlockingRecv error: recv got EOF from 127.11.131.195:54655 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 08 14:34:29 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.193@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:29 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.193@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:34:29.521706 25855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:29.516126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.193:49637)
0808 14:34:29.516429 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:29.516444 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:29.516531 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:29.516777 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:29.516780 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:29.516971 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:29.517069 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:29.517074 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:29.517983 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:29.517986 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:29.518565 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:29.518574 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:29.519072 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:29.519079 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:29.519152 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:29.519707 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:29.519719 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:29.521582 (+ 1863us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":96,"threads_started":1}
W20260808 14:34:29.521883 25856 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:29.516197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:49637 (local address 127.11.131.254:35395)
0808 14:34:29.516487 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:29.516491 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:29.516504 (+ 13us) server_negotiation.cc:407] Connection header received
0808 14:34:29.516618 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:29.516621 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:29.516665 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:29.516746 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:29.517170 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:29.517728 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:29.518692 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:29.518938 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:29.519048 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:29.521737 (+ 2689us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.131.193:49637: BlockingRecv error: recv got EOF from 127.11.131.193:49637 (error 108)
Metrics: {"server-negotiator.queue_time_us":219,"thread_start_us":116,"threads_started":1}
Aug 08 14:34:29 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.194@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:29 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.194@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:34:29.711270 25857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:29.705591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.194:56379)
0808 14:34:29.706013 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:29.706028 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:29.706121 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:29.706375 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:29.706377 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:29.706570 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:29.706702 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:29.706707 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:29.707440 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:29.707442 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:29.708018 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:29.708026 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:29.708491 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:29.708493 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:29.708553 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:29.709082 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:29.709094 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:29.711117 (+ 2023us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":96,"threads_started":1}
W20260808 14:34:29.711587 25856 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:29.705881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:56379 (local address 127.11.131.254:35395)
0808 14:34:29.706062 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:29.706066 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:29.706091 (+ 25us) server_negotiation.cc:407] Connection header received
0808 14:34:29.706207 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:29.706210 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:29.706257 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:29.706336 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:29.706824 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:29.707343 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:29.708155 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:29.708386 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:29.708472 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:29.711327 (+ 2855us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.131.194:56379: BlockingRecv error: recv got EOF from 127.11.131.194:56379 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
Aug 08 14:34:29 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.195@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:29 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.195@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:34:29.919937 25858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:29.914572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.195:52751)
0808 14:34:29.914895 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:29.914908 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:29.915007 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:29.915237 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:29.915240 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:29.915429 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:29.915527 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:29.915533 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:29.916264 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:29.916266 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:29.916820 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:29.916828 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:29.917229 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:29.917232 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:29.917297 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:29.917770 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:29.917781 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:29.919773 (+ 1992us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":100,"threads_started":1}
W20260808 14:34:29.920080 25856 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:29.914697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:52751 (local address 127.11.131.254:35395)
0808 14:34:29.914859 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:29.914863 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:29.914972 (+ 109us) server_negotiation.cc:407] Connection header received
0808 14:34:29.915083 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:29.915086 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:29.915133 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:29.915204 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:29.915621 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:29.916169 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:29.916923 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:29.917133 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:29.917207 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:29.919928 (+ 2721us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.131.195:52751: BlockingRecv error: recv got EOF from 127.11.131.195:52751 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 08 14:34:30 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.193@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:30 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.193@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:34:30.528514 25860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:30.522697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.193:44269)
0808 14:34:30.523011 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:30.523026 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:30.523170 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:30.523450 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:30.523453 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:30.523659 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:30.523763 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:30.523768 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:30.524626 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:30.524629 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:30.525248 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:30.525258 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:30.525758 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:30.525761 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:30.525850 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:30.526402 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:30.526414 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:30.528333 (+ 1919us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":77,"threads_started":1}
W20260808 14:34:30.528591 25861 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:30.522800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:44269 (local address 127.11.131.254:35395)
0808 14:34:30.523093 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:30.523097 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:30.523113 (+ 16us) server_negotiation.cc:407] Connection header received
0808 14:34:30.523270 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:30.523273 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:30.523319 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:30.523434 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:30.523882 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:30.524464 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:30.525394 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:30.525637 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:30.525748 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:30.528466 (+ 2718us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.131.193:44269: BlockingRecv error: recv got EOF from 127.11.131.193:44269 (error 108)
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":85,"threads_started":1}
Aug 08 14:34:30 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.194@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:30 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.194@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:34:30.718142 25862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:30.712168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.194:45957)
0808 14:34:30.712469 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:30.712485 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:30.712602 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:30.712880 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:30.712882 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:30.713077 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:30.713181 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:30.713186 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:30.713934 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:30.713937 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:30.714507 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:30.714515 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:30.715124 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:30.715129 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:30.715249 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:30.715957 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:30.715974 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:30.718020 (+ 2046us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":88,"threads_started":1}
W20260808 14:34:30.718321 25861 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:30.712275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:45957 (local address 127.11.131.254:35395)
0808 14:34:30.712432 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:30.712436 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:30.712563 (+ 127us) server_negotiation.cc:407] Connection header received
0808 14:34:30.712703 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:30.712706 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:30.712753 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:30.712833 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:30.713281 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:30.713823 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:30.714658 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:30.714971 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:30.715084 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:30.718148 (+ 3064us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.131.194:45957: BlockingRecv error: recv got EOF from 127.11.131.194:45957 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 08 14:34:30 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.195@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:30 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.195@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:34:30.926579 25863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:30.920816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.195:45401)
0808 14:34:30.921186 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:30.921199 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:30.921309 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:30.921547 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:30.921549 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:30.921739 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:30.921840 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:30.921846 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:30.922588 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:30.922590 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:30.923169 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:30.923178 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:30.923654 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:30.923658 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:30.923726 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:30.924335 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:30.924346 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:30.926395 (+ 2049us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":97,"threads_started":1}
W20260808 14:34:30.926662 25861 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:30.920885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:45401 (local address 127.11.131.254:35395)
0808 14:34:30.921042 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:30.921048 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:30.921325 (+ 277us) server_negotiation.cc:407] Connection header received
0808 14:34:30.921376 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:30.921378 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:30.921429 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:30.921509 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:30.921949 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:30.922492 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:30.923292 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:30.923513 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:30.923613 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:30.926523 (+ 2910us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.131.195:45401: BlockingRecv error: recv got EOF from 127.11.131.195:45401 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 08 14:34:31 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.193@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:31 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.193@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:34:31.535175 25864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:31.529262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.193:51913)
0808 14:34:31.529672 (+ 410us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:31.529688 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:31.529834 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:31.530119 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:31.530123 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:31.530349 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:31.530523 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:31.530535 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:31.531333 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:31.531339 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:31.531911 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:31.531919 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:31.532406 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:31.532410 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:31.532502 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:31.533076 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:31.533088 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:31.535049 (+ 1961us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":95,"threads_started":1}
W20260808 14:34:31.535357 25865 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:31.529396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:51913 (local address 127.11.131.254:35395)
0808 14:34:31.529665 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:31.529669 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:31.529768 (+ 99us) server_negotiation.cc:407] Connection header received
0808 14:34:31.529940 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:31.529944 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:31.529999 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:31.530093 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:31.530666 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:31.531219 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:31.532031 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:31.532267 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:31.532397 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:31.535186 (+ 2789us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.131.193:51913: BlockingRecv error: recv got EOF from 127.11.131.193:51913 (error 108)
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":66,"threads_started":1}
Aug 08 14:34:31 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.194@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:31 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.194@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:34:31.724645 25866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:31.718928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.194:55471)
0808 14:34:31.719305 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:31.719319 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:31.719454 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:31.719735 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:31.719739 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:31.719963 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:31.720060 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:31.720066 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:31.720848 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:31.720852 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:31.721416 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:31.721424 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:31.721898 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:31.721901 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:31.721989 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:31.722551 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:31.722563 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:31.724488 (+ 1925us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":106,"threads_started":1}
W20260808 14:34:31.724908 25865 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:31.718943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:55471 (local address 127.11.131.254:35395)
0808 14:34:31.719110 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:31.719114 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:31.719399 (+ 285us) server_negotiation.cc:407] Connection header received
0808 14:34:31.719566 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:31.719569 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:31.719624 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:31.719707 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:31.720178 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:31.720713 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:31.721537 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:31.721776 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:31.721890 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:31.724648 (+ 2758us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.131.194:55471: BlockingRecv error: recv got EOF from 127.11.131.194:55471 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 08 14:34:31 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.195@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:31 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.195@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:34:31.933493 25869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:31.927524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.195:37599)
0808 14:34:31.927880 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:31.927894 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:31.928029 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:31.928313 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:31.928316 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:31.928549 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:31.928649 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:31.928654 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:31.929511 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:31.929517 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:31.930085 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:31.930093 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:31.930678 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:31.930681 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:31.930769 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:31.931262 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:31.931272 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:31.933297 (+ 2025us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":92,"threads_started":1}
W20260808 14:34:31.933586 25865 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:31.927584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:37599 (local address 127.11.131.254:35395)
0808 14:34:31.927731 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:31.927737 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:31.927968 (+ 231us) server_negotiation.cc:407] Connection header received
0808 14:34:31.928140 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:31.928143 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:31.928200 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:31.928282 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:31.928770 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:31.929400 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:31.930210 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:31.930519 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:31.930652 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:31.933438 (+ 2786us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.131.195:37599: BlockingRecv error: recv got EOF from 127.11.131.195:37599 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 08 14:34:32 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.193@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:32 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.193@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:34:32.541667 25870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:32.535968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.193:50805)
0808 14:34:32.536261 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:32.536276 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:32.536380 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:32.536609 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:32.536611 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:32.536797 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:32.536922 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:32.536927 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:32.537683 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:32.537687 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:32.538273 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:32.538283 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:32.538751 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:32.538754 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:32.538839 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:32.539403 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:32.539416 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:32.541500 (+ 2084us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":105,"threads_started":1}
W20260808 14:34:32.541801 25872 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:32.536130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:50805 (local address 127.11.131.254:35395)
0808 14:34:32.536381 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:32.536385 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:32.536398 (+ 13us) server_negotiation.cc:407] Connection header received
0808 14:34:32.536443 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:32.536446 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:32.536490 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:32.536573 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:32.537036 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:32.537579 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:32.538389 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:32.538636 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:32.538712 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:32.541659 (+ 2947us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.131.193:50805: BlockingRecv error: recv got EOF from 127.11.131.193:50805 (error 108)
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":88,"threads_started":1}
Aug 08 14:34:32 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.194@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:32 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.194@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:34:32.731703 25876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:32.725538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.194:47825)
0808 14:34:32.725820 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:32.725834 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:32.725939 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:32.726188 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:32.726190 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:32.726381 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:32.726482 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:32.726487 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:32.727364 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:32.727366 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:32.727983 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:32.727992 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:32.728554 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:32.728558 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:32.728654 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:32.729384 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:32.729401 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:32.731521 (+ 2120us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":96,"threads_started":1}
W20260808 14:34:32.731755 25872 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:32.725624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:47825 (local address 127.11.131.254:35395)
0808 14:34:32.725765 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:32.725769 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:32.725904 (+ 135us) server_negotiation.cc:407] Connection header received
0808 14:34:32.726023 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:32.726026 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:32.726072 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:32.726151 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:32.726579 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:32.727270 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:32.728087 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:32.728420 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:32.728530 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:32.731650 (+ 3120us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.131.194:47825: BlockingRecv error: recv got EOF from 127.11.131.194:47825 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 08 14:34:32 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.195@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:32 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.195@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:34:32.940085 25878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:32.934359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.195:53159)
0808 14:34:32.934667 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:32.934687 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:32.934792 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:32.935028 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:32.935031 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:32.935217 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:32.935317 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:32.935322 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:32.936297 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:32.936300 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:32.937106 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:32.937117 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:32.937545 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:32.937548 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:32.937607 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:32.938091 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:32.938102 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:32.939964 (+ 1862us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":75,"threads_started":1}
W20260808 14:34:32.940264 25872 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:32.934444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:53159 (local address 127.11.131.254:35395)
0808 14:34:32.934647 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:32.934650 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:32.934756 (+ 106us) server_negotiation.cc:407] Connection header received
0808 14:34:32.934872 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:32.934874 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:32.934923 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:32.934992 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:32.935450 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:32.936167 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:32.937216 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:32.937448 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:32.937530 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:32.940104 (+ 2574us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.131.195:53159: BlockingRecv error: recv got EOF from 127.11.131.195:53159 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Aug 08 14:34:33 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.193@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:33 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.193@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:34:33.552743 25879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:33.542575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.193:36173)
0808 14:34:33.542894 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:33.542909 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:33.543017 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:33.543268 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:33.543270 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:33.543471 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:33.543597 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:33.543603 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:33.544328 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:33.544330 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:33.544908 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:33.544916 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:33.545351 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:33.545354 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:33.545432 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:33.550464 (+ 5032us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:33.550477 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:33.552592 (+ 2115us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":93,"threads_started":1}
W20260808 14:34:33.552933 25880 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:33.542686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:36173 (local address 127.11.131.254:35395)
0808 14:34:33.542926 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:33.542929 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:33.542966 (+ 37us) server_negotiation.cc:407] Connection header received
0808 14:34:33.543104 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:33.543106 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:33.543151 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:33.543232 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:33.543697 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:33.544235 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:33.545009 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:33.545235 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:33.545326 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:33.552758 (+ 7432us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.131.193:36173: BlockingRecv error: recv got EOF from 127.11.131.193:36173 (error 108)
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":64,"threads_started":1}
Aug 08 14:34:33 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.194@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:33 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.194@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:34:33.738992 25881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:33.732645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.194:35721)
0808 14:34:33.733017 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:33.733034 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:33.733175 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:33.733487 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:33.733491 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:33.733768 (+ 277us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:33.733896 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:33.733904 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:33.734907 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:33.734911 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:33.735732 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:33.735744 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:33.736211 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:33.736213 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:33.736279 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:33.736771 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:33.736783 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:33.738869 (+ 2086us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":115,"threads_started":1}
W20260808 14:34:33.739166 25880 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:33.732733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:35721 (local address 127.11.131.254:35395)
0808 14:34:33.732911 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:33.732919 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:33.733144 (+ 225us) server_negotiation.cc:407] Connection header received
0808 14:34:33.733286 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:33.733289 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:33.733362 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:33.733460 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:33.734042 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:33.734773 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:33.735881 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:33.736108 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:33.736192 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:33.739008 (+ 2816us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.131.194:35721: BlockingRecv error: recv got EOF from 127.11.131.194:35721 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
Aug 08 14:34:33 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.195@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:33 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.195@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:34:33.947161 25883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:33.940975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.195:36385)
0808 14:34:33.941337 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:33.941355 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:33.941513 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:33.941848 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:33.941852 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:33.942070 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:33.942171 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:33.942176 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:33.943039 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:33.943043 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:33.943609 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:33.943618 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:33.944084 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:33.944088 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:33.944189 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:33.944778 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:33.944804 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:33.946957 (+ 2153us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":95,"threads_started":1}
W20260808 14:34:33.947198 25880 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:33.941127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:36385 (local address 127.11.131.254:35395)
0808 14:34:33.941339 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:33.941345 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:33.941447 (+ 102us) server_negotiation.cc:407] Connection header received
0808 14:34:33.941626 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:33.941630 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:33.941688 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:33.941778 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:33.942308 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:33.942930 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:33.943732 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:33.943960 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:33.944067 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:33.947092 (+ 3025us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.131.195:36385: BlockingRecv error: recv got EOF from 127.11.131.195:36385 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
Aug 08 14:34:34 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.193@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:34 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.193@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:34:34.560045 25885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:34.553696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.193:33969)
0808 14:34:34.554102 (+ 406us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:34.554121 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:34.554258 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:34.554652 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:34.554658 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:34.554932 (+ 274us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:34.555070 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:34.555080 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:34.556073 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:34.556078 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:34.556665 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:34.556673 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:34.557199 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:34.557202 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:34.557306 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:34.557816 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:34.557830 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:34.559902 (+ 2072us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":102,"threads_started":1}
W20260808 14:34:34.560243 25886 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:34.553787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:33969 (local address 127.11.131.254:35395)
0808 14:34:34.554124 (+ 337us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:34.554131 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:34.554198 (+ 67us) server_negotiation.cc:407] Connection header received
0808 14:34:34.554383 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:34.554395 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:34.554459 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:34.554562 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:34.555186 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:34.555972 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:34.556793 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:34.557057 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:34.557169 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:34.560056 (+ 2887us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.131.193:33969: BlockingRecv error: recv got EOF from 127.11.131.193:33969 (error 108)
Metrics: {"server-negotiator.queue_time_us":226,"thread_start_us":67,"threads_started":1}
Aug 08 14:34:34 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.194@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:34 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.194@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:34:34.745910 25888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:34.740073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.194:37229)
0808 14:34:34.740424 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:34.740440 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:34.740558 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:34.740847 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:34.740849 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:34.741060 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:34.741167 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:34.741173 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:34.741916 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:34.741919 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:34.742484 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:34.742492 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:34.743017 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:34.743021 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:34.743101 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:34.743784 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:34.743807 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:34.745772 (+ 1965us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":82,"threads_started":1}
W20260808 14:34:34.746033 25886 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:34.740183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:37229 (local address 127.11.131.254:35395)
0808 14:34:34.740420 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:34.740424 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:34.740521 (+ 97us) server_negotiation.cc:407] Connection header received
0808 14:34:34.740645 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:34.740647 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:34.740692 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:34.740768 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:34.741279 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:34.741812 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:34.742651 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:34.742888 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:34.743003 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:34.745914 (+ 2911us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.131.194:37229: BlockingRecv error: recv got EOF from 127.11.131.194:37229 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 08 14:34:34 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.195@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:34 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.195@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:34:34.953894 25892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:34.948101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.195:33903)
0808 14:34:34.948434 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:34.948449 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:34.948548 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:34.948822 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:34.948825 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:34.949022 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:34.949136 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:34.949142 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:34.949886 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:34.949909 (+ 23us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:34.950562 (+ 653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:34.950572 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:34.951065 (+ 493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:34.951068 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:34.951137 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:34.951679 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:34.951692 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:34.953674 (+ 1982us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":127,"threads_started":1}
W20260808 14:34:34.953929 25886 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:34.948255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:33903 (local address 127.11.131.254:35395)
0808 14:34:34.948416 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:34.948420 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:34.948516 (+ 96us) server_negotiation.cc:407] Connection header received
0808 14:34:34.948617 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:34.948619 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:34.948666 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:34.948743 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:34.949256 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:34.949777 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:34.950704 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:34.950954 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:34.951039 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:34.953821 (+ 2782us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.131.195:33903: BlockingRecv error: recv got EOF from 127.11.131.195:33903 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 08 14:34:35 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.193@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:35 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.193@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:34:35.566421 25893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:35.560867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.193:60145)
0808 14:34:35.561199 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:35.561214 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:35.561319 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:35.561556 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:35.561558 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:35.561744 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:35.561847 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:35.561853 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:35.562586 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:35.562588 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:35.563185 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:35.563195 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:35.563663 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:35.563666 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:35.563733 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:35.564264 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:35.564276 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:35.566295 (+ 2019us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":93,"threads_started":1}
W20260808 14:34:35.566649 25895 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:35.560989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:60145 (local address 127.11.131.254:35395)
0808 14:34:35.561234 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:35.561237 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:35.561267 (+ 30us) server_negotiation.cc:407] Connection header received
0808 14:34:35.561411 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:35.561413 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:35.561463 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:35.561544 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:35.561948 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:35.562488 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:35.563307 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:35.563555 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:35.563639 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:35.566462 (+ 2823us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.131.193:60145: BlockingRecv error: recv got EOF from 127.11.131.193:60145 (error 108)
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":63,"threads_started":1}
Aug 08 14:34:35 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.194@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:35 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.194@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:34:35.752135 25898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:35.746725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.194:53079)
0808 14:34:35.747020 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:35.747033 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:35.747141 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:35.747361 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:35.747363 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:35.747556 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:35.747653 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:35.747658 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:35.748421 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:35.748424 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:35.749027 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:35.749036 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:35.749507 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:35.749511 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:35.749590 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:35.750126 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:35.750138 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:35.752012 (+ 1874us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":105,"threads_started":1}
W20260808 14:34:35.752296 25895 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:35.746760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:53079 (local address 127.11.131.254:35395)
0808 14:34:35.746903 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:35.746907 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:35.747123 (+ 216us) server_negotiation.cc:407] Connection header received
0808 14:34:35.747224 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:35.747227 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:35.747276 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:35.747348 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:35.747782 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:35.748311 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:35.749135 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:35.749377 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:35.749455 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:35.752165 (+ 2710us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.131.194:53079: BlockingRecv error: recv got EOF from 127.11.131.194:53079 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 08 14:34:35 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.195@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:35 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.195@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:34:35.962383 25899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:35.954850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.195:33267)
0808 14:34:35.955174 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:35.955191 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:35.955322 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:35.955657 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:35.955661 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:35.955876 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:35.955985 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:35.955991 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:35.957046 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:35.957053 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:35.958012 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:35.958026 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:35.958642 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:35.958648 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:35.958776 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:35.959551 (+ 775us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:35.959572 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:35.962118 (+ 2546us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":94,"threads_started":1}
W20260808 14:34:35.962944 25895 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:35.954986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:33267 (local address 127.11.131.254:35395)
0808 14:34:35.955178 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:35.955186 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:35.955257 (+ 71us) server_negotiation.cc:407] Connection header received
0808 14:34:35.955449 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:35.955453 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:35.955529 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:35.955613 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:35.956112 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:35.956886 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:35.958192 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:35.958481 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:35.958625 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:35.962361 (+ 3736us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.131.195:33267: BlockingRecv error: recv got EOF from 127.11.131.195:33267 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
Aug 08 14:34:36 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.193@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:36 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.193@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:34:36.573730 25900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:36.567377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.193:54411)
0808 14:34:36.567726 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:36.567743 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:36.567877 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:36.568169 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:36.568172 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:36.568359 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:36.568477 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:36.568482 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:36.569356 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:36.569377 (+ 21us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:36.570059 (+ 682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:36.570072 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:36.570710 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:36.570719 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:36.570786 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:36.571321 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:36.571339 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:36.573606 (+ 2267us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":252,"threads_started":1}
W20260808 14:34:36.573918 25901 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:36.567466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:54411 (local address 127.11.131.254:35395)
0808 14:34:36.567714 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:36.567717 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:36.567827 (+ 110us) server_negotiation.cc:407] Connection header received
0808 14:34:36.567963 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:36.567965 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:36.568012 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:36.568101 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:36.568583 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:36.569234 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:36.570184 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:36.570547 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:36.570688 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:36.573744 (+ 3056us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.131.193:54411: BlockingRecv error: recv got EOF from 127.11.131.193:54411 (error 108)
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":88,"threads_started":1}
Aug 08 14:34:36 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.194@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:36 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.194@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:34:36.759063 25904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:36.753183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.194:46335)
0808 14:34:36.753498 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:36.753511 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:36.753618 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:36.753866 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:36.753869 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:36.754058 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:36.754161 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:36.754166 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:36.754935 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:36.754938 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:36.755503 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:36.755512 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:36.756053 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:36.756056 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:36.756159 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:36.756787 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:36.756804 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:36.758872 (+ 2068us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":116,"threads_started":1}
W20260808 14:34:36.759097 25901 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:36.753296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:46335 (local address 127.11.131.254:35395)
0808 14:34:36.753456 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:36.753460 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:36.753585 (+ 125us) server_negotiation.cc:407] Connection header received
0808 14:34:36.753701 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:36.753703 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:36.753749 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:36.753825 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:36.754260 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:36.754826 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:36.755621 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:36.755933 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:36.756042 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:36.758996 (+ 2954us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.131.194:46335: BlockingRecv error: recv got EOF from 127.11.131.194:46335 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 08 14:34:36 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.195@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:36 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.195@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:34:36.968919 25905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:36.963424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.195:55213)
0808 14:34:36.963721 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:36.963734 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:36.963834 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:36.964076 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:36.964079 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:36.964262 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:36.964382 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:36.964387 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:36.965088 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:36.965090 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:36.965652 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:36.965660 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:36.966075 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:36.966077 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:36.966140 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:36.966707 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:36.966720 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:36.968738 (+ 2018us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":121,"threads_started":1}
W20260808 14:34:36.968993 25901 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:36.963513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:55213 (local address 127.11.131.254:35395)
0808 14:34:36.963648 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:36.963652 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:36.963800 (+ 148us) server_negotiation.cc:407] Connection header received
0808 14:34:36.963916 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:36.963919 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:36.963966 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:36.964038 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:36.964479 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:36.964997 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:36.965755 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:36.965977 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:36.966055 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:36.968859 (+ 2804us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.131.195:55213: BlockingRecv error: recv got EOF from 127.11.131.195:55213 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 08 14:34:37 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.193@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:37 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.193@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:34:37.580248 25906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:37.574676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.193:59735)
0808 14:34:37.575020 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:37.575035 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:37.575179 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:37.575484 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:37.575487 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:37.575682 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:37.575792 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:37.575798 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:37.576532 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:37.576534 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:37.577094 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:37.577101 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:37.577538 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:37.577541 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:37.577604 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:37.578179 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:37.578192 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:37.580116 (+ 1924us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":100,"threads_started":1}
W20260808 14:34:37.580392 25909 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:37.574715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:59735 (local address 127.11.131.254:35395)
0808 14:34:37.574987 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:37.574992 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:37.575114 (+ 122us) server_negotiation.cc:407] Connection header received
0808 14:34:37.575288 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:37.575292 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:37.575348 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:37.575452 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:37.575900 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:37.576435 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:37.577196 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:37.577420 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:37.577498 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:37.580257 (+ 2759us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.131.193:59735: BlockingRecv error: recv got EOF from 127.11.131.193:59735 (error 108)
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":85,"threads_started":1}
Aug 08 14:34:37 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.194@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:37 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.194@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:34:37.765841 25912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:37.760127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.194:51417)
0808 14:34:37.760436 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:37.760451 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:37.760561 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:37.760875 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:37.760878 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:37.761107 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:37.761207 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:37.761233 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:37.762155 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:37.762158 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:37.762796 (+ 638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:37.762806 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:37.763267 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:37.763270 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:37.763329 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:37.763845 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:37.763857 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:37.765720 (+ 1863us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":114,"threads_started":1}
W20260808 14:34:37.766194 25909 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:37.760295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:51417 (local address 127.11.131.254:35395)
0808 14:34:37.760457 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:37.760462 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:37.760512 (+ 50us) server_negotiation.cc:407] Connection header received
0808 14:34:37.760687 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:37.760690 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:37.760740 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:37.760837 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:37.761354 (+ 517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:37.762051 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:37.762926 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:37.763154 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:37.763239 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:37.766082 (+ 2843us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.131.194:51417: BlockingRecv error: recv got EOF from 127.11.131.194:51417 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 08 14:34:37 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.195@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:37 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.195@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:34:37.975620 25915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:37.970109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.195:46921)
0808 14:34:37.970415 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:37.970432 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:37.970566 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:37.970937 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:37.970940 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:37.971218 (+ 278us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:37.971329 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:37.971337 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:37.972050 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:37.972052 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:37.972611 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:37.972619 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:37.973045 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:37.973047 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:37.973110 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:37.973582 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:37.973593 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:37.975501 (+ 1908us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":100,"threads_started":1}
W20260808 14:34:37.975797 25909 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:37.970157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:46921 (local address 127.11.131.254:35395)
0808 14:34:37.970285 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:37.970290 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:37.970516 (+ 226us) server_negotiation.cc:407] Connection header received
0808 14:34:37.970721 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:37.970725 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:37.970786 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:37.970878 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:37.971428 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:37.971955 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:37.972723 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:37.972948 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:37.973027 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:37.975643 (+ 2616us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.131.195:46921: BlockingRecv error: recv got EOF from 127.11.131.195:46921 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 08 14:34:38 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.193@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:38 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.193@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:34:38.591358 25916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:38.581042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.193:60119)
0808 14:34:38.581367 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:38.581382 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:38.581482 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:38.581764 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:38.581767 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:38.581987 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:38.582089 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:38.582095 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:38.582941 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:38.582943 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:38.583495 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:38.583503 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:38.583941 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:38.583944 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:38.584009 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:38.589138 (+ 5129us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:38.589153 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:38.591162 (+ 2009us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":111,"threads_started":1}
W20260808 14:34:38.591445 25917 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:38.581234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:60119 (local address 127.11.131.254:35395)
0808 14:34:38.581550 (+ 316us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:38.581554 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:38.581567 (+ 13us) server_negotiation.cc:407] Connection header received
0808 14:34:38.581605 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:38.581607 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:38.581649 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:38.581730 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:38.582196 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:38.582837 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:38.583590 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:38.583813 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:38.583889 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:38.591295 (+ 7406us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.131.193:60119: BlockingRecv error: recv got EOF from 127.11.131.193:60119 (error 108)
Metrics: {"server-negotiator.queue_time_us":247,"thread_start_us":82,"threads_started":1}
Aug 08 14:34:38 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.194@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:38 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.194@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:34:38.772966 25918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:38.766765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.194:49707)
0808 14:34:38.767087 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:38.767101 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:38.767255 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:38.767552 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:38.767554 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:38.767777 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:38.767880 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:38.767886 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:38.768678 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:38.768683 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:38.769365 (+ 682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:38.769374 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:38.769870 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:38.769874 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:38.769954 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:38.770517 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:38.770529 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:38.772772 (+ 2243us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":102,"threads_started":1}
W20260808 14:34:38.773020 25917 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:38.766774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:49707 (local address 127.11.131.254:35395)
0808 14:34:38.766988 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:38.766993 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:38.767189 (+ 196us) server_negotiation.cc:407] Connection header received
0808 14:34:38.767364 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:38.767369 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:38.767430 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:38.767521 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:38.768014 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:38.768559 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:38.769506 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:38.769744 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:38.769863 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:38.772913 (+ 3050us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.131.194:49707: BlockingRecv error: recv got EOF from 127.11.131.194:49707 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
Aug 08 14:34:38 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.195@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:38 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.195@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:34:38.982112 25919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:38.976553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.195:56965)
0808 14:34:38.976847 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:38.976872 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:38.976970 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:38.977217 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:38.977219 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:38.977410 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:38.977512 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:38.977517 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:38.978223 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:38.978226 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:38.978829 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:38.978837 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:38.979287 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:38.979290 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:38.979367 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:38.980052 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:38.980065 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:38.981981 (+ 1916us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":101,"threads_started":1}
W20260808 14:34:38.982282 25917 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:38.976750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:56965 (local address 127.11.131.254:35395)
0808 14:34:38.976898 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:38.976902 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:38.976919 (+ 17us) server_negotiation.cc:407] Connection header received
0808 14:34:38.977059 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:38.977061 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:38.977109 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:38.977172 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:38.977615 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:38.978126 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:38.978939 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:38.979157 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:38.979243 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:38.982121 (+ 2878us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.131.195:56965: BlockingRecv error: recv got EOF from 127.11.131.195:56965 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 08 14:34:39 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.193@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:39 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.193@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:34:39.598186 25920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:39.592447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.193:52727)
0808 14:34:39.592778 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:39.592794 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:39.592886 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:39.593154 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:39.593156 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:39.593349 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:39.593451 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:39.593457 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:39.594247 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:39.594251 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:39.595025 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:39.595041 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:39.595575 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:39.595578 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:39.595664 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:39.596156 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:39.596168 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:39.598053 (+ 1885us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":122,"threads_started":1}
W20260808 14:34:39.598382 25921 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:39.592577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:52727 (local address 127.11.131.254:35395)
0808 14:34:39.592834 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:39.592838 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:39.592853 (+ 15us) server_negotiation.cc:407] Connection header received
0808 14:34:39.592981 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:39.592983 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:39.593029 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:39.593116 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:39.593559 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:39.594101 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:39.595175 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:39.595435 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:39.595560 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:39.598228 (+ 2668us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.131.193:52727: BlockingRecv error: recv got EOF from 127.11.131.193:52727 (error 108)
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":108,"threads_started":1}
Aug 08 14:34:39 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.194@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 14:34:39 dist-test-slave-twwt krb5kdc[24299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.131.194@KRBTEST.COM for oryx/127.11.131.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 14:34:39.779654 25922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:39.774010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35395 (local address 127.11.131.194:56079)
0808 14:34:39.774343 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:39.774356 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:39.774502 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:39.774817 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:39.774820 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:39.775042 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:39.775142 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:39.775148 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:39.775915 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:39.775922 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:39.776499 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:39.776507 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:39.776983 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:39.776987 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:39.777074 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:39.777578 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:39.777590 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:39.779465 (+ 1875us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.131.254:35395: Server oryx/127.11.131.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":97,"threads_started":1}
W20260808 14:34:39.779693 25921 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:39.774106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:56079 (local address 127.11.131.254:35395)
0808 14:34:39.774260 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:39.774265 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:39.774445 (+ 180us) server_negotiation.cc:407] Connection header received
0808 14:34:39.774645 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:39.774647 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:39.774696 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:39.774787 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:39.775271 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:39.775800 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:39.776623 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:39.776854 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:39.776979 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:39.779586 (+ 2607us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.131.194:56079: BlockingRecv error: recv got EOF from 127.11.131.194:56079 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 14:34:39.862774 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 25167
I20260808 14:34:39.877038 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 25400
I20260808 14:34:39.894475 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 25602
I20260808 14:34:39.909879 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 25066
2026-08-08T14:34:39Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (18410 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-08T14:34:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:34:39Z Disabled control of system clock
I20260808 14:34:39.945555 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:34333
--webserver_interface=127.11.131.254
--webserver_port=0
--builtin_ntp_servers=127.11.131.212:39603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:34333
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 14:34:40.067696 25927 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:34:40.067994 25927 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:34:40.068030 25927 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:34:40.071990 25927 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:34:40.072043 25927 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:34:40.072059 25927 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:34:40.072077 25927 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:34:40.072091 25927 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:34:40.076963 25927 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:39603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:34333
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:34333
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.131.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25927
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:34:40.078027 25927 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:34:40.079401 25927 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:34:40.088282 25933 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:40.088244 25934 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:40.088245 25936 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:40.088299 25927 server_base.cc:1034] running on GCE node
I20260808 14:34:40.089102 25927 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:34:40.090226 25927 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:34:40.091398 25927 hybrid_clock.cc:648] HybridClock initialized: now 1786199680091377 us; error 33 us; skew 500 ppm
I20260808 14:34:40.093317 25927 webserver.cc:460] Webserver started at http://127.11.131.254:37573/ using document root <none> and password file <none>
I20260808 14:34:40.093938 25927 fs_manager.cc:359] Metadata directory not provided
I20260808 14:34:40.094003 25927 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:34:40.094249 25927 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:34:40.096357 25927 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/master-0/data/instance:
uuid: "d7776aec0fe5475c8d1b8e0263891a68"
format_stamp: "Formatted at 2026-08-08 14:34:40 on dist-test-slave-twwt"
server_key: "6d30f53c1474cfbeb3594edd5341d161"
server_key_iv: "6b503bace3acffd01036e4f6ad2b4b1e"
server_key_version: "encryptionkey@0"
I20260808 14:34:40.096951 25927 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/master-0/wal/instance:
uuid: "d7776aec0fe5475c8d1b8e0263891a68"
format_stamp: "Formatted at 2026-08-08 14:34:40 on dist-test-slave-twwt"
server_key: "6d30f53c1474cfbeb3594edd5341d161"
server_key_iv: "6b503bace3acffd01036e4f6ad2b4b1e"
server_key_version: "encryptionkey@0"
I20260808 14:34:40.100647 25927 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260808 14:34:40.103039 25944 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:40.104251 25927 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 14:34:40.104416 25927 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "d7776aec0fe5475c8d1b8e0263891a68"
format_stamp: "Formatted at 2026-08-08 14:34:40 on dist-test-slave-twwt"
server_key: "6d30f53c1474cfbeb3594edd5341d161"
server_key_iv: "6b503bace3acffd01036e4f6ad2b4b1e"
server_key_version: "encryptionkey@0"
I20260808 14:34:40.104535 25927 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:34:40.126567 25927 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:34:40.127413 25927 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:34:40.127628 25927 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:34:40.135354 25927 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.254:34333
I20260808 14:34:40.135365 26029 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.254:34333 every 8 connection(s)
I20260808 14:34:40.136360 25927 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:34:40.139775 26030 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:34:40.142000 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 25927
I20260808 14:34:40.142127 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/master-0/wal/instance
I20260808 14:34:40.142469 11791 external_mini_cluster.cc:1428] Setting key 471adf163e5ee594997364f7796bfb4b
I20260808 14:34:40.146438 26030 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7776aec0fe5475c8d1b8e0263891a68: Bootstrap starting.
I20260808 14:34:40.148802 26030 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d7776aec0fe5475c8d1b8e0263891a68: Neither blocks nor log segments found. Creating new log.
I20260808 14:34:40.149559 26030 log.cc:824] T 00000000000000000000000000000000 P d7776aec0fe5475c8d1b8e0263891a68: Log is configured to *not* fsync() on all Append() calls
I20260808 14:34:40.151757 26030 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7776aec0fe5475c8d1b8e0263891a68: No bootstrap required, opened a new log
I20260808 14:34:40.152383 26034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:40.144057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36444 (local address 127.11.131.254:34333)
0808 14:34:40.144764 (+ 707us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:40.144780 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:40.144816 (+ 36us) server_negotiation.cc:407] Connection header received
0808 14:34:40.145604 (+ 788us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:40.145624 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:40.146037 (+ 413us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:40.146391 (+ 354us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:40.146876 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:40.147846 (+ 970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:40.148818 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:40.149351 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:40.149551 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:40.150471 (+ 920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:40.150476 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:40.150490 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:34:40.150954 (+ 464us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:40.151013 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:34:40.151035 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:40.151151 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:40.151308 (+ 157us) server_negotiation.cc:299] Negotiation successful
0808 14:34:40.151576 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":350,"thread_start_us":160,"threads_started":1}
I20260808 14:34:40.155804 26030 raft_consensus.cc:348] T 00000000000000000000000000000000 P d7776aec0fe5475c8d1b8e0263891a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7776aec0fe5475c8d1b8e0263891a68" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 34333 } }
I20260808 14:34:40.156059 26030 raft_consensus.cc:374] T 00000000000000000000000000000000 P d7776aec0fe5475c8d1b8e0263891a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:34:40.156152 26030 raft_consensus.cc:729] T 00000000000000000000000000000000 P d7776aec0fe5475c8d1b8e0263891a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7776aec0fe5475c8d1b8e0263891a68, State: Initialized, Role: FOLLOWER
I20260808 14:34:40.156594 26030 consensus_queue.cc:260] T 00000000000000000000000000000000 P d7776aec0fe5475c8d1b8e0263891a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7776aec0fe5475c8d1b8e0263891a68" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 34333 } }
I20260808 14:34:40.156752 26030 raft_consensus.cc:388] T 00000000000000000000000000000000 P d7776aec0fe5475c8d1b8e0263891a68 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:34:40.156840 26030 raft_consensus.cc:482] T 00000000000000000000000000000000 P d7776aec0fe5475c8d1b8e0263891a68 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:34:40.156966 26030 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d7776aec0fe5475c8d1b8e0263891a68 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:34:40.158108 26030 raft_consensus.cc:504] T 00000000000000000000000000000000 P d7776aec0fe5475c8d1b8e0263891a68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7776aec0fe5475c8d1b8e0263891a68" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 34333 } }
I20260808 14:34:40.158468 26030 leader_election.cc:302] T 00000000000000000000000000000000 P d7776aec0fe5475c8d1b8e0263891a68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d7776aec0fe5475c8d1b8e0263891a68; no voters:
I20260808 14:34:40.158823 26030 leader_election.cc:288] T 00000000000000000000000000000000 P d7776aec0fe5475c8d1b8e0263891a68 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:34:40.158928 26036 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d7776aec0fe5475c8d1b8e0263891a68 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:34:40.159181 26036 raft_consensus.cc:686] T 00000000000000000000000000000000 P d7776aec0fe5475c8d1b8e0263891a68 [term 1 LEADER]: Becoming Leader. State: Replica: d7776aec0fe5475c8d1b8e0263891a68, State: Running, Role: LEADER
I20260808 14:34:40.159531 26036 consensus_queue.cc:237] T 00000000000000000000000000000000 P d7776aec0fe5475c8d1b8e0263891a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7776aec0fe5475c8d1b8e0263891a68" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 34333 } }
I20260808 14:34:40.160072 26030 sys_catalog.cc:564] T 00000000000000000000000000000000 P d7776aec0fe5475c8d1b8e0263891a68 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:34:40.161223 26041 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7776aec0fe5475c8d1b8e0263891a68 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d7776aec0fe5475c8d1b8e0263891a68. Latest consensus state: current_term: 1 leader_uuid: "d7776aec0fe5475c8d1b8e0263891a68" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7776aec0fe5475c8d1b8e0263891a68" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 34333 } } }
I20260808 14:34:40.161360 26041 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7776aec0fe5475c8d1b8e0263891a68 [sys.catalog]: This master's current role is: LEADER
I20260808 14:34:40.161789 26051 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:34:40.161733 26040 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7776aec0fe5475c8d1b8e0263891a68 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d7776aec0fe5475c8d1b8e0263891a68" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7776aec0fe5475c8d1b8e0263891a68" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 34333 } } }
I20260808 14:34:40.161959 26040 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7776aec0fe5475c8d1b8e0263891a68 [sys.catalog]: This master's current role is: LEADER
I20260808 14:34:40.165361 26051 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:34:40.171747 26051 catalog_manager.cc:1347] Generated new cluster ID: 94caee527067434abf406a30ae74799a
I20260808 14:34:40.171823 26051 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:34:40.193192 26051 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:34:40.194494 26051 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:34:40.201370 26051 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d7776aec0fe5475c8d1b8e0263891a68: Generated new TSK 0
I20260808 14:34:40.202265 26051 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:34:40.211345 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.193:0
--local_ip_for_outbound_sockets=127.11.131.193
--webserver_interface=127.11.131.193
--webserver_port=0
--tserver_master_addrs=127.11.131.254:34333
--builtin_ntp_servers=127.11.131.212:39603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260808 14:34:40.333731 26066 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:34:40.334000 26066 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:34:40.334038 26066 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:34:40.338212 26066 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:34:40.338274 26066 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:34:40.338361 26066 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.193
I20260808 14:34:40.343103 26066 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:39603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.131.193
--webserver_port=0
--tserver_master_addrs=127.11.131.254:34333
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26066
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.193
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:34:40.344193 26066 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:34:40.345645 26066 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:34:40.355469 26079 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:40.355469 26082 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:40.355578 26080 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:40.355610 26066 server_base.cc:1034] running on GCE node
I20260808 14:34:40.356132 26066 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:34:40.356791 26066 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:34:40.357954 26066 hybrid_clock.cc:648] HybridClock initialized: now 1786199680357918 us; error 47 us; skew 500 ppm
I20260808 14:34:40.359840 26066 webserver.cc:460] Webserver started at http://127.11.131.193:43347/ using document root <none> and password file <none>
I20260808 14:34:40.360857 26066 fs_manager.cc:359] Metadata directory not provided
I20260808 14:34:40.360941 26066 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:34:40.361299 26066 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:34:40.363665 26066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-0/data/instance:
uuid: "40252513944f4963812a5c17da604cf8"
format_stamp: "Formatted at 2026-08-08 14:34:40 on dist-test-slave-twwt"
server_key: "21605565c041736ec6b47db78dae48ce"
server_key_iv: "31da4995f1223ef988a26731deb56ee2"
server_key_version: "encryptionkey@0"
I20260808 14:34:40.364331 26066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-0/wal/instance:
uuid: "40252513944f4963812a5c17da604cf8"
format_stamp: "Formatted at 2026-08-08 14:34:40 on dist-test-slave-twwt"
server_key: "21605565c041736ec6b47db78dae48ce"
server_key_iv: "31da4995f1223ef988a26731deb56ee2"
server_key_version: "encryptionkey@0"
I20260808 14:34:40.368410 26066 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 14:34:40.371323 26091 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:40.372604 26066 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:34:40.372752 26066 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-0/wal
uuid: "40252513944f4963812a5c17da604cf8"
format_stamp: "Formatted at 2026-08-08 14:34:40 on dist-test-slave-twwt"
server_key: "21605565c041736ec6b47db78dae48ce"
server_key_iv: "31da4995f1223ef988a26731deb56ee2"
server_key_version: "encryptionkey@0"
I20260808 14:34:40.372871 26066 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:34:40.382218 26066 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:34:40.382948 26066 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:34:40.383147 26066 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:34:40.383736 26066 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:34:40.384693 26066 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:34:40.384742 26066 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:40.384822 26066 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:34:40.384853 26066 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:40.393989 26066 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.193:35991
I20260808 14:34:40.394023 26268 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.193:35991 every 8 connection(s)
I20260808 14:34:40.394942 26066 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
I20260808 14:34:40.399456 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 26066
I20260808 14:34:40.399600 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-0/wal/instance
I20260808 14:34:40.399914 11791 external_mini_cluster.cc:1428] Setting key 0b4a7f4fea6b5944ec9e579da78462e4
I20260808 14:34:40.401902 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.194:0
--local_ip_for_outbound_sockets=127.11.131.194
--webserver_interface=127.11.131.194
--webserver_port=0
--tserver_master_addrs=127.11.131.254:34333
--builtin_ntp_servers=127.11.131.212:39603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260808 14:34:40.404834 26034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:40.396786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:37561 (local address 127.11.131.254:34333)
0808 14:34:40.396939 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:40.396943 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:40.398031 (+ 1088us) server_negotiation.cc:407] Connection header received
0808 14:34:40.399516 (+ 1485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:40.399520 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:40.399586 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:40.399668 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:40.400775 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:40.401417 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:40.402785 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:40.403029 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:40.403144 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:40.404380 (+ 1236us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:40.404384 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:40.404386 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:34:40.404399 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:40.404420 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:34:40.404428 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:40.404484 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:40.404669 (+ 185us) server_negotiation.cc:299] Negotiation successful
0808 14:34:40.404721 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 14:34:40.405896 26271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:40.397200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:34333 (local address 127.11.131.193:37561)
0808 14:34:40.397866 (+ 666us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:40.397920 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:40.399257 (+ 1337us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:40.399855 (+ 598us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:40.399862 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:40.399953 (+ 91us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:40.400618 (+ 665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:40.400636 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:40.401557 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:40.401565 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:40.402568 (+ 1003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:40.402579 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:40.403189 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:40.403193 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:40.403367 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:40.404041 (+ 674us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:34:40.404044 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:40.404103 (+ 59us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:34:40.404194 (+ 91us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:40.404510 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:40.404519 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:40.404527 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 14:34:40.404665 (+ 138us) client_negotiation.cc:240] Negotiation successful
0808 14:34:40.404992 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":135,"threads_started":1}
I20260808 14:34:40.407203 26269 heartbeater.cc:347] Connected to a master server at 127.11.131.254:34333
I20260808 14:34:40.407464 26269 heartbeater.cc:464] Registering TS with master...
I20260808 14:34:40.408002 26269 heartbeater.cc:511] Master 127.11.131.254:34333 requested a full tablet report, sending...
I20260808 14:34:40.409632 25973 ts_manager.cc:194] Registered new tserver with Master: 40252513944f4963812a5c17da604cf8 (127.11.131.193:35991)
I20260808 14:34:40.410833 25973 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.131.193:37561
W20260808 14:34:40.520767 26276 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:34:40.521080 26276 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:34:40.521155 26276 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:34:40.525306 26276 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:34:40.525395 26276 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:34:40.525489 26276 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.194
I20260808 14:34:40.530406 26276 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:39603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.131.194
--webserver_port=0
--tserver_master_addrs=127.11.131.254:34333
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26276
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.194
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:34:40.531597 26276 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:34:40.533079 26276 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:34:40.543444 26286 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:40.543505 26284 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:40.543735 26276 server_base.cc:1034] running on GCE node
W20260808 14:34:40.543505 26283 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:40.544409 26276 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:34:40.545081 26276 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:34:40.546280 26276 hybrid_clock.cc:648] HybridClock initialized: now 1786199680546251 us; error 25 us; skew 500 ppm
I20260808 14:34:40.548277 26276 webserver.cc:460] Webserver started at http://127.11.131.194:34203/ using document root <none> and password file <none>
I20260808 14:34:40.548956 26276 fs_manager.cc:359] Metadata directory not provided
I20260808 14:34:40.549026 26276 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:34:40.549311 26276 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:34:40.551762 26276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-1/data/instance:
uuid: "e7b9c0a179074129b5950ef360b2ae2f"
format_stamp: "Formatted at 2026-08-08 14:34:40 on dist-test-slave-twwt"
server_key: "5960c93f0b8eb63c40044f708c0a2b50"
server_key_iv: "a8428ec4d87b9116a00515dd31abe51c"
server_key_version: "encryptionkey@0"
I20260808 14:34:40.552448 26276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-1/wal/instance:
uuid: "e7b9c0a179074129b5950ef360b2ae2f"
format_stamp: "Formatted at 2026-08-08 14:34:40 on dist-test-slave-twwt"
server_key: "5960c93f0b8eb63c40044f708c0a2b50"
server_key_iv: "a8428ec4d87b9116a00515dd31abe51c"
server_key_version: "encryptionkey@0"
I20260808 14:34:40.556628 26276 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260808 14:34:40.559729 26294 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:40.561282 26276 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 14:34:40.561431 26276 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-1/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-1/wal
uuid: "e7b9c0a179074129b5950ef360b2ae2f"
format_stamp: "Formatted at 2026-08-08 14:34:40 on dist-test-slave-twwt"
server_key: "5960c93f0b8eb63c40044f708c0a2b50"
server_key_iv: "a8428ec4d87b9116a00515dd31abe51c"
server_key_version: "encryptionkey@0"
I20260808 14:34:40.561568 26276 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:34:40.590888 26276 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:34:40.591620 26276 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:34:40.591800 26276 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:34:40.592419 26276 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:34:40.593497 26276 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:34:40.593549 26276 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:40.593595 26276 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:34:40.593612 26276 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:40.603603 26276 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.194:39283
I20260808 14:34:40.603647 26499 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.194:39283 every 8 connection(s)
I20260808 14:34:40.604599 26276 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
I20260808 14:34:40.610981 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 26276
I20260808 14:34:40.611115 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-1/wal/instance
I20260808 14:34:40.611459 11791 external_mini_cluster.cc:1428] Setting key 734ae31521a49c166a2e655aa620017a
I20260808 14:34:40.613574 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.195:0
--local_ip_for_outbound_sockets=127.11.131.195
--webserver_interface=127.11.131.195
--webserver_port=0
--tserver_master_addrs=127.11.131.254:34333
--builtin_ntp_servers=127.11.131.212:39603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260808 14:34:40.615506 26034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:40.606486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:49507 (local address 127.11.131.254:34333)
0808 14:34:40.606659 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:40.606664 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:40.608019 (+ 1355us) server_negotiation.cc:407] Connection header received
0808 14:34:40.609760 (+ 1741us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:40.609763 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:40.609826 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:40.609924 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:40.611182 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:40.611797 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:40.613346 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:40.613568 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:40.613647 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:40.614999 (+ 1352us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:40.615002 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:40.615004 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:34:40.615018 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:40.615036 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:34:40.615045 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:40.615106 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:40.615299 (+ 193us) server_negotiation.cc:299] Negotiation successful
0808 14:34:40.615352 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 14:34:40.616415 26512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:40.606976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:34333 (local address 127.11.131.194:49507)
0808 14:34:40.607852 (+ 876us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:40.607913 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:40.609525 (+ 1612us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:40.610134 (+ 609us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:40.610143 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:40.610241 (+ 98us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:40.611002 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:40.611028 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:40.611957 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:40.611960 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:40.613209 (+ 1249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:40.613221 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:40.613737 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:40.613745 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:40.613987 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:40.614673 (+ 686us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:34:40.614677 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:40.614737 (+ 60us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:34:40.614840 (+ 103us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:40.615135 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:40.615147 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:40.615157 (+ 10us) client_negotiation.cc:769] Sending connection context
0808 14:34:40.615283 (+ 126us) client_negotiation.cc:240] Negotiation successful
0808 14:34:40.615612 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":127,"threads_started":1}
I20260808 14:34:40.617691 26506 heartbeater.cc:347] Connected to a master server at 127.11.131.254:34333
I20260808 14:34:40.617966 26506 heartbeater.cc:464] Registering TS with master...
I20260808 14:34:40.618536 26506 heartbeater.cc:511] Master 127.11.131.254:34333 requested a full tablet report, sending...
I20260808 14:34:40.619733 25973 ts_manager.cc:194] Registered new tserver with Master: e7b9c0a179074129b5950ef360b2ae2f (127.11.131.194:39283)
I20260808 14:34:40.620321 25973 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.131.194:49507
W20260808 14:34:40.734223 26514 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:34:40.734550 26514 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:34:40.734647 26514 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:34:40.738725 26514 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:34:40.738821 26514 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:34:40.738922 26514 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.195
I20260808 14:34:40.743784 26514 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:39603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.131.195
--webserver_port=0
--tserver_master_addrs=127.11.131.254:34333
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26514
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.195
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:34:40.744979 26514 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:34:40.746475 26514 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:34:40.756695 26520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:40.756726 26521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:40.756695 26523 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:40.756958 26514 server_base.cc:1034] running on GCE node
I20260808 14:34:40.757447 26514 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:34:40.758177 26514 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:34:40.759375 26514 hybrid_clock.cc:648] HybridClock initialized: now 1786199680759354 us; error 32 us; skew 500 ppm
I20260808 14:34:40.761529 26514 webserver.cc:460] Webserver started at http://127.11.131.195:39285/ using document root <none> and password file <none>
I20260808 14:34:40.762197 26514 fs_manager.cc:359] Metadata directory not provided
I20260808 14:34:40.762291 26514 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:34:40.762521 26514 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:34:40.764719 26514 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-2/data/instance:
uuid: "73b95ebbcee04296bab0c09e01315cb8"
format_stamp: "Formatted at 2026-08-08 14:34:40 on dist-test-slave-twwt"
server_key: "baa3d940cf448fc9e858e1598f226378"
server_key_iv: "429534959d5b91c7e9496590e0404128"
server_key_version: "encryptionkey@0"
I20260808 14:34:40.765410 26514 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-2/wal/instance:
uuid: "73b95ebbcee04296bab0c09e01315cb8"
format_stamp: "Formatted at 2026-08-08 14:34:40 on dist-test-slave-twwt"
server_key: "baa3d940cf448fc9e858e1598f226378"
server_key_iv: "429534959d5b91c7e9496590e0404128"
server_key_version: "encryptionkey@0"
I20260808 14:34:40.769400 26514 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260808 14:34:40.772205 26533 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:40.773532 26514 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 14:34:40.773679 26514 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-2/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-2/wal
uuid: "73b95ebbcee04296bab0c09e01315cb8"
format_stamp: "Formatted at 2026-08-08 14:34:40 on dist-test-slave-twwt"
server_key: "baa3d940cf448fc9e858e1598f226378"
server_key_iv: "429534959d5b91c7e9496590e0404128"
server_key_version: "encryptionkey@0"
I20260808 14:34:40.773809 26514 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:34:40.797876 26514 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:34:40.798723 26514 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:34:40.798955 26514 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:34:40.799606 26514 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:34:40.800607 26514 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:34:40.800678 26514 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:40.800750 26514 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:34:40.800791 26514 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:40.810680 26514 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.195:36183
I20260808 14:34:40.810693 26705 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.195:36183 every 8 connection(s)
I20260808 14:34:40.811643 26514 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
I20260808 14:34:40.811945 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 26514
I20260808 14:34:40.812080 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-2/wal/instance
I20260808 14:34:40.812426 11791 external_mini_cluster.cc:1428] Setting key 9089f36ae56ea5e3c272cb73a5084952
I20260808 14:34:40.821015 26034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:40.813676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:42877 (local address 127.11.131.254:34333)
0808 14:34:40.813818 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:40.813823 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:40.815188 (+ 1365us) server_negotiation.cc:407] Connection header received
0808 14:34:40.816542 (+ 1354us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:40.816545 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:40.816590 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:40.816657 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:40.817523 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:40.818037 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:40.819258 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:40.819497 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:40.819577 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:40.820598 (+ 1021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:40.820602 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:40.820604 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:34:40.820617 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:40.820637 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:34:40.820645 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:40.820703 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:40.820845 (+ 142us) server_negotiation.cc:299] Negotiation successful
0808 14:34:40.820898 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 14:34:40.821894 26714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:40.814237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:34333 (local address 127.11.131.195:42877)
0808 14:34:40.815043 (+ 806us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:40.815087 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:40.816357 (+ 1270us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:40.816797 (+ 440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:40.816803 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:40.816892 (+ 89us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:40.817401 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:40.817415 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:40.818149 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:40.818152 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:40.819150 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:40.819161 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:40.819638 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:40.819641 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:40.819783 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:40.820353 (+ 570us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:34:40.820354 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:40.820394 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:34:40.820457 (+ 63us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:40.820718 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:40.820725 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:40.820729 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 14:34:40.820824 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 14:34:40.821061 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":128,"threads_started":1}
I20260808 14:34:40.823050 26709 heartbeater.cc:347] Connected to a master server at 127.11.131.254:34333
I20260808 14:34:40.823302 26709 heartbeater.cc:464] Registering TS with master...
I20260808 14:34:40.823833 26709 heartbeater.cc:511] Master 127.11.131.254:34333 requested a full tablet report, sending...
I20260808 14:34:40.824869 25973 ts_manager.cc:194] Registered new tserver with Master: 73b95ebbcee04296bab0c09e01315cb8 (127.11.131.195:36183)
I20260808 14:34:40.825541 25973 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.131.195:42877
I20260808 14:34:40.826874 11791 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 14:34:40.829931 26034 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:40.829002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36446 (local address 127.11.131.254:34333)
0808 14:34:40.829134 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:40.829137 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:40.829360 (+ 223us) server_negotiation.cc:407] Connection header received
0808 14:34:40.829457 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:40.829459 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:40.829497 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:40.829563 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:40.829776 (+ 213us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36446: BlockingRecv error: recv got EOF from 127.0.0.1:36446 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 14:34:40.830385 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 26066
I20260808 14:34:40.849876 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 26276
I20260808 14:34:40.872741 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 26514
I20260808 14:34:40.891645 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 25927
2026-08-08T14:34:40Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (983 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-08T14:34:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:34:40Z Disabled control of system clock
I20260808 14:34:40.928113 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:35943
--webserver_interface=127.11.131.254
--webserver_port=0
--builtin_ntp_servers=127.11.131.212:42657
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:35943
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 14:34:41.045409 26726 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:34:41.045666 26726 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:34:41.045702 26726 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:34:41.049769 26726 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:34:41.049832 26726 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:34:41.049849 26726 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:34:41.049870 26726 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:34:41.049886 26726 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:34:41.054921 26726 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:42657
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:35943
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:35943
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.131.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26726
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:34:41.056100 26726 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:34:41.057600 26726 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:34:41.066640 26739 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:41.066696 26733 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:41.066713 26737 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:41.066839 26726 server_base.cc:1034] running on GCE node
I20260808 14:34:41.067497 26726 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:34:41.068601 26726 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:34:41.069767 26726 hybrid_clock.cc:648] HybridClock initialized: now 1786199681069741 us; error 43 us; skew 500 ppm
I20260808 14:34:41.071666 26726 webserver.cc:460] Webserver started at http://127.11.131.254:34555/ using document root <none> and password file <none>
I20260808 14:34:41.072268 26726 fs_manager.cc:359] Metadata directory not provided
I20260808 14:34:41.072333 26726 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:34:41.072606 26726 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:34:41.074863 26726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/master-0/data/instance:
uuid: "b53da59f15aa4cebb7e859347ebe875b"
format_stamp: "Formatted at 2026-08-08 14:34:41 on dist-test-slave-twwt"
server_key: "e50bc406c76658f06b39dd7470b9f0ec"
server_key_iv: "405375292bb80cbfd1a73257251996b2"
server_key_version: "encryptionkey@0"
I20260808 14:34:41.075446 26726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/master-0/wal/instance:
uuid: "b53da59f15aa4cebb7e859347ebe875b"
format_stamp: "Formatted at 2026-08-08 14:34:41 on dist-test-slave-twwt"
server_key: "e50bc406c76658f06b39dd7470b9f0ec"
server_key_iv: "405375292bb80cbfd1a73257251996b2"
server_key_version: "encryptionkey@0"
I20260808 14:34:41.079320 26726 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260808 14:34:41.081930 26749 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:41.083225 26726 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 14:34:41.083374 26726 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "b53da59f15aa4cebb7e859347ebe875b"
format_stamp: "Formatted at 2026-08-08 14:34:41 on dist-test-slave-twwt"
server_key: "e50bc406c76658f06b39dd7470b9f0ec"
server_key_iv: "405375292bb80cbfd1a73257251996b2"
server_key_version: "encryptionkey@0"
I20260808 14:34:41.083479 26726 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:34:41.088119 26726 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:34:41.088747 26726 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:34:41.088933 26726 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:34:41.096014 26726 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.254:35943
I20260808 14:34:41.096020 26837 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.254:35943 every 8 connection(s)
I20260808 14:34:41.096951 26726 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:34:41.100343 26838 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:34:41.104212 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 26726
I20260808 14:34:41.104349 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/master-0/wal/instance
I20260808 14:34:41.104683 11791 external_mini_cluster.cc:1428] Setting key cf21ee2ced4c72da4113f75e5a93dac6
I20260808 14:34:41.106551 26838 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b53da59f15aa4cebb7e859347ebe875b: Bootstrap starting.
I20260808 14:34:41.108925 26838 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b53da59f15aa4cebb7e859347ebe875b: Neither blocks nor log segments found. Creating new log.
I20260808 14:34:41.109802 26838 log.cc:824] T 00000000000000000000000000000000 P b53da59f15aa4cebb7e859347ebe875b: Log is configured to *not* fsync() on all Append() calls
I20260808 14:34:41.110383 26846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:41.106139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44252 (local address 127.11.131.254:35943)
0808 14:34:41.106855 (+ 716us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:41.106873 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:41.106910 (+ 37us) server_negotiation.cc:407] Connection header received
0808 14:34:41.107551 (+ 641us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:41.107568 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:41.107913 (+ 345us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:41.108252 (+ 339us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:41.109071 (+ 819us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:41.109076 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:41.109089 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:34:41.109100 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:41.109156 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:34:41.109172 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:41.109289 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:41.109399 (+ 110us) server_negotiation.cc:299] Negotiation successful
0808 14:34:41.109644 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":140,"threads_started":1}
I20260808 14:34:41.112455 26838 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b53da59f15aa4cebb7e859347ebe875b: No bootstrap required, opened a new log
I20260808 14:34:41.116583 26838 raft_consensus.cc:348] T 00000000000000000000000000000000 P b53da59f15aa4cebb7e859347ebe875b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b53da59f15aa4cebb7e859347ebe875b" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 35943 } }
I20260808 14:34:41.116835 26838 raft_consensus.cc:374] T 00000000000000000000000000000000 P b53da59f15aa4cebb7e859347ebe875b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:34:41.116876 26838 raft_consensus.cc:729] T 00000000000000000000000000000000 P b53da59f15aa4cebb7e859347ebe875b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b53da59f15aa4cebb7e859347ebe875b, State: Initialized, Role: FOLLOWER
I20260808 14:34:41.117367 26838 consensus_queue.cc:260] T 00000000000000000000000000000000 P b53da59f15aa4cebb7e859347ebe875b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b53da59f15aa4cebb7e859347ebe875b" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 35943 } }
I20260808 14:34:41.117566 26838 raft_consensus.cc:388] T 00000000000000000000000000000000 P b53da59f15aa4cebb7e859347ebe875b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:34:41.117692 26838 raft_consensus.cc:482] T 00000000000000000000000000000000 P b53da59f15aa4cebb7e859347ebe875b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:34:41.117823 26838 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b53da59f15aa4cebb7e859347ebe875b [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:34:41.119010 26838 raft_consensus.cc:504] T 00000000000000000000000000000000 P b53da59f15aa4cebb7e859347ebe875b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b53da59f15aa4cebb7e859347ebe875b" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 35943 } }
I20260808 14:34:41.119417 26838 leader_election.cc:302] T 00000000000000000000000000000000 P b53da59f15aa4cebb7e859347ebe875b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b53da59f15aa4cebb7e859347ebe875b; no voters:
I20260808 14:34:41.119771 26838 leader_election.cc:288] T 00000000000000000000000000000000 P b53da59f15aa4cebb7e859347ebe875b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:34:41.119887 26849 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b53da59f15aa4cebb7e859347ebe875b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:34:41.120144 26849 raft_consensus.cc:686] T 00000000000000000000000000000000 P b53da59f15aa4cebb7e859347ebe875b [term 1 LEADER]: Becoming Leader. State: Replica: b53da59f15aa4cebb7e859347ebe875b, State: Running, Role: LEADER
I20260808 14:34:41.120477 26849 consensus_queue.cc:237] T 00000000000000000000000000000000 P b53da59f15aa4cebb7e859347ebe875b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b53da59f15aa4cebb7e859347ebe875b" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 35943 } }
I20260808 14:34:41.121227 26838 sys_catalog.cc:564] T 00000000000000000000000000000000 P b53da59f15aa4cebb7e859347ebe875b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:34:41.122398 26856 sys_catalog.cc:455] T 00000000000000000000000000000000 P b53da59f15aa4cebb7e859347ebe875b [sys.catalog]: SysCatalogTable state changed. Reason: New leader b53da59f15aa4cebb7e859347ebe875b. Latest consensus state: current_term: 1 leader_uuid: "b53da59f15aa4cebb7e859347ebe875b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b53da59f15aa4cebb7e859347ebe875b" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 35943 } } }
I20260808 14:34:41.122398 26853 sys_catalog.cc:455] T 00000000000000000000000000000000 P b53da59f15aa4cebb7e859347ebe875b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b53da59f15aa4cebb7e859347ebe875b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b53da59f15aa4cebb7e859347ebe875b" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 35943 } } }
I20260808 14:34:41.122617 26853 sys_catalog.cc:458] T 00000000000000000000000000000000 P b53da59f15aa4cebb7e859347ebe875b [sys.catalog]: This master's current role is: LEADER
I20260808 14:34:41.122907 26856 sys_catalog.cc:458] T 00000000000000000000000000000000 P b53da59f15aa4cebb7e859347ebe875b [sys.catalog]: This master's current role is: LEADER
I20260808 14:34:41.123134 26868 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:34:41.126278 26868 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:34:41.132082 26868 catalog_manager.cc:1347] Generated new cluster ID: 349dba2d69324097873076608964a156
I20260808 14:34:41.132166 26868 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:34:41.155594 26868 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:34:41.155979 26868 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:34:41.166160 26868 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b53da59f15aa4cebb7e859347ebe875b: Generated new TSK 0
I20260808 14:34:41.167022 26868 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:34:41.180682 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.193:0
--local_ip_for_outbound_sockets=127.11.131.193
--webserver_interface=127.11.131.193
--webserver_port=0
--tserver_master_addrs=127.11.131.254:35943
--builtin_ntp_servers=127.11.131.212:42657
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 14:34:41.299158 26881 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:34:41.299460 26881 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:34:41.299535 26881 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:34:41.303618 26881 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:34:41.303699 26881 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:34:41.303791 26881 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.193
I20260808 14:34:41.309099 26881 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:42657
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.131.193
--webserver_port=0
--tserver_master_addrs=127.11.131.254:35943
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26881
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.193
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:34:41.310226 26881 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:34:41.311762 26881 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:34:41.321993 26889 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:41.322027 26893 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:41.321971 26890 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:41.322144 26881 server_base.cc:1034] running on GCE node
I20260808 14:34:41.322773 26881 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:34:41.323516 26881 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:34:41.324679 26881 hybrid_clock.cc:648] HybridClock initialized: now 1786199681324640 us; error 52 us; skew 500 ppm
I20260808 14:34:41.326556 26881 webserver.cc:460] Webserver started at http://127.11.131.193:41963/ using document root <none> and password file <none>
I20260808 14:34:41.327210 26881 fs_manager.cc:359] Metadata directory not provided
I20260808 14:34:41.327276 26881 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:34:41.327529 26881 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:34:41.329689 26881 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-0/data/instance:
uuid: "7fba3a421a104b26ace06caa6087288c"
format_stamp: "Formatted at 2026-08-08 14:34:41 on dist-test-slave-twwt"
server_key: "fb644551045e6a82f65e16336374426d"
server_key_iv: "9cb85afbb96da1bad3ae77c1ca46ef55"
server_key_version: "encryptionkey@0"
I20260808 14:34:41.330258 26881 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-0/wal/instance:
uuid: "7fba3a421a104b26ace06caa6087288c"
format_stamp: "Formatted at 2026-08-08 14:34:41 on dist-test-slave-twwt"
server_key: "fb644551045e6a82f65e16336374426d"
server_key_iv: "9cb85afbb96da1bad3ae77c1ca46ef55"
server_key_version: "encryptionkey@0"
I20260808 14:34:41.334081 26881 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 14:34:41.336627 26905 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:41.337852 26881 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 14:34:41.338011 26881 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-0/wal
uuid: "7fba3a421a104b26ace06caa6087288c"
format_stamp: "Formatted at 2026-08-08 14:34:41 on dist-test-slave-twwt"
server_key: "fb644551045e6a82f65e16336374426d"
server_key_iv: "9cb85afbb96da1bad3ae77c1ca46ef55"
server_key_version: "encryptionkey@0"
I20260808 14:34:41.338132 26881 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:34:41.343133 26881 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:34:41.343760 26881 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:34:41.343958 26881 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:34:41.344501 26881 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:34:41.345417 26881 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:34:41.345486 26881 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:41.345549 26881 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:34:41.345602 26881 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:41.355206 26881 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.193:46655
I20260808 14:34:41.355291 27085 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.193:46655 every 8 connection(s)
I20260808 14:34:41.356199 26881 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
I20260808 14:34:41.358794 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 26881
I20260808 14:34:41.358919 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-0/wal/instance
I20260808 14:34:41.359246 11791 external_mini_cluster.cc:1428] Setting key d14e6f7b2e7440a8dc743c19495e6847
I20260808 14:34:41.361220 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.194:0
--local_ip_for_outbound_sockets=127.11.131.194
--webserver_interface=127.11.131.194
--webserver_port=0
--tserver_master_addrs=127.11.131.254:35943
--builtin_ntp_servers=127.11.131.212:42657
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260808 14:34:41.362768 26846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:41.358071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:49021 (local address 127.11.131.254:35943)
0808 14:34:41.358214 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:41.358217 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:41.359440 (+ 1223us) server_negotiation.cc:407] Connection header received
0808 14:34:41.360960 (+ 1520us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:41.360963 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:41.361005 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:41.361076 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:41.362253 (+ 1177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:41.362256 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:41.362259 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:34:41.362271 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:41.362301 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:34:41.362309 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:41.362418 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:41.362569 (+ 151us) server_negotiation.cc:299] Negotiation successful
0808 14:34:41.362635 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 14:34:41.363673 27088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:41.358401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35943 (local address 127.11.131.193:49021)
0808 14:34:41.359253 (+ 852us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:41.359318 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:41.360748 (+ 1430us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:41.361236 (+ 488us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:41.361243 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:41.361378 (+ 135us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:41.362001 (+ 623us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:34:41.362002 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:41.362041 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:34:41.362109 (+ 68us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:41.362411 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:41.362421 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:41.362429 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 14:34:41.362612 (+ 183us) client_negotiation.cc:240] Negotiation successful
0808 14:34:41.362963 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":204,"threads_started":1}
I20260808 14:34:41.364980 27086 heartbeater.cc:347] Connected to a master server at 127.11.131.254:35943
I20260808 14:34:41.365222 27086 heartbeater.cc:464] Registering TS with master...
I20260808 14:34:41.365698 27086 heartbeater.cc:511] Master 127.11.131.254:35943 requested a full tablet report, sending...
I20260808 14:34:41.367327 26779 ts_manager.cc:194] Registered new tserver with Master: 7fba3a421a104b26ace06caa6087288c (127.11.131.193:46655)
W20260808 14:34:41.481276 27089 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:34:41.481597 27089 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:34:41.481688 27089 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:34:41.485826 27089 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:34:41.485921 27089 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:34:41.486019 27089 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.194
I20260808 14:34:41.491142 27089 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:42657
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.131.194
--webserver_port=0
--tserver_master_addrs=127.11.131.254:35943
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27089
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.194
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:34:41.492316 27089 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:34:41.493813 27089 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:34:41.503935 27097 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:41.503968 27107 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:41.503990 27089 server_base.cc:1034] running on GCE node
W20260808 14:34:41.503913 27100 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:41.504582 27089 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:34:41.505256 27089 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:34:41.506425 27089 hybrid_clock.cc:648] HybridClock initialized: now 1786199681506408 us; error 28 us; skew 500 ppm
I20260808 14:34:41.508313 27089 webserver.cc:460] Webserver started at http://127.11.131.194:46741/ using document root <none> and password file <none>
I20260808 14:34:41.508921 27089 fs_manager.cc:359] Metadata directory not provided
I20260808 14:34:41.508984 27089 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:34:41.509266 27089 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:34:41.511457 27089 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-1/data/instance:
uuid: "20683a4bb3cd40a9beb030cf7ba41b0e"
format_stamp: "Formatted at 2026-08-08 14:34:41 on dist-test-slave-twwt"
server_key: "bf9911299883ba6587db85342eea5d89"
server_key_iv: "78e46163f5d42e363ad3fb502d76d01d"
server_key_version: "encryptionkey@0"
I20260808 14:34:41.512046 27089 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-1/wal/instance:
uuid: "20683a4bb3cd40a9beb030cf7ba41b0e"
format_stamp: "Formatted at 2026-08-08 14:34:41 on dist-test-slave-twwt"
server_key: "bf9911299883ba6587db85342eea5d89"
server_key_iv: "78e46163f5d42e363ad3fb502d76d01d"
server_key_version: "encryptionkey@0"
I20260808 14:34:41.515894 27089 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 14:34:41.518491 27117 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:41.519810 27089 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 14:34:41.519968 27089 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-1/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-1/wal
uuid: "20683a4bb3cd40a9beb030cf7ba41b0e"
format_stamp: "Formatted at 2026-08-08 14:34:41 on dist-test-slave-twwt"
server_key: "bf9911299883ba6587db85342eea5d89"
server_key_iv: "78e46163f5d42e363ad3fb502d76d01d"
server_key_version: "encryptionkey@0"
I20260808 14:34:41.520071 27089 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:34:41.524816 27089 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:34:41.525431 27089 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:34:41.525615 27089 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:34:41.526167 27089 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:34:41.527161 27089 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:34:41.527207 27089 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:41.527273 27089 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:34:41.527312 27089 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:41.536718 27089 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.194:34361
I20260808 14:34:41.536891 27282 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.194:34361 every 8 connection(s)
I20260808 14:34:41.537643 27089 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
I20260808 14:34:41.539784 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 27089
I20260808 14:34:41.539927 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-1/wal/instance
I20260808 14:34:41.540220 11791 external_mini_cluster.cc:1428] Setting key 95b33b03b2a9904fadf1af1e04c077a3
I20260808 14:34:41.542651 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.195:0
--local_ip_for_outbound_sockets=127.11.131.195
--webserver_interface=127.11.131.195
--webserver_port=0
--tserver_master_addrs=127.11.131.254:35943
--builtin_ntp_servers=127.11.131.212:42657
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260808 14:34:41.545217 26846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:41.539723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:36947 (local address 127.11.131.254:35943)
0808 14:34:41.539909 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:41.539915 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:41.541401 (+ 1486us) server_negotiation.cc:407] Connection header received
0808 14:34:41.543247 (+ 1846us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:41.543250 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:41.543295 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:41.543369 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:41.544630 (+ 1261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:41.544637 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:41.544642 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:34:41.544660 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:41.544688 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:34:41.544701 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:41.544811 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:41.544991 (+ 180us) server_negotiation.cc:299] Negotiation successful
0808 14:34:41.545041 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 14:34:41.546001 27287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:41.540244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35943 (local address 127.11.131.194:36947)
0808 14:34:41.541253 (+ 1009us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:41.541295 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:41.543016 (+ 1721us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:41.543552 (+ 536us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:41.543563 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:41.543677 (+ 114us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:41.544283 (+ 606us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:34:41.544288 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:41.544346 (+ 58us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:34:41.544443 (+ 97us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:41.544812 (+ 369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:41.544827 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:41.544833 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 14:34:41.544993 (+ 160us) client_negotiation.cc:240] Negotiation successful
0808 14:34:41.545187 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":122,"threads_started":1}
I20260808 14:34:41.547225 27283 heartbeater.cc:347] Connected to a master server at 127.11.131.254:35943
I20260808 14:34:41.547457 27283 heartbeater.cc:464] Registering TS with master...
I20260808 14:34:41.547923 27283 heartbeater.cc:511] Master 127.11.131.254:35943 requested a full tablet report, sending...
I20260808 14:34:41.549031 26779 ts_manager.cc:194] Registered new tserver with Master: 20683a4bb3cd40a9beb030cf7ba41b0e (127.11.131.194:34361)
W20260808 14:34:41.660810 27288 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:34:41.661077 27288 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:34:41.661118 27288 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:34:41.665066 27288 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:34:41.665112 27288 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:34:41.665210 27288 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.195
I20260808 14:34:41.670022 27288 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:42657
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.131.195
--webserver_port=0
--tserver_master_addrs=127.11.131.254:35943
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27288
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.195
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:34:41.671221 27288 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:34:41.672556 27288 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:34:41.682498 27300 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:41.682502 27296 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:41.682502 27298 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:41.682716 27288 server_base.cc:1034] running on GCE node
I20260808 14:34:41.683347 27288 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:34:41.683982 27288 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:34:41.685173 27288 hybrid_clock.cc:648] HybridClock initialized: now 1786199681685142 us; error 46 us; skew 500 ppm
I20260808 14:34:41.687156 27288 webserver.cc:460] Webserver started at http://127.11.131.195:46675/ using document root <none> and password file <none>
I20260808 14:34:41.687789 27288 fs_manager.cc:359] Metadata directory not provided
I20260808 14:34:41.687892 27288 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:34:41.688139 27288 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:34:41.690196 27288 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-2/data/instance:
uuid: "d66702c6dc574cbb8d239f6577e45510"
format_stamp: "Formatted at 2026-08-08 14:34:41 on dist-test-slave-twwt"
server_key: "83a86007d9459059e1970df2546c967f"
server_key_iv: "964d982628a96447eb60dcdfee9ad81b"
server_key_version: "encryptionkey@0"
I20260808 14:34:41.690833 27288 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-2/wal/instance:
uuid: "d66702c6dc574cbb8d239f6577e45510"
format_stamp: "Formatted at 2026-08-08 14:34:41 on dist-test-slave-twwt"
server_key: "83a86007d9459059e1970df2546c967f"
server_key_iv: "964d982628a96447eb60dcdfee9ad81b"
server_key_version: "encryptionkey@0"
I20260808 14:34:41.694463 27288 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260808 14:34:41.697014 27309 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:41.698215 27288 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 14:34:41.698354 27288 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-2/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-2/wal
uuid: "d66702c6dc574cbb8d239f6577e45510"
format_stamp: "Formatted at 2026-08-08 14:34:41 on dist-test-slave-twwt"
server_key: "83a86007d9459059e1970df2546c967f"
server_key_iv: "964d982628a96447eb60dcdfee9ad81b"
server_key_version: "encryptionkey@0"
I20260808 14:34:41.698473 27288 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:34:41.703018 27288 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:34:41.703639 27288 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:34:41.703828 27288 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:34:41.704389 27288 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:34:41.705319 27288 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:34:41.705392 27288 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:41.705466 27288 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:34:41.705508 27288 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:41.713979 27288 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.195:35059
I20260808 14:34:41.714008 27476 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.195:35059 every 8 connection(s)
I20260808 14:34:41.714988 27288 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
I20260808 14:34:41.720728 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 27288
I20260808 14:34:41.720885 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786199615258783-11791-0/minicluster-data/ts-2/wal/instance
I20260808 14:34:41.721249 11791 external_mini_cluster.cc:1428] Setting key a9824a2df36fba73cbbd27d87e46bc55
I20260808 14:34:41.721490 26846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:41.716864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:48609 (local address 127.11.131.254:35943)
0808 14:34:41.717015 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:41.717020 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:41.718110 (+ 1090us) server_negotiation.cc:407] Connection header received
0808 14:34:41.719617 (+ 1507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:41.719620 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:41.719667 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:41.719777 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:41.720994 (+ 1217us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:41.720999 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:41.721001 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:34:41.721013 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:41.721034 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:34:41.721043 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:41.721125 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:41.721323 (+ 198us) server_negotiation.cc:299] Negotiation successful
0808 14:34:41.721374 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 14:34:41.722704 27480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:41.717276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35943 (local address 127.11.131.195:48609)
0808 14:34:41.717959 (+ 683us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:41.718001 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:41.719383 (+ 1382us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:41.719953 (+ 570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:41.719961 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:41.720051 (+ 90us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:41.720615 (+ 564us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:34:41.720617 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:41.720675 (+ 58us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:34:41.720770 (+ 95us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:41.721140 (+ 370us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:41.721150 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:41.721157 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 14:34:41.721353 (+ 196us) client_negotiation.cc:240] Negotiation successful
0808 14:34:41.721615 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":135,"threads_started":1}
I20260808 14:34:41.723960 27477 heartbeater.cc:347] Connected to a master server at 127.11.131.254:35943
I20260808 14:34:41.724229 27477 heartbeater.cc:464] Registering TS with master...
I20260808 14:34:41.724618 27477 heartbeater.cc:511] Master 127.11.131.254:35943 requested a full tablet report, sending...
I20260808 14:34:41.725605 26778 ts_manager.cc:194] Registered new tserver with Master: d66702c6dc574cbb8d239f6577e45510 (127.11.131.195:35059)
I20260808 14:34:41.735584 11791 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 14:34:41.738584 26846 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:34:41.737593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44262 (local address 127.11.131.254:35943)
0808 14:34:41.737745 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:41.737749 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:41.737937 (+ 188us) server_negotiation.cc:407] Connection header received
0808 14:34:41.738089 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:41.738093 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:41.738135 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:41.738215 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:41.738462 (+ 247us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44262: BlockingRecv error: recv got EOF from 127.0.0.1:44262 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 14:34:41.738771 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 26881
I20260808 14:34:41.762027 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 27089
I20260808 14:34:41.782344 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 27288
I20260808 14:34:41.795105 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 26726
2026-08-08T14:34:41Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (902 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:34:41 dist-test-slave-twwt krb5kdc[27492](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:34:41 dist-test-slave-twwt krb5kdc[27492](info): set up 2 sockets
Aug 08 14:34:41 dist-test-slave-twwt krb5kdc[27492](info): commencing operation
krb5kdc: starting...
W20260808 14:34:43.055037 11791 mini_kdc.cc:121] Time spent starting KDC: real 1.233s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Aug 08 14:34:43 dist-test-slave-twwt krb5kdc[27492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199683, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:34:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:34:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.131.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
I20260808 14:34:43.194816 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:37831
--webserver_interface=127.11.131.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:40519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:37831
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:34:43.314006 27507 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:34:43.314430 27507 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:34:43.314519 27507 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:34:43.318854 27507 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:34:43.318917 27507 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:34:43.318938 27507 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:34:43.318953 27507 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:34:43.318969 27507 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:34:43.324522 27507 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:40519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:37831
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:37831
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.131.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27507
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:34:43.325546 27507 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:34:43.326597 27507 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:34:43.335772 27518 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:43.335915 27507 server_base.cc:1034] running on GCE node
W20260808 14:34:43.335796 27520 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:43.335714 27516 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:43.336616 27507 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:34:43.337788 27507 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:34:43.338985 27507 hybrid_clock.cc:648] HybridClock initialized: now 1786199683338953 us; error 47 us; skew 500 ppm
Aug 08 14:34:43 dist-test-slave-twwt krb5kdc[27492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199683, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:34:43.341908 27507 init.cc:377] Logged in from keytab as kudu/127.11.131.254@KRBTEST.COM (short username kudu)
I20260808 14:34:43.343014 27507 webserver.cc:460] Webserver started at http://127.11.131.254:33995/ using document root <none> and password file <none>
I20260808 14:34:43.343604 27507 fs_manager.cc:359] Metadata directory not provided
I20260808 14:34:43.343695 27507 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:34:43.343943 27507 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:34:43.346088 27507 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/master-0/data/instance:
uuid: "77557a35fbb041b3a4ab0407de534efe"
format_stamp: "Formatted at 2026-08-08 14:34:43 on dist-test-slave-twwt"
server_key: "7979d7cbca03ff3788bc4463a6170f95"
server_key_iv: "7900eb55fd869391919856e9c2d195d9"
server_key_version: "encryptionkey@0"
I20260808 14:34:43.346803 27507 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/master-0/wal/instance:
uuid: "77557a35fbb041b3a4ab0407de534efe"
format_stamp: "Formatted at 2026-08-08 14:34:43 on dist-test-slave-twwt"
server_key: "7979d7cbca03ff3788bc4463a6170f95"
server_key_iv: "7900eb55fd869391919856e9c2d195d9"
server_key_version: "encryptionkey@0"
I20260808 14:34:43.350879 27507 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 14:34:43.353500 27529 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:43.354887 27507 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:34:43.355027 27507 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "77557a35fbb041b3a4ab0407de534efe"
format_stamp: "Formatted at 2026-08-08 14:34:43 on dist-test-slave-twwt"
server_key: "7979d7cbca03ff3788bc4463a6170f95"
server_key_iv: "7900eb55fd869391919856e9c2d195d9"
server_key_version: "encryptionkey@0"
I20260808 14:34:43.355147 27507 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:34:43.373176 27507 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:34:43.376464 27507 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:34:43.376677 27507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:34:43.384285 27507 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.254:37831
I20260808 14:34:43.384590 27598 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.254:37831 every 8 connection(s)
I20260808 14:34:43.385368 27507 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:34:43.388593 27599 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:34:43.393464 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 27507
I20260808 14:34:43.393574 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/master-0/wal/instance
I20260808 14:34:43.393893 11791 external_mini_cluster.cc:1428] Setting key 5353fde1e029d51da2966e498c3d25bf
I20260808 14:34:43.395328 27599 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77557a35fbb041b3a4ab0407de534efe: Bootstrap starting.
I20260808 14:34:43.398460 27599 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 77557a35fbb041b3a4ab0407de534efe: Neither blocks nor log segments found. Creating new log.
I20260808 14:34:43.399490 27599 log.cc:824] T 00000000000000000000000000000000 P 77557a35fbb041b3a4ab0407de534efe: Log is configured to *not* fsync() on all Append() calls
I20260808 14:34:43.401677 27599 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77557a35fbb041b3a4ab0407de534efe: No bootstrap required, opened a new log
Aug 08 14:34:43 dist-test-slave-twwt krb5kdc[27492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199683, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:34:43.406402 27599 raft_consensus.cc:348] T 00000000000000000000000000000000 P 77557a35fbb041b3a4ab0407de534efe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77557a35fbb041b3a4ab0407de534efe" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 37831 } }
I20260808 14:34:43.406716 27599 raft_consensus.cc:374] T 00000000000000000000000000000000 P 77557a35fbb041b3a4ab0407de534efe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:34:43.406804 27599 raft_consensus.cc:729] T 00000000000000000000000000000000 P 77557a35fbb041b3a4ab0407de534efe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77557a35fbb041b3a4ab0407de534efe, State: Initialized, Role: FOLLOWER
I20260808 14:34:43.407307 27599 consensus_queue.cc:260] T 00000000000000000000000000000000 P 77557a35fbb041b3a4ab0407de534efe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77557a35fbb041b3a4ab0407de534efe" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 37831 } }
I20260808 14:34:43.407487 27599 raft_consensus.cc:388] T 00000000000000000000000000000000 P 77557a35fbb041b3a4ab0407de534efe [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:34:43.407572 27599 raft_consensus.cc:482] T 00000000000000000000000000000000 P 77557a35fbb041b3a4ab0407de534efe [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:34:43.407732 27599 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 77557a35fbb041b3a4ab0407de534efe [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:34:43.408968 27599 raft_consensus.cc:504] T 00000000000000000000000000000000 P 77557a35fbb041b3a4ab0407de534efe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77557a35fbb041b3a4ab0407de534efe" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 37831 } }
I20260808 14:34:43.409344 27599 leader_election.cc:302] T 00000000000000000000000000000000 P 77557a35fbb041b3a4ab0407de534efe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 77557a35fbb041b3a4ab0407de534efe; no voters:
I20260808 14:34:43.409688 27599 leader_election.cc:288] T 00000000000000000000000000000000 P 77557a35fbb041b3a4ab0407de534efe [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:34:43.409818 27609 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 77557a35fbb041b3a4ab0407de534efe [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:34:43.410104 27609 raft_consensus.cc:686] T 00000000000000000000000000000000 P 77557a35fbb041b3a4ab0407de534efe [term 1 LEADER]: Becoming Leader. State: Replica: 77557a35fbb041b3a4ab0407de534efe, State: Running, Role: LEADER
I20260808 14:34:43.410141 27603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:43.395499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49306 (local address 127.11.131.254:37831)
0808 14:34:43.395980 (+ 481us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:43.396002 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:43.396050 (+ 48us) server_negotiation.cc:407] Connection header received
0808 14:34:43.397142 (+ 1092us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:43.397169 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:43.397602 (+ 433us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:43.397969 (+ 367us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:43.398747 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:43.400160 (+ 1413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:43.401029 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:43.401710 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:43.401879 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:43.404661 (+ 2782us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:43.404669 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:43.404691 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:43.404731 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:43.406737 (+ 2006us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:43.407274 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:43.407279 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:43.407285 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:43.407434 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:43.407768 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:43.407772 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:43.407797 (+ 25us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:43.408338 (+ 541us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:43.408547 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:43.408779 (+ 232us) server_negotiation.cc:299] Negotiation successful
0808 14:34:43.409104 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":309,"thread_start_us":129,"threads_started":1}
I20260808 14:34:43.410539 27609 consensus_queue.cc:237] T 00000000000000000000000000000000 P 77557a35fbb041b3a4ab0407de534efe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77557a35fbb041b3a4ab0407de534efe" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 37831 } }
I20260808 14:34:43.411012 27599 sys_catalog.cc:564] T 00000000000000000000000000000000 P 77557a35fbb041b3a4ab0407de534efe [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:34:43.412968 27610 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77557a35fbb041b3a4ab0407de534efe [sys.catalog]: SysCatalogTable state changed. Reason: New leader 77557a35fbb041b3a4ab0407de534efe. Latest consensus state: current_term: 1 leader_uuid: "77557a35fbb041b3a4ab0407de534efe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77557a35fbb041b3a4ab0407de534efe" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 37831 } } }
I20260808 14:34:43.413115 27610 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77557a35fbb041b3a4ab0407de534efe [sys.catalog]: This master's current role is: LEADER
I20260808 14:34:43.413434 27611 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77557a35fbb041b3a4ab0407de534efe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "77557a35fbb041b3a4ab0407de534efe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77557a35fbb041b3a4ab0407de534efe" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 37831 } } }
I20260808 14:34:43.413805 27611 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77557a35fbb041b3a4ab0407de534efe [sys.catalog]: This master's current role is: LEADER
W20260808 14:34:43.416348 27625 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 77557a35fbb041b3a4ab0407de534efe: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:34:43.416431 27625 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:34:43.416509 27626 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:34:43.417379 27626 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:34:43.422986 27626 catalog_manager.cc:1347] Generated new cluster ID: 3ac5ae3969ca4495ba8aaa6c128fc2cd
I20260808 14:34:43.423059 27626 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:34:43.439489 27626 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:34:43.440515 27626 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:34:43.448678 27626 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 77557a35fbb041b3a4ab0407de534efe: Generated new TSK 0
I20260808 14:34:43.449421 27626 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.131.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab.
Entry for principal kudu/127.11.131.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab.
I20260808 14:34:43.487000 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.193:0
--local_ip_for_outbound_sockets=127.11.131.193
--webserver_interface=127.11.131.193
--webserver_port=0
--tserver_master_addrs=127.11.131.254:37831
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab
--principal=kudu/127.11.131.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:40519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:34:43.604056 27633 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:34:43.604313 27633 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:34:43.604357 27633 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:34:43.608388 27633 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:34:43.608451 27633 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:34:43.608510 27633 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.193
I20260808 14:34:43.614095 27633 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:40519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab
--principal=kudu/127.11.131.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.131.193
--webserver_port=0
--tserver_master_addrs=127.11.131.254:37831
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27633
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.193
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:34:43.615286 27633 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:34:43.616396 27633 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:34:43.627264 27648 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:43.627260 27649 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:43.627255 27651 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:43.627506 27633 server_base.cc:1034] running on GCE node
I20260808 14:34:43.628007 27633 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:34:43.628682 27633 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:34:43.629870 27633 hybrid_clock.cc:648] HybridClock initialized: now 1786199683629838 us; error 44 us; skew 500 ppm
Aug 08 14:34:43 dist-test-slave-twwt krb5kdc[27492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199683, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:34:43.638167 27633 init.cc:377] Logged in from keytab as kudu/127.11.131.193@KRBTEST.COM (short username kudu)
I20260808 14:34:43.639314 27633 webserver.cc:460] Webserver started at http://127.11.131.193:42865/ using document root <none> and password file <none>
I20260808 14:34:43.639972 27633 fs_manager.cc:359] Metadata directory not provided
I20260808 14:34:43.640075 27633 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:34:43.640342 27633 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:34:43.642670 27633 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/ts-0/data/instance:
uuid: "1ef49472405e473f9daa1e8ef698ac62"
format_stamp: "Formatted at 2026-08-08 14:34:43 on dist-test-slave-twwt"
server_key: "c2a619756306b8a8774ee342dc5a9666"
server_key_iv: "f9f39f031687adf4b6a02bf64e33b1a1"
server_key_version: "encryptionkey@0"
I20260808 14:34:43.643328 27633 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/ts-0/wal/instance:
uuid: "1ef49472405e473f9daa1e8ef698ac62"
format_stamp: "Formatted at 2026-08-08 14:34:43 on dist-test-slave-twwt"
server_key: "c2a619756306b8a8774ee342dc5a9666"
server_key_iv: "f9f39f031687adf4b6a02bf64e33b1a1"
server_key_version: "encryptionkey@0"
I20260808 14:34:43.647531 27633 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 14:34:43.650192 27661 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:43.651649 27633 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 14:34:43.651806 27633 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/ts-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/ts-0/wal
uuid: "1ef49472405e473f9daa1e8ef698ac62"
format_stamp: "Formatted at 2026-08-08 14:34:43 on dist-test-slave-twwt"
server_key: "c2a619756306b8a8774ee342dc5a9666"
server_key_iv: "f9f39f031687adf4b6a02bf64e33b1a1"
server_key_version: "encryptionkey@0"
I20260808 14:34:43.651944 27633 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:34:43.683780 27633 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:34:43.687754 27633 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:34:43.687985 27633 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:34:43.688694 27633 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:34:43.689635 27633 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:34:43.689713 27633 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:43.689795 27633 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:34:43.689851 27633 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:43.699889 27633 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.193:39291
I20260808 14:34:43.699935 27844 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.193:39291 every 8 connection(s)
I20260808 14:34:43.700886 27633 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
I20260808 14:34:43.705004 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 27633
I20260808 14:34:43.705163 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/ts-0/wal/instance
I20260808 14:34:43.705482 11791 external_mini_cluster.cc:1428] Setting key e88c335f492c92825d64c968f670bc4c
Aug 08 14:34:43 dist-test-slave-twwt krb5kdc[27492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199683, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.193@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:34:43.716512 27603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:43.702875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:43897 (local address 127.11.131.254:37831)
0808 14:34:43.703023 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:43.703027 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:43.703902 (+ 875us) server_negotiation.cc:407] Connection header received
0808 14:34:43.705425 (+ 1523us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:43.705428 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:43.705492 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:43.705600 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:43.707069 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:43.707602 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:43.708771 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:43.709009 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:43.709116 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:43.712231 (+ 3115us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:43.712235 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:43.712237 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:43.712260 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:43.714124 (+ 1864us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:43.714755 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:43.714761 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:43.714765 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:43.714880 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:43.715257 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:43.715261 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:43.715263 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:43.715522 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:43.715631 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:43.716159 (+ 528us) server_negotiation.cc:299] Negotiation successful
0808 14:34:43.716296 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 14:34:43.717305 27847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:43.703264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:37831 (local address 127.11.131.193:43897)
0808 14:34:43.703741 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:43.703784 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:43.705144 (+ 1360us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:43.705791 (+ 647us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:43.705799 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:43.706263 (+ 464us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:43.706916 (+ 653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:43.706947 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:43.707736 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:43.707740 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:43.708631 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:43.708641 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:43.709172 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:43.709176 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:43.709373 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:43.710015 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:43.710033 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:43.712055 (+ 2022us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:43.714271 (+ 2216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:43.714277 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:43.714290 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:43.714591 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:43.714987 (+ 396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:43.714990 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:43.714991 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:43.715141 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:43.715632 (+ 491us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:43.715637 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:43.715886 (+ 249us) client_negotiation.cc:769] Sending connection context
0808 14:34:43.716047 (+ 161us) client_negotiation.cc:240] Negotiation successful
0808 14:34:43.716319 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":134,"threads_started":1}
WARNING: no policy specified for kudu/127.11.131.194@KRBTEST.COM; defaulting to no policy
I20260808 14:34:43.718767 27845 heartbeater.cc:347] Connected to a master server at 127.11.131.254:37831
I20260808 14:34:43.719010 27845 heartbeater.cc:464] Registering TS with master...
I20260808 14:34:43.719483 27845 heartbeater.cc:511] Master 127.11.131.254:37831 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.194@KRBTEST.COM" created.
I20260808 14:34:43.721062 27553 ts_manager.cc:194] Registered new tserver with Master: 1ef49472405e473f9daa1e8ef698ac62 (127.11.131.193:39291)
I20260808 14:34:43.722178 27553 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.193@KRBTEST.COM'} at 127.11.131.193:43897
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab.
Entry for principal kudu/127.11.131.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab.
I20260808 14:34:43.738175 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.194:0
--local_ip_for_outbound_sockets=127.11.131.194
--webserver_interface=127.11.131.194
--webserver_port=0
--tserver_master_addrs=127.11.131.254:37831
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab
--principal=kudu/127.11.131.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:40519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:34:43.856917 27854 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:34:43.857216 27854 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:34:43.857286 27854 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:34:43.861410 27854 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:34:43.861497 27854 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:34:43.861583 27854 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.194
I20260808 14:34:43.866861 27854 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:40519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab
--principal=kudu/127.11.131.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.131.194
--webserver_port=0
--tserver_master_addrs=127.11.131.254:37831
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27854
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.194
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:34:43.868153 27854 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:34:43.869388 27854 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:34:43.879329 27867 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:43.879354 27866 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:43.879396 27869 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:43.879597 27854 server_base.cc:1034] running on GCE node
I20260808 14:34:43.880103 27854 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:34:43.880728 27854 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:34:43.881922 27854 hybrid_clock.cc:648] HybridClock initialized: now 1786199683881911 us; error 28 us; skew 500 ppm
Aug 08 14:34:43 dist-test-slave-twwt krb5kdc[27492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199683, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:34:43.884665 27854 init.cc:377] Logged in from keytab as kudu/127.11.131.194@KRBTEST.COM (short username kudu)
I20260808 14:34:43.885581 27854 webserver.cc:460] Webserver started at http://127.11.131.194:36669/ using document root <none> and password file <none>
I20260808 14:34:43.886158 27854 fs_manager.cc:359] Metadata directory not provided
I20260808 14:34:43.886250 27854 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:34:43.886489 27854 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:34:43.888716 27854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/ts-1/data/instance:
uuid: "fecc17bd213844628f98bd6ff3251e30"
format_stamp: "Formatted at 2026-08-08 14:34:43 on dist-test-slave-twwt"
server_key: "2f60c4fb94671b08a973e6a81e2c9503"
server_key_iv: "2402bba28322b184003bf8fb55a2e4e9"
server_key_version: "encryptionkey@0"
I20260808 14:34:43.889312 27854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/ts-1/wal/instance:
uuid: "fecc17bd213844628f98bd6ff3251e30"
format_stamp: "Formatted at 2026-08-08 14:34:43 on dist-test-slave-twwt"
server_key: "2f60c4fb94671b08a973e6a81e2c9503"
server_key_iv: "2402bba28322b184003bf8fb55a2e4e9"
server_key_version: "encryptionkey@0"
I20260808 14:34:43.893195 27854 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 14:34:43.895843 27877 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:43.897145 27854 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 14:34:43.897294 27854 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/ts-1/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/ts-1/wal
uuid: "fecc17bd213844628f98bd6ff3251e30"
format_stamp: "Formatted at 2026-08-08 14:34:43 on dist-test-slave-twwt"
server_key: "2f60c4fb94671b08a973e6a81e2c9503"
server_key_iv: "2402bba28322b184003bf8fb55a2e4e9"
server_key_version: "encryptionkey@0"
I20260808 14:34:43.897429 27854 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:34:43.939289 27854 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:34:43.942389 27854 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:34:43.942649 27854 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:34:43.943336 27854 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:34:43.944306 27854 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:34:43.944382 27854 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:43.944459 27854 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:34:43.944511 27854 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:43.955734 27854 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.194:39871
I20260808 14:34:43.955993 28043 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.194:39871 every 8 connection(s)
I20260808 14:34:43.956875 27854 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
I20260808 14:34:43.966216 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 27854
I20260808 14:34:43.966346 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/ts-1/wal/instance
I20260808 14:34:43.966718 11791 external_mini_cluster.cc:1428] Setting key 054aeed1be4d31228359cc823406bf29
Aug 08 14:34:43 dist-test-slave-twwt krb5kdc[27492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199683, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.194@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:34:43.971292 27603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:43.959011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:55509 (local address 127.11.131.254:37831)
0808 14:34:43.959157 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:43.959161 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:43.960124 (+ 963us) server_negotiation.cc:407] Connection header received
0808 14:34:43.961576 (+ 1452us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:43.961579 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:43.961627 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:43.961704 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:43.962970 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:43.963484 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:43.964581 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:43.964791 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:43.964863 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:43.967393 (+ 2530us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:43.967397 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:43.967400 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:43.967428 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:43.969104 (+ 1676us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:43.969612 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:43.969618 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:43.969622 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:43.969720 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:43.970050 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:43.970056 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:43.970060 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:43.970320 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:43.970428 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:43.970993 (+ 565us) server_negotiation.cc:299] Negotiation successful
0808 14:34:43.971121 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 14:34:43.972177 28047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:43.959486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:37831 (local address 127.11.131.194:55509)
0808 14:34:43.959969 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:43.960014 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:43.961375 (+ 1361us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:43.961878 (+ 503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:43.961885 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:43.962259 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:43.962837 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:43.962853 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:43.963593 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:43.963595 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:43.964475 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:43.964484 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:43.964922 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:43.964925 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:43.965064 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:43.965605 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:43.965622 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:43.967234 (+ 1612us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:43.969227 (+ 1993us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:43.969231 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:43.969244 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:43.969508 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:43.969817 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:43.969820 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:43.969821 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:43.969956 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:43.970426 (+ 470us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:43.970431 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:43.970726 (+ 295us) client_negotiation.cc:769] Sending connection context
0808 14:34:43.970929 (+ 203us) client_negotiation.cc:240] Negotiation successful
0808 14:34:43.971263 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":152,"threads_started":1}
I20260808 14:34:43.973536 28045 heartbeater.cc:347] Connected to a master server at 127.11.131.254:37831
I20260808 14:34:43.973789 28045 heartbeater.cc:464] Registering TS with master...
I20260808 14:34:43.974308 28045 heartbeater.cc:511] Master 127.11.131.254:37831 requested a full tablet report, sending...
I20260808 14:34:43.975574 27553 ts_manager.cc:194] Registered new tserver with Master: fecc17bd213844628f98bd6ff3251e30 (127.11.131.194:39871)
I20260808 14:34:43.976472 27553 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.194@KRBTEST.COM'} at 127.11.131.194:55509
WARNING: no policy specified for kudu/127.11.131.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab.
Entry for principal kudu/127.11.131.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab.
I20260808 14:34:43.997170 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.195:0
--local_ip_for_outbound_sockets=127.11.131.195
--webserver_interface=127.11.131.195
--webserver_port=0
--tserver_master_addrs=127.11.131.254:37831
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab
--principal=kudu/127.11.131.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:40519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:34:44.116580 28054 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:34:44.116842 28054 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:34:44.116884 28054 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:34:44.120765 28054 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:34:44.120821 28054 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:34:44.120877 28054 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.195
I20260808 14:34:44.125921 28054 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:40519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab
--principal=kudu/127.11.131.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.131.195
--webserver_port=0
--tserver_master_addrs=127.11.131.254:37831
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28054
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.195
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:34:44.126915 28054 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:34:44.127864 28054 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:34:44.137777 28067 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:44.137791 28064 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:34:44.137784 28065 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:34:44.138170 28054 server_base.cc:1034] running on GCE node
I20260808 14:34:44.138690 28054 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:34:44.139371 28054 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:34:44.140568 28054 hybrid_clock.cc:648] HybridClock initialized: now 1786199684140551 us; error 28 us; skew 500 ppm
Aug 08 14:34:44 dist-test-slave-twwt krb5kdc[27492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199684, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:34:44.143390 28054 init.cc:377] Logged in from keytab as kudu/127.11.131.195@KRBTEST.COM (short username kudu)
I20260808 14:34:44.144320 28054 webserver.cc:460] Webserver started at http://127.11.131.195:42053/ using document root <none> and password file <none>
I20260808 14:34:44.144862 28054 fs_manager.cc:359] Metadata directory not provided
I20260808 14:34:44.144930 28054 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:34:44.145103 28054 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:34:44.147198 28054 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/ts-2/data/instance:
uuid: "1b8e7e8c9159416b87b8d3c7df2145d3"
format_stamp: "Formatted at 2026-08-08 14:34:44 on dist-test-slave-twwt"
server_key: "746151f98d79fd24ad99225feb6483dc"
server_key_iv: "ea52ff1da77ab95f27f781af045d451d"
server_key_version: "encryptionkey@0"
I20260808 14:34:44.147730 28054 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/ts-2/wal/instance:
uuid: "1b8e7e8c9159416b87b8d3c7df2145d3"
format_stamp: "Formatted at 2026-08-08 14:34:44 on dist-test-slave-twwt"
server_key: "746151f98d79fd24ad99225feb6483dc"
server_key_iv: "ea52ff1da77ab95f27f781af045d451d"
server_key_version: "encryptionkey@0"
I20260808 14:34:44.151535 28054 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 14:34:44.153987 28074 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:44.155386 28054 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 14:34:44.155509 28054 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/ts-2/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/ts-2/wal
uuid: "1b8e7e8c9159416b87b8d3c7df2145d3"
format_stamp: "Formatted at 2026-08-08 14:34:44 on dist-test-slave-twwt"
server_key: "746151f98d79fd24ad99225feb6483dc"
server_key_iv: "ea52ff1da77ab95f27f781af045d451d"
server_key_version: "encryptionkey@0"
I20260808 14:34:44.155622 28054 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:34:44.178382 28054 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:34:44.181655 28054 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:34:44.181881 28054 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:34:44.182547 28054 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:34:44.183476 28054 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:34:44.183527 28054 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:44.183568 28054 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:34:44.183625 28054 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:34:44.193606 28054 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.195:37461
I20260808 14:34:44.193630 28263 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.195:37461 every 8 connection(s)
I20260808 14:34:44.194564 28054 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
I20260808 14:34:44.194878 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 28054
I20260808 14:34:44.195021 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/ts-2/wal/instance
I20260808 14:34:44.195439 11791 external_mini_cluster.cc:1428] Setting key 5e4b7bd3a753d70e87b30875c14ea9f6
Aug 08 14:34:44 dist-test-slave-twwt krb5kdc[27492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199684, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.195@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:34:44.208541 27603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:44.196759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:35425 (local address 127.11.131.254:37831)
0808 14:34:44.197014 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:44.197018 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:44.197971 (+ 953us) server_negotiation.cc:407] Connection header received
0808 14:34:44.199481 (+ 1510us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:44.199484 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:44.199530 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:44.199597 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:44.200830 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:44.201349 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:44.202575 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:44.202845 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:44.202936 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:44.205307 (+ 2371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:44.205310 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:44.205313 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:44.205337 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:44.206684 (+ 1347us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:44.207155 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:44.207158 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:44.207159 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:44.207237 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:44.207541 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:44.207543 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:44.207545 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:44.207712 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:44.207788 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:44.208255 (+ 467us) server_negotiation.cc:299] Negotiation successful
0808 14:34:44.208370 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158}
I20260808 14:34:44.209481 28268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:44.197306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:37831 (local address 127.11.131.195:35425)
0808 14:34:44.197815 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:44.197870 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:44.199289 (+ 1419us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:44.199771 (+ 482us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:44.199777 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:44.200145 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:34:44.200718 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:44.200734 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:44.201458 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:44.201461 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:44.202468 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:44.202478 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:44.202976 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:44.202978 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:44.203127 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:44.203694 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:34:44.203710 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:34:44.205154 (+ 1444us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:34:44.206789 (+ 1635us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:44.206794 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:44.206809 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:44.207069 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:44.207321 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:34:44.207323 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:34:44.207324 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:34:44.207460 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:34:44.207799 (+ 339us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:34:44.207804 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:34:44.208026 (+ 222us) client_negotiation.cc:769] Sending connection context
0808 14:34:44.208176 (+ 150us) client_negotiation.cc:240] Negotiation successful
0808 14:34:44.208526 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":149,"threads_started":1}
I20260808 14:34:44.210632 28266 heartbeater.cc:347] Connected to a master server at 127.11.131.254:37831
I20260808 14:34:44.210898 28266 heartbeater.cc:464] Registering TS with master...
I20260808 14:34:44.211373 28266 heartbeater.cc:511] Master 127.11.131.254:37831 requested a full tablet report, sending...
I20260808 14:34:44.212438 27553 ts_manager.cc:194] Registered new tserver with Master: 1b8e7e8c9159416b87b8d3c7df2145d3 (127.11.131.195:37461)
I20260808 14:34:44.213135 27553 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.195@KRBTEST.COM'} at 127.11.131.195:35425
I20260808 14:34:44.221598 11791 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:34:44.231225 27603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:44.223758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49312 (local address 127.11.131.254:37831)
0808 14:34:44.223910 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:44.223913 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:44.224065 (+ 152us) server_negotiation.cc:407] Connection header received
0808 14:34:44.224229 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:44.224232 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:44.224275 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:44.224343 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:34:44.225197 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:44.225733 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:44.226539 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:44.226812 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:44.226893 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:44.228201 (+ 1308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:34:44.228204 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:34:44.228206 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:34:44.228247 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:34:44.229709 (+ 1462us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:44.230090 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:44.230092 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:44.230093 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:44.230168 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:34:44.230419 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:34:44.230421 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:34:44.230422 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:34:44.230691 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:34:44.230797 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:44.231007 (+ 210us) server_negotiation.cc:299] Negotiation successful
0808 14:34:44.231106 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 14:34:44.234045 27553 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49312:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:34:44.237396 27553 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:34:44.252635 28279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:44.246331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39420 (local address 127.11.131.194:39871)
0808 14:34:44.246832 (+ 501us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:44.246848 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:44.246877 (+ 29us) server_negotiation.cc:407] Connection header received
0808 14:34:44.247253 (+ 376us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:44.247260 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:44.247507 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:44.248488 (+ 981us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:34:44.248678 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:44.249485 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:44.251127 (+ 1642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:44.251911 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:44.252074 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:44.252235 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:44.252361 (+ 126us) server_negotiation.cc:299] Negotiation successful
0808 14:34:44.252462 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":332,"thread_start_us":182,"threads_started":1}
I20260808 14:34:44.252628 28278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:44.246167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.194:39871 (local address 127.0.0.1:39420)
0808 14:34:44.246584 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:44.246674 (+ 90us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:44.246996 (+ 322us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:44.248145 (+ 1149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:44.248152 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:44.248176 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:34:44.248357 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:44.248366 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:44.249620 (+ 1254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:44.249626 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:44.250997 (+ 1371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:44.251008 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:44.252062 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:44.252066 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:44.252172 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:44.252211 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 14:34:44.252334 (+ 123us) client_negotiation.cc:240] Negotiation successful
0808 14:34:44.252477 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":107,"threads_started":1}
I20260808 14:34:44.253149 28280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:44.247004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.195:37461 (local address 127.0.0.1:49184)
0808 14:34:44.247255 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:44.247271 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:44.247359 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:44.248366 (+ 1007us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:44.248370 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:44.248388 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:34:44.248512 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:44.248518 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:44.250036 (+ 1518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:44.250039 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:44.251190 (+ 1151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:44.251198 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:44.252186 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:44.252190 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:44.252281 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:44.252323 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 14:34:44.252377 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 14:34:44.253024 (+ 647us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":183,"mutex_wait_us":541,"thread_start_us":122,"threads_started":1}
I20260808 14:34:44.253156 28281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:44.247198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49184 (local address 127.11.131.195:37461)
0808 14:34:44.247871 (+ 673us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:44.247885 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:44.247911 (+ 26us) server_negotiation.cc:407] Connection header received
0808 14:34:44.247992 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:44.247997 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:44.248198 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:44.248374 (+ 176us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:34:44.248648 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:44.249880 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:44.251325 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:44.252038 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:44.252504 (+ 466us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:44.252643 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:44.252888 (+ 245us) server_negotiation.cc:299] Negotiation successful
0808 14:34:44.252996 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":564,"thread_start_us":168,"threads_started":1}
I20260808 14:34:44.253564 28282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:44.247364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:39291 (local address 127.0.0.1:51394)
0808 14:34:44.247585 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:44.247597 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:44.247674 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:44.248572 (+ 898us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:44.248575 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:44.248591 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:34:44.248667 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:44.248673 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:44.250067 (+ 1394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:44.250072 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:44.251521 (+ 1449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:44.251532 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:44.253003 (+ 1471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:44.253010 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:44.253100 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:44.253123 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 14:34:44.253203 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 14:34:44.253437 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":100,"threads_started":1}
I20260808 14:34:44.253973 28285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:44.247746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51394 (local address 127.11.131.193:39291)
0808 14:34:44.248063 (+ 317us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:44.248072 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:44.248095 (+ 23us) server_negotiation.cc:407] Connection header received
0808 14:34:44.248171 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:44.248175 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:44.248366 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:44.248509 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:34:44.248794 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:44.249902 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:44.251652 (+ 1750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:44.252461 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:44.252569 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:44.252671 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:44.253529 (+ 858us) server_negotiation.cc:299] Negotiation successful
0808 14:34:44.253817 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":207,"thread_start_us":119,"threads_started":1}
I20260808 14:34:44.256202 27954 tablet_service.cc:1467] Processing CreateTablet for tablet ae8a16e3eacb46b9ae935da41ff3be00 (DEFAULT_TABLE table=test-table [id=eed25ef261b249de9207ee1c7e62ad13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:34:44.256192 28155 tablet_service.cc:1467] Processing CreateTablet for tablet ae8a16e3eacb46b9ae935da41ff3be00 (DEFAULT_TABLE table=test-table [id=eed25ef261b249de9207ee1c7e62ad13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:34:44.257452 28155 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae8a16e3eacb46b9ae935da41ff3be00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:34:44.257447 27954 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae8a16e3eacb46b9ae935da41ff3be00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:34:44.257319 27743 tablet_service.cc:1467] Processing CreateTablet for tablet ae8a16e3eacb46b9ae935da41ff3be00 (DEFAULT_TABLE table=test-table [id=eed25ef261b249de9207ee1c7e62ad13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:34:44.258302 27743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae8a16e3eacb46b9ae935da41ff3be00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:34:44.264652 28286 tablet_bootstrap.cc:492] T ae8a16e3eacb46b9ae935da41ff3be00 P 1b8e7e8c9159416b87b8d3c7df2145d3: Bootstrap starting.
I20260808 14:34:44.265368 28287 tablet_bootstrap.cc:492] T ae8a16e3eacb46b9ae935da41ff3be00 P 1ef49472405e473f9daa1e8ef698ac62: Bootstrap starting.
I20260808 14:34:44.266952 28289 tablet_bootstrap.cc:492] T ae8a16e3eacb46b9ae935da41ff3be00 P fecc17bd213844628f98bd6ff3251e30: Bootstrap starting.
I20260808 14:34:44.267892 28287 tablet_bootstrap.cc:654] T ae8a16e3eacb46b9ae935da41ff3be00 P 1ef49472405e473f9daa1e8ef698ac62: Neither blocks nor log segments found. Creating new log.
I20260808 14:34:44.268180 28286 tablet_bootstrap.cc:654] T ae8a16e3eacb46b9ae935da41ff3be00 P 1b8e7e8c9159416b87b8d3c7df2145d3: Neither blocks nor log segments found. Creating new log.
I20260808 14:34:44.268880 28287 log.cc:824] T ae8a16e3eacb46b9ae935da41ff3be00 P 1ef49472405e473f9daa1e8ef698ac62: Log is configured to *not* fsync() on all Append() calls
I20260808 14:34:44.269390 28289 tablet_bootstrap.cc:654] T ae8a16e3eacb46b9ae935da41ff3be00 P fecc17bd213844628f98bd6ff3251e30: Neither blocks nor log segments found. Creating new log.
I20260808 14:34:44.270161 28289 log.cc:824] T ae8a16e3eacb46b9ae935da41ff3be00 P fecc17bd213844628f98bd6ff3251e30: Log is configured to *not* fsync() on all Append() calls
I20260808 14:34:44.270251 28286 log.cc:824] T ae8a16e3eacb46b9ae935da41ff3be00 P 1b8e7e8c9159416b87b8d3c7df2145d3: Log is configured to *not* fsync() on all Append() calls
I20260808 14:34:44.271344 28287 tablet_bootstrap.cc:492] T ae8a16e3eacb46b9ae935da41ff3be00 P 1ef49472405e473f9daa1e8ef698ac62: No bootstrap required, opened a new log
I20260808 14:34:44.271550 28287 ts_tablet_manager.cc:1397] T ae8a16e3eacb46b9ae935da41ff3be00 P 1ef49472405e473f9daa1e8ef698ac62: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 14:34:44.272063 28289 tablet_bootstrap.cc:492] T ae8a16e3eacb46b9ae935da41ff3be00 P fecc17bd213844628f98bd6ff3251e30: No bootstrap required, opened a new log
I20260808 14:34:44.272270 28289 ts_tablet_manager.cc:1397] T ae8a16e3eacb46b9ae935da41ff3be00 P fecc17bd213844628f98bd6ff3251e30: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 14:34:44.272311 28286 tablet_bootstrap.cc:492] T ae8a16e3eacb46b9ae935da41ff3be00 P 1b8e7e8c9159416b87b8d3c7df2145d3: No bootstrap required, opened a new log
I20260808 14:34:44.272497 28286 ts_tablet_manager.cc:1397] T ae8a16e3eacb46b9ae935da41ff3be00 P 1b8e7e8c9159416b87b8d3c7df2145d3: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20260808 14:34:44.275256 28289 raft_consensus.cc:348] T ae8a16e3eacb46b9ae935da41ff3be00 P fecc17bd213844628f98bd6ff3251e30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fecc17bd213844628f98bd6ff3251e30" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 39871 } } peers { permanent_uuid: "1b8e7e8c9159416b87b8d3c7df2145d3" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 37461 } } peers { permanent_uuid: "1ef49472405e473f9daa1e8ef698ac62" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 39291 } }
I20260808 14:34:44.275542 28289 raft_consensus.cc:374] T ae8a16e3eacb46b9ae935da41ff3be00 P fecc17bd213844628f98bd6ff3251e30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:34:44.275606 28289 raft_consensus.cc:729] T ae8a16e3eacb46b9ae935da41ff3be00 P fecc17bd213844628f98bd6ff3251e30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fecc17bd213844628f98bd6ff3251e30, State: Initialized, Role: FOLLOWER
I20260808 14:34:44.276192 28289 consensus_queue.cc:260] T ae8a16e3eacb46b9ae935da41ff3be00 P fecc17bd213844628f98bd6ff3251e30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fecc17bd213844628f98bd6ff3251e30" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 39871 } } peers { permanent_uuid: "1b8e7e8c9159416b87b8d3c7df2145d3" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 37461 } } peers { permanent_uuid: "1ef49472405e473f9daa1e8ef698ac62" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 39291 } }
I20260808 14:34:44.276525 28287 raft_consensus.cc:348] T ae8a16e3eacb46b9ae935da41ff3be00 P 1ef49472405e473f9daa1e8ef698ac62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fecc17bd213844628f98bd6ff3251e30" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 39871 } } peers { permanent_uuid: "1b8e7e8c9159416b87b8d3c7df2145d3" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 37461 } } peers { permanent_uuid: "1ef49472405e473f9daa1e8ef698ac62" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 39291 } }
I20260808 14:34:44.276804 28287 raft_consensus.cc:374] T ae8a16e3eacb46b9ae935da41ff3be00 P 1ef49472405e473f9daa1e8ef698ac62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:34:44.276882 28287 raft_consensus.cc:729] T ae8a16e3eacb46b9ae935da41ff3be00 P 1ef49472405e473f9daa1e8ef698ac62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef49472405e473f9daa1e8ef698ac62, State: Initialized, Role: FOLLOWER
I20260808 14:34:44.277020 28045 heartbeater.cc:503] Master 127.11.131.254:37831 was elected leader, sending a full tablet report...
I20260808 14:34:44.277320 28289 ts_tablet_manager.cc:1428] T ae8a16e3eacb46b9ae935da41ff3be00 P fecc17bd213844628f98bd6ff3251e30: Time spent starting tablet: real 0.005s user 0.000s sys 0.006s
I20260808 14:34:44.277334 28287 consensus_queue.cc:260] T ae8a16e3eacb46b9ae935da41ff3be00 P 1ef49472405e473f9daa1e8ef698ac62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fecc17bd213844628f98bd6ff3251e30" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 39871 } } peers { permanent_uuid: "1b8e7e8c9159416b87b8d3c7df2145d3" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 37461 } } peers { permanent_uuid: "1ef49472405e473f9daa1e8ef698ac62" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 39291 } }
I20260808 14:34:44.277989 27845 heartbeater.cc:503] Master 127.11.131.254:37831 was elected leader, sending a full tablet report...
I20260808 14:34:44.278342 28287 ts_tablet_manager.cc:1428] T ae8a16e3eacb46b9ae935da41ff3be00 P 1ef49472405e473f9daa1e8ef698ac62: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260808 14:34:44.278453 28286 raft_consensus.cc:348] T ae8a16e3eacb46b9ae935da41ff3be00 P 1b8e7e8c9159416b87b8d3c7df2145d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fecc17bd213844628f98bd6ff3251e30" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 39871 } } peers { permanent_uuid: "1b8e7e8c9159416b87b8d3c7df2145d3" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 37461 } } peers { permanent_uuid: "1ef49472405e473f9daa1e8ef698ac62" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 39291 } }
I20260808 14:34:44.278736 28286 raft_consensus.cc:374] T ae8a16e3eacb46b9ae935da41ff3be00 P 1b8e7e8c9159416b87b8d3c7df2145d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:34:44.278815 28286 raft_consensus.cc:729] T ae8a16e3eacb46b9ae935da41ff3be00 P 1b8e7e8c9159416b87b8d3c7df2145d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b8e7e8c9159416b87b8d3c7df2145d3, State: Initialized, Role: FOLLOWER
I20260808 14:34:44.279235 28286 consensus_queue.cc:260] T ae8a16e3eacb46b9ae935da41ff3be00 P 1b8e7e8c9159416b87b8d3c7df2145d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fecc17bd213844628f98bd6ff3251e30" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 39871 } } peers { permanent_uuid: "1b8e7e8c9159416b87b8d3c7df2145d3" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 37461 } } peers { permanent_uuid: "1ef49472405e473f9daa1e8ef698ac62" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 39291 } }
I20260808 14:34:44.279928 28266 heartbeater.cc:503] Master 127.11.131.254:37831 was elected leader, sending a full tablet report...
I20260808 14:34:44.280265 28286 ts_tablet_manager.cc:1428] T ae8a16e3eacb46b9ae935da41ff3be00 P 1b8e7e8c9159416b87b8d3c7df2145d3: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260808 14:34:44.369777 28295 raft_consensus.cc:482] T ae8a16e3eacb46b9ae935da41ff3be00 P fecc17bd213844628f98bd6ff3251e30 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:34:44.369992 28295 raft_consensus.cc:504] T ae8a16e3eacb46b9ae935da41ff3be00 P fecc17bd213844628f98bd6ff3251e30 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fecc17bd213844628f98bd6ff3251e30" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 39871 } } peers { permanent_uuid: "1b8e7e8c9159416b87b8d3c7df2145d3" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 37461 } } peers { permanent_uuid: "1ef49472405e473f9daa1e8ef698ac62" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 39291 } }
I20260808 14:34:44.371201 28295 leader_election.cc:288] T ae8a16e3eacb46b9ae935da41ff3be00 P fecc17bd213844628f98bd6ff3251e30 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b8e7e8c9159416b87b8d3c7df2145d3 (127.11.131.195:37461), 1ef49472405e473f9daa1e8ef698ac62 (127.11.131.193:39291)
I20260808 14:34:44.375006 28281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:44.371567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:55639 (local address 127.11.131.195:37461)
0808 14:34:44.371705 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:44.371708 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:44.371725 (+ 17us) server_negotiation.cc:407] Connection header received
0808 14:34:44.371874 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:44.371877 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:44.371942 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:44.372075 (+ 133us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:34:44.372376 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:44.372920 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:44.373990 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:44.374407 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:44.374538 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:44.374597 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:44.374822 (+ 225us) server_negotiation.cc:299] Negotiation successful
0808 14:34:44.374899 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 14:34:44.375006 28047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:44.371446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.195:37461 (local address 127.11.131.194:55639)
0808 14:34:44.371597 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:44.371615 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:44.371740 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:44.372088 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:44.372092 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:44.372113 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:34:44.372250 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:44.372257 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:44.373047 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:44.373052 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:44.373853 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:44.373863 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:44.374528 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:44.374532 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:44.374674 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:44.374695 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 14:34:44.374789 (+ 94us) client_negotiation.cc:240] Negotiation successful
0808 14:34:44.374867 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60}
I20260808 14:34:44.375612 28285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:44.372071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:55651 (local address 127.11.131.193:39291)
0808 14:34:44.372211 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:44.372216 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:44.372443 (+ 227us) server_negotiation.cc:407] Connection header received
0808 14:34:44.372566 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:44.372574 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:44.372620 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:44.372721 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:34:44.373023 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:44.373507 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:44.374526 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:44.374999 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:44.375133 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:44.375183 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:44.375429 (+ 246us) server_negotiation.cc:299] Negotiation successful
0808 14:34:44.375519 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 14:34:44.375617 28298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:44.371850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:39291 (local address 127.11.131.194:55651)
0808 14:34:44.372337 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:44.372348 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:34:44.372464 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:34:44.372735 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:34:44.372738 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:34:44.372756 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:34:44.372884 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:44.372890 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:44.373623 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:44.373628 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:44.374389 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:34:44.374398 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:34:44.375138 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:34:44.375141 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:34:44.375252 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:44.375280 (+ 28us) client_negotiation.cc:769] Sending connection context
0808 14:34:44.375395 (+ 115us) client_negotiation.cc:240] Negotiation successful
0808 14:34:44.375478 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":426,"thread_start_us":169,"threads_started":1}
I20260808 14:34:44.375779 28185 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae8a16e3eacb46b9ae935da41ff3be00" candidate_uuid: "fecc17bd213844628f98bd6ff3251e30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b8e7e8c9159416b87b8d3c7df2145d3" is_pre_election: true
I20260808 14:34:44.376180 28185 raft_consensus.cc:2454] T ae8a16e3eacb46b9ae935da41ff3be00 P 1b8e7e8c9159416b87b8d3c7df2145d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fecc17bd213844628f98bd6ff3251e30 in term 0.
I20260808 14:34:44.376398 27777 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae8a16e3eacb46b9ae935da41ff3be00" candidate_uuid: "fecc17bd213844628f98bd6ff3251e30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef49472405e473f9daa1e8ef698ac62" is_pre_election: true
I20260808 14:34:44.376663 27777 raft_consensus.cc:2454] T ae8a16e3eacb46b9ae935da41ff3be00 P 1ef49472405e473f9daa1e8ef698ac62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fecc17bd213844628f98bd6ff3251e30 in term 0.
I20260808 14:34:44.376690 27882 leader_election.cc:302] T ae8a16e3eacb46b9ae935da41ff3be00 P fecc17bd213844628f98bd6ff3251e30 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b8e7e8c9159416b87b8d3c7df2145d3, fecc17bd213844628f98bd6ff3251e30; no voters:
I20260808 14:34:44.376977 28295 raft_consensus.cc:2781] T ae8a16e3eacb46b9ae935da41ff3be00 P fecc17bd213844628f98bd6ff3251e30 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:34:44.377079 28295 raft_consensus.cc:482] T ae8a16e3eacb46b9ae935da41ff3be00 P fecc17bd213844628f98bd6ff3251e30 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:34:44.377140 28295 raft_consensus.cc:3037] T ae8a16e3eacb46b9ae935da41ff3be00 P fecc17bd213844628f98bd6ff3251e30 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:34:44.378206 28295 raft_consensus.cc:504] T ae8a16e3eacb46b9ae935da41ff3be00 P fecc17bd213844628f98bd6ff3251e30 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fecc17bd213844628f98bd6ff3251e30" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 39871 } } peers { permanent_uuid: "1b8e7e8c9159416b87b8d3c7df2145d3" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 37461 } } peers { permanent_uuid: "1ef49472405e473f9daa1e8ef698ac62" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 39291 } }
I20260808 14:34:44.378561 28295 leader_election.cc:288] T ae8a16e3eacb46b9ae935da41ff3be00 P fecc17bd213844628f98bd6ff3251e30 [CANDIDATE]: Term 1 election: Requested vote from peers 1b8e7e8c9159416b87b8d3c7df2145d3 (127.11.131.195:37461), 1ef49472405e473f9daa1e8ef698ac62 (127.11.131.193:39291)
I20260808 14:34:44.378980 28185 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae8a16e3eacb46b9ae935da41ff3be00" candidate_uuid: "fecc17bd213844628f98bd6ff3251e30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b8e7e8c9159416b87b8d3c7df2145d3"
I20260808 14:34:44.379020 27777 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae8a16e3eacb46b9ae935da41ff3be00" candidate_uuid: "fecc17bd213844628f98bd6ff3251e30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef49472405e473f9daa1e8ef698ac62"
I20260808 14:34:44.379088 28185 raft_consensus.cc:3037] T ae8a16e3eacb46b9ae935da41ff3be00 P 1b8e7e8c9159416b87b8d3c7df2145d3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:34:44.379163 27777 raft_consensus.cc:3037] T ae8a16e3eacb46b9ae935da41ff3be00 P 1ef49472405e473f9daa1e8ef698ac62 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:34:44.380230 28185 raft_consensus.cc:2454] T ae8a16e3eacb46b9ae935da41ff3be00 P 1b8e7e8c9159416b87b8d3c7df2145d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fecc17bd213844628f98bd6ff3251e30 in term 1.
I20260808 14:34:44.380404 27777 raft_consensus.cc:2454] T ae8a16e3eacb46b9ae935da41ff3be00 P 1ef49472405e473f9daa1e8ef698ac62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fecc17bd213844628f98bd6ff3251e30 in term 1.
I20260808 14:34:44.380533 27882 leader_election.cc:302] T ae8a16e3eacb46b9ae935da41ff3be00 P fecc17bd213844628f98bd6ff3251e30 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b8e7e8c9159416b87b8d3c7df2145d3, fecc17bd213844628f98bd6ff3251e30; no voters:
I20260808 14:34:44.380714 28295 raft_consensus.cc:2781] T ae8a16e3eacb46b9ae935da41ff3be00 P fecc17bd213844628f98bd6ff3251e30 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:34:44.380980 28295 raft_consensus.cc:686] T ae8a16e3eacb46b9ae935da41ff3be00 P fecc17bd213844628f98bd6ff3251e30 [term 1 LEADER]: Becoming Leader. State: Replica: fecc17bd213844628f98bd6ff3251e30, State: Running, Role: LEADER
I20260808 14:34:44.381319 28295 consensus_queue.cc:237] T ae8a16e3eacb46b9ae935da41ff3be00 P fecc17bd213844628f98bd6ff3251e30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fecc17bd213844628f98bd6ff3251e30" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 39871 } } peers { permanent_uuid: "1b8e7e8c9159416b87b8d3c7df2145d3" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 37461 } } peers { permanent_uuid: "1ef49472405e473f9daa1e8ef698ac62" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 39291 } }
I20260808 14:34:44.384994 27550 catalog_manager.cc:5495] T ae8a16e3eacb46b9ae935da41ff3be00 P fecc17bd213844628f98bd6ff3251e30 reported cstate change: term changed from 0 to 1, leader changed from <none> to fecc17bd213844628f98bd6ff3251e30 (127.11.131.194). New cstate: current_term: 1 leader_uuid: "fecc17bd213844628f98bd6ff3251e30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fecc17bd213844628f98bd6ff3251e30" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 39871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b8e7e8c9159416b87b8d3c7df2145d3" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 37461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef49472405e473f9daa1e8ef698ac62" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 39291 } health_report { overall_health: UNKNOWN } } }
I20260808 14:34:44.406385 28279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:44.402130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39434 (local address 127.11.131.194:39871)
0808 14:34:44.402289 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 14:34:44.402296 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:34:44.402377 (+ 81us) server_negotiation.cc:407] Connection header received
0808 14:34:44.402585 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:34:44.402589 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:34:44.402739 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:34:44.402874 (+ 135us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:34:44.403163 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:44.403735 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:44.404726 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:34:44.404972 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:34:44.405095 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:34:44.405462 (+ 367us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:34:44.405921 (+ 459us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:34:44.406073 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0808 14:34:44.406148 (+ 75us) server_negotiation.cc:299] Negotiation successful
0808 14:34:44.406214 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 14:34:44.412954 28185 raft_consensus.cc:1261] T ae8a16e3eacb46b9ae935da41ff3be00 P 1b8e7e8c9159416b87b8d3c7df2145d3 [term 1 FOLLOWER]: Refusing update from remote peer fecc17bd213844628f98bd6ff3251e30: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:34:44.413040 27777 raft_consensus.cc:1261] T ae8a16e3eacb46b9ae935da41ff3be00 P 1ef49472405e473f9daa1e8ef698ac62 [term 1 FOLLOWER]: Refusing update from remote peer fecc17bd213844628f98bd6ff3251e30: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:34:44.413852 28295 consensus_queue.cc:1035] T ae8a16e3eacb46b9ae935da41ff3be00 P fecc17bd213844628f98bd6ff3251e30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b8e7e8c9159416b87b8d3c7df2145d3" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 37461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:34:44.414098 28299 consensus_queue.cc:1035] T ae8a16e3eacb46b9ae935da41ff3be00 P fecc17bd213844628f98bd6ff3251e30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef49472405e473f9daa1e8ef698ac62" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 39291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:34:44.422456 28308 mvcc.cc:205] Tried to move back new op lower bound from 7316273907346452480 to 7316273907228712960. Current Snapshot: MvccSnapshot[applied={T|T < 7316273907346452480}]
I20260808 14:34:44.423286 28303 mvcc.cc:205] Tried to move back new op lower bound from 7316273907346452480 to 7316273907228712960. Current Snapshot: MvccSnapshot[applied={T|T < 7316273907346452480}]
I20260808 14:34:44.423794 28305 mvcc.cc:205] Tried to move back new op lower bound from 7316273907346452480 to 7316273907228712960. Current Snapshot: MvccSnapshot[applied={T|T < 7316273907346452480}]
I20260808 14:34:44.432796 27553 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49312:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:34:44.432955 27553 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49312:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:34:44.435530 27553 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 77557a35fbb041b3a4ab0407de534efe: Sending DeleteTablet for 3 replicas of tablet ae8a16e3eacb46b9ae935da41ff3be00
I20260808 14:34:44.436312 27954 tablet_service.cc:1514] Processing DeleteTablet for tablet ae8a16e3eacb46b9ae935da41ff3be00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:34:44 UTC) from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:39420
I20260808 14:34:44.436434 28155 tablet_service.cc:1514] Processing DeleteTablet for tablet ae8a16e3eacb46b9ae935da41ff3be00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:34:44 UTC) from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:49184
I20260808 14:34:44.436564 27743 tablet_service.cc:1514] Processing DeleteTablet for tablet ae8a16e3eacb46b9ae935da41ff3be00 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:34:44 UTC) from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:51394
I20260808 14:34:44.436861 28322 tablet_replica.cc:330] T ae8a16e3eacb46b9ae935da41ff3be00 P fecc17bd213844628f98bd6ff3251e30: stopping tablet replica
I20260808 14:34:44.437036 28325 tablet_replica.cc:330] T ae8a16e3eacb46b9ae935da41ff3be00 P 1ef49472405e473f9daa1e8ef698ac62: stopping tablet replica
I20260808 14:34:44.437175 28322 raft_consensus.cc:2229] T ae8a16e3eacb46b9ae935da41ff3be00 P fecc17bd213844628f98bd6ff3251e30 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:34:44.437354 28325 raft_consensus.cc:2229] T ae8a16e3eacb46b9ae935da41ff3be00 P 1ef49472405e473f9daa1e8ef698ac62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:34:44.437371 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 27633
I20260808 14:34:44.437614 28322 raft_consensus.cc:2258] T ae8a16e3eacb46b9ae935da41ff3be00 P fecc17bd213844628f98bd6ff3251e30 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:34:44.437683 28325 raft_consensus.cc:2258] T ae8a16e3eacb46b9ae935da41ff3be00 P 1ef49472405e473f9daa1e8ef698ac62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:34:44.439097 28322 ts_tablet_manager.cc:1905] T ae8a16e3eacb46b9ae935da41ff3be00 P fecc17bd213844628f98bd6ff3251e30: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:34:44.442078 28322 ts_tablet_manager.cc:1918] T ae8a16e3eacb46b9ae935da41ff3be00 P fecc17bd213844628f98bd6ff3251e30: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:34:44.442169 28322 log.cc:1196] T ae8a16e3eacb46b9ae935da41ff3be00 P fecc17bd213844628f98bd6ff3251e30: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/ts-1/wal/wals/ae8a16e3eacb46b9ae935da41ff3be00
I20260808 14:34:44.442497 28322 ts_tablet_manager.cc:1939] T ae8a16e3eacb46b9ae935da41ff3be00 P fecc17bd213844628f98bd6ff3251e30: Deleting consensus metadata
I20260808 14:34:44.443812 28324 tablet_replica.cc:330] T ae8a16e3eacb46b9ae935da41ff3be00 P 1b8e7e8c9159416b87b8d3c7df2145d3: stopping tablet replica
I20260808 14:34:44.444144 28324 raft_consensus.cc:2229] T ae8a16e3eacb46b9ae935da41ff3be00 P 1b8e7e8c9159416b87b8d3c7df2145d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:34:44.444478 28324 raft_consensus.cc:2258] T ae8a16e3eacb46b9ae935da41ff3be00 P 1b8e7e8c9159416b87b8d3c7df2145d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:34:44.446709 27533 catalog_manager.cc:4841] TS fecc17bd213844628f98bd6ff3251e30 (127.11.131.194:39871): tablet ae8a16e3eacb46b9ae935da41ff3be00 (table test-table [id=eed25ef261b249de9207ee1c7e62ad13]) successfully deleted
I20260808 14:34:44.446820 28324 ts_tablet_manager.cc:1905] T ae8a16e3eacb46b9ae935da41ff3be00 P 1b8e7e8c9159416b87b8d3c7df2145d3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:34:44.449579 28324 ts_tablet_manager.cc:1918] T ae8a16e3eacb46b9ae935da41ff3be00 P 1b8e7e8c9159416b87b8d3c7df2145d3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:34:44.449688 28324 log.cc:1196] T ae8a16e3eacb46b9ae935da41ff3be00 P 1b8e7e8c9159416b87b8d3c7df2145d3: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786199615258783-11791-0/minicluster-data/ts-2/wal/wals/ae8a16e3eacb46b9ae935da41ff3be00
I20260808 14:34:44.450033 28324 ts_tablet_manager.cc:1939] T ae8a16e3eacb46b9ae935da41ff3be00 P 1b8e7e8c9159416b87b8d3c7df2145d3: Deleting consensus metadata
I20260808 14:34:44.451413 27533 catalog_manager.cc:4841] TS 1b8e7e8c9159416b87b8d3c7df2145d3 (127.11.131.195:37461): tablet ae8a16e3eacb46b9ae935da41ff3be00 (table test-table [id=eed25ef261b249de9207ee1c7e62ad13]) successfully deleted
W20260808 14:34:44.453831 27533 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.131.193:39291 (error 108)
I20260808 14:34:44.454685 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 27854
I20260808 14:34:44.455068 28282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:34:44.454724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:39291 (local address 127.0.0.1:51410)
0808 14:34:44.454887 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 14:34:44.454965 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.193:39291: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
W20260808 14:34:44.460397 27533 catalog_manager.cc:4584] TS 1ef49472405e473f9daa1e8ef698ac62 (127.11.131.193:39291): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ae8a16e3eacb46b9ae935da41ff3be00: Network error: Client connection negotiation failed: client connection to 127.11.131.193:39291: connect: Connection refused (error 111)
I20260808 14:34:44.467061 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 28054
I20260808 14:34:44.480125 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 27507
2026-08-08T14:34:44Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2685 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:34:44 dist-test-slave-twwt krb5kdc[28329](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:34:44 dist-test-slave-twwt krb5kdc[28329](info): set up 2 sockets
Aug 08 14:34:44 dist-test-slave-twwt krb5kdc[28329](info): commencing operation
krb5kdc: starting...
W20260808 14:34:45.741631 11791 mini_kdc.cc:121] Time spent starting KDC: real 1.234s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Aug 08 14:34:45 dist-test-slave-twwt krb5kdc[28329](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199685, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:34:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:34:45Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.11.131.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.11.131.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.11.131.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/krb5kdc/rangeradmin_127.11.131.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.11.131.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/krb5kdc/rangeradmin_127.11.131.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.11.131.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.11.131.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.11.131.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/krb5kdc/rangerlookup_127.11.131.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.11.131.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/krb5kdc/rangerlookup_127.11.131.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.131.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.11.131.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.131.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/krb5kdc/HTTP_127.11.131.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.131.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/krb5kdc/HTTP_127.11.131.212@KRBTEST.COM.keytab.
I20260808 14:34:45.941598 11791 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskR7JPPN/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/postgres -l logfile start
2026-08-08 14:34:48.642 UTC [28372] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 14:34:48.642 UTC [28372] LOG: listening on IPv4 address "127.11.131.212", port 46575
2026-08-08 14:34:48.645 UTC [28372] LOG: listening on Unix socket "/tmp/.s.PGSQL.46575"
2026-08-08 14:34:48.668 UTC [28377] LOG: database system was shut down at 2026-08-08 14:34:47 UTC
2026-08-08 14:34:48.672 UTC [28372] LOG: database system is ready to accept connections
I20260808 14:34:49.835777 11791 mini_postgres.cc:96] Postgres bound to 46575
2026-08-08 14:34:49.844 UTC [28391] FATAL: database "slave" does not exist
127.11.131.212:46575 - accepting connections
I20260808 14:34:49.845589 11791 mini_ranger.cc:161] Starting Ranger...
I20260808 14:34:49.862375 11791 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 14:34:50.384704 11791 mini_ranger.cc:87] Created ranger Postgres database
I20260808 14:34:50.384826 11791 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ranger-admin
2026-08-08 14:34:50,739 [I] DB FLAVOR :POSTGRES
2026-08-08 14:34:50,740 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 14:34:50,740 [I] Checking connection..
2026-08-08 14:34:50,740 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskR7JPPN/build/debug/bin/postgresql.jar:/tmp/dist-test-taskR7JPPN/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.131.212:46575/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 14:34:51,029 [I] Checking connection passed.
2026-08-08 14:34:51,029 [I] --------- Verifying version history table ---------
2026-08-08 14:34:51,029 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskR7JPPN/build/debug/bin/postgresql.jar:/tmp/dist-test-taskR7JPPN/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.131.212:46575/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 14:34:51,273 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 14:34:51,273 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskR7JPPN/build/debug/bin/postgresql.jar:/tmp/dist-test-taskR7JPPN/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.131.212:46575/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 14:34:51,549 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 14:34:51,550 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 14:34:51,550 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskR7JPPN/build/debug/bin/postgresql.jar:/tmp/dist-test-taskR7JPPN/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.131.212:46575/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskR7JPPN/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 14:34:51.799 UTC [28486] WARNING: there is no transaction in progress
2026-08-08 14:34:51,808 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 14:34:51,808 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskR7JPPN/build/debug/bin/postgresql.jar:/tmp/dist-test-taskR7JPPN/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.131.212:46575/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 14:34:52,082 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 14:34:52,082 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 14:34:52,083 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskR7JPPN/build/debug/bin/postgresql.jar:/tmp/dist-test-taskR7JPPN/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.131.212:46575/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 14:34:52,358 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskR7JPPN/build/debug/bin/postgresql.jar:/tmp/dist-test-taskR7JPPN/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.131.212:46575/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 14:34:52,614 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskR7JPPN/build/debug/bin/postgresql.jar:/tmp/dist-test-taskR7JPPN/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.131.212:46575/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-twwt.c.gcp-upstream.internal','N') ;"
2026-08-08 14:34:52,869 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskR7JPPN/build/debug/bin/postgresql.jar:/tmp/dist-test-taskR7JPPN/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.131.212:46575/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 14:34:53,138 [I] Table x_portal_user does not exist in database ranger
2026-08-08 14:34:53,138 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskR7JPPN/build/debug/bin/postgresql.jar:/tmp/dist-test-taskR7JPPN/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.131.212:46575/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 14:34:53,410 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 14:34:53,411 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskR7JPPN/build/debug/bin/postgresql.jar:/tmp/dist-test-taskR7JPPN/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.131.212:46575/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 14:34:53,684 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskR7JPPN/build/debug/bin/postgresql.jar:/tmp/dist-test-taskR7JPPN/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.131.212:46575/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 14:34:53,924 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 14:34:53,924 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskR7JPPN/build/debug/bin/postgresql.jar:/tmp/dist-test-taskR7JPPN/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.131.212:46575/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskR7JPPN/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 14:34:55.029 UTC [28656] WARNING: there is no transaction in progress
2026-08-08 14:34:55.047 UTC [28656] WARNING: there is no transaction in progress
2026-08-08 14:34:55.065 UTC [28656] WARNING: there is no transaction in progress
2026-08-08 14:34:55.084 UTC [28656] WARNING: there is no transaction in progress
2026-08-08 14:34:55.102 UTC [28656] WARNING: there is no transaction in progress
2026-08-08 14:34:55.124 UTC [28656] WARNING: there is no transaction in progress
2026-08-08 14:34:55.184 UTC [28656] WARNING: there is no transaction in progress
2026-08-08 14:34:55.191 UTC [28656] WARNING: there is no transaction in progress
2026-08-08 14:34:55.207 UTC [28656] WARNING: there is no transaction in progress
2026-08-08 14:34:55.218 UTC [28656] WARNING: there is no transaction in progress
2026-08-08 14:34:55.231 UTC [28656] WARNING: there is no transaction in progress
2026-08-08 14:34:55.250 UTC [28656] WARNING: there is no transaction in progress
2026-08-08 14:34:55.264 UTC [28656] WARNING: there is no transaction in progress
2026-08-08 14:34:55.277 UTC [28656] WARNING: there is no transaction in progress
2026-08-08 14:34:55.285 UTC [28656] WARNING: there is no transaction in progress
2026-08-08 14:34:55.292 UTC [28656] WARNING: there is no transaction in progress
2026-08-08 14:34:55,996 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 14:34:55,996 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskR7JPPN/build/debug/bin/postgresql.jar:/tmp/dist-test-taskR7JPPN/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.131.212:46575/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 14:34:56,249 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 14:34:56,249 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskR7JPPN/build/debug/bin/postgresql.jar:/tmp/dist-test-taskR7JPPN/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.131.212:46575/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 14:34:56,501 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 14:34:56,502 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskR7JPPN/build/debug/bin/postgresql.jar:/tmp/dist-test-taskR7JPPN/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.131.212:46575/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 14:34:56,766 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 14:34:56,766 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskR7JPPN/build/debug/bin/postgresql.jar:/tmp/dist-test-taskR7JPPN/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.131.212:46575/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 14:34:57,056 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskR7JPPN/build/debug/bin/postgresql.jar:/tmp/dist-test-taskR7JPPN/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.131.212:46575/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 14:34:57,309 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskR7JPPN/build/debug/bin/postgresql.jar:/tmp/dist-test-taskR7JPPN/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.131.212:46575/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-twwt.c.gcp-upstream.internal';"
2026-08-08 14:34:57,569 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 14:34:57,569 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskR7JPPN/build/debug/bin/postgresql.jar:/tmp/dist-test-taskR7JPPN/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.131.212:46575/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 14:34:57,842 [I] DB_PATCHES have already been applied
I20260808 14:34:57.848558 11791 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ranger-admin:/tmp/dist-test-taskR7JPPN/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskR7JPPN/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskR7JPPN/build/debug/bin/postgresql.jar:/tmp/dist-test-taskR7JPPN/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 14:34:57.848651 11791 mini_ranger.cc:193] Using host: 127.11.131.212
I20260808 14:34:57.853469 11791 mini_ranger.cc:227] Ranger admin URL: http://127.11.131.212:47569
Aug 08, 2026 2:34:58 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 2:34:58 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 2:34:58 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 2:34:58 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 2:34:58 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 2:34:58 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 2:34:58 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 14:34:59.277611 11791 mini_ranger.cc:160] Time spent starting Ranger: real 9.432s user 0.000s sys 0.013s
Aug 08, 2026 2:35:19 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 2:35:19 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 08, 2026 2:35:19 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 2:35:19 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 2:35:19 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 2:35:19 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 2:35:19 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 2:35:19 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 2:35:19 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 2:35:19 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 2:35:19 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 2:35:19 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 2:35:19 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 2:35:19 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 2:35:19 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 2:35:19 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 2:35:19 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 2:35:20 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 14:35:20.954356 11791 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.11.131.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.11.131.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.11.131.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/krb5kdc/rangerkms_127.11.131.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.11.131.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/krb5kdc/rangerkms_127.11.131.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.131.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.11.131.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.131.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/krb5kdc/HTTP_127.11.131.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.131.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/krb5kdc/HTTP_127.11.131.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 14:35:21 dist-test-slave-twwt krb5kdc[28329](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199721, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 14:35:21.049613 11791 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 14:35:21.061036 11791 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 14:35:21.958444 11791 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 14:35:21.958554 11791 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ranger-kms
I20260808 14:35:21.958680 11791 mini_ranger_kms.cc:227] Using postgres at 127.11.131.212:46575
2026-08-08 14:35:22,197 [I] DB FLAVOR :POSTGRES
2026-08-08 14:35:22,198 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 14:35:22,198 [I] Checking connection
2026-08-08 14:35:22,198 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskR7JPPN/build/debug/bin/postgresql.jar:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.131.212:46575/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 14:35:22,466 [I] connection success
2026-08-08 14:35:22,466 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 14:35:22,467 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 14:35:22,467 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskR7JPPN/build/debug/bin/postgresql.jar:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.131.212:46575/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 14:35:22,709 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 14:35:22,709 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 14:35:22,709 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 14:35:22,709 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskR7JPPN/build/debug/bin/postgresql.jar:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.131.212:46575/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 14:35:23,010 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 14:35:23.492337 11791 mini_ranger_kms.cc:310] Created kms service
I20260808 14:35:23.719031 11791 mini_ranger_kms.cc:326] Created kudu user
I20260808 14:35:23.766566 11791 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 14:35:23 dist-test-slave-twwt krb5kdc[28329](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199721, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.11.131.212@KRBTEST.COM
I20260808 14:35:24.185009 11791 mini_ranger_kms.cc:384] Added ranger policy
I20260808 14:35:24.185178 11791 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ranger-kms:/tmp/dist-test-taskR7JPPN/build/debug/bin/postgresql.jar:/tmp/dist-test-taskR7JPPN/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskR7JPPN/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 14:35:24.185204 11791 mini_ranger_kms.cc:240] Using host: 127.11.131.212
I20260808 14:35:24.190532 11791 mini_ranger_kms.cc:276] Ranger KMS PID: 28920
I20260808 14:35:24.190713 11791 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.11.131.212:33985
Aug 08, 2026 2:35:25 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 2:35:25 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 2:35:25 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 2:35:25 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 2:35:25 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 2:35:25 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 08 14:35:26 dist-test-slave-twwt krb5kdc[28329](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786199726, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.131.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:35:27.071913 11791 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.022s user 0.007s sys 0.216s
I20260808 14:35:27.072083 11791 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 14:35:27.072213 11791 mini_ranger_kms.cc:401] 127.11.131.212:33985/kms/v1/keys
Aug 08 14:35:27 dist-test-slave-twwt krb5kdc[28329](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199726, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.131.212@KRBTEST.COM for HTTP/127.11.131.212@KRBTEST.COM
Aug 08 14:35:27 dist-test-slave-twwt krb5kdc[28329](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199726, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.131.212@KRBTEST.COM for HTTP/127.11.131.212@KRBTEST.COM
Aug 08 14:35:29 dist-test-slave-twwt krb5kdc[28329](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199729, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.11.131.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
I20260808 14:35:30.026216 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:35153
--webserver_interface=127.11.131.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:35561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:35153
--ranger_config_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.131.212:33985/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:35:30.161334 29005 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:35:30.161616 29005 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:35:30.161657 29005 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:35:30.165848 29005 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:35:30.165920 29005 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:35:30.165939 29005 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:35:30.165956 29005 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:35:30.165971 29005 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:35:30.171763 29005 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:35561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/master-0/wal
--ranger_kms_url=127.11.131.212:33985/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:35153
--ranger_config_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:35153
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.131.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29005
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:35:30.172982 29005 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:35:30.174113 29005 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:35:30.184183 29012 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:30.184252 29005 server_base.cc:1034] running on GCE node
W20260808 14:35:30.184192 29016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:30.184608 29013 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:30.185283 29005 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:35:30.186532 29005 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:35:30.187749 29005 hybrid_clock.cc:648] HybridClock initialized: now 1786199730187722 us; error 47 us; skew 500 ppm
Aug 08 14:35:30 dist-test-slave-twwt krb5kdc[28329](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199730, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:35:30.194903 29005 init.cc:377] Logged in from keytab as kudu/127.11.131.254@KRBTEST.COM (short username kudu)
I20260808 14:35:30.196077 29005 webserver.cc:460] Webserver started at http://127.11.131.254:37475/ using document root <none> and password file <none>
I20260808 14:35:30.196669 29005 fs_manager.cc:359] Metadata directory not provided
I20260808 14:35:30.196753 29005 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:35:30.196998 29005 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 14:35:30 dist-test-slave-twwt krb5kdc[28329](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199730, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for HTTP/127.11.131.212@KRBTEST.COM
I20260808 14:35:30.256119 29005 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/master-0/data/instance:
uuid: "8fe7211de7694aa28a93545a2685c88b"
format_stamp: "Formatted at 2026-08-08 14:35:30 on dist-test-slave-twwt"
server_key: "b35214b5630cc20c2cb6b92cd4713d4a"
server_key_iv: "4ef4a724bae4b07287c0b64facf376fb"
server_key_version: "kuduclusterkey@0"
I20260808 14:35:30.256805 29005 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/master-0/wal/instance:
uuid: "8fe7211de7694aa28a93545a2685c88b"
format_stamp: "Formatted at 2026-08-08 14:35:30 on dist-test-slave-twwt"
server_key: "b35214b5630cc20c2cb6b92cd4713d4a"
server_key_iv: "4ef4a724bae4b07287c0b64facf376fb"
server_key_version: "kuduclusterkey@0"
I20260808 14:35:30.261232 29005 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 14:35:30.276264 29024 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:30.277773 29005 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 14:35:30.277918 29005 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "8fe7211de7694aa28a93545a2685c88b"
format_stamp: "Formatted at 2026-08-08 14:35:30 on dist-test-slave-twwt"
server_key: "b35214b5630cc20c2cb6b92cd4713d4a"
server_key_iv: "4ef4a724bae4b07287c0b64facf376fb"
server_key_version: "kuduclusterkey@0"
I20260808 14:35:30.278059 29005 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:35:30.296250 29005 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:35:30.299345 29005 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:35:30.299598 29005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:35:30.308022 29005 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.254:35153
I20260808 14:35:30.308072 29110 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.254:35153 every 8 connection(s)
I20260808 14:35:30.309065 29005 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:35:30.312095 29113 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:35:30.316962 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 29005
I20260808 14:35:30.317106 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/master-0/wal/instance
I20260808 14:35:30.317437 11791 external_mini_cluster.cc:1428] Setting key 99783e9f4926e826069c9306fe5b1760
I20260808 14:35:30.318445 29113 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8fe7211de7694aa28a93545a2685c88b: Bootstrap starting.
I20260808 14:35:30.321089 29113 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8fe7211de7694aa28a93545a2685c88b: Neither blocks nor log segments found. Creating new log.
I20260808 14:35:30.322081 29113 log.cc:824] T 00000000000000000000000000000000 P 8fe7211de7694aa28a93545a2685c88b: Log is configured to *not* fsync() on all Append() calls
I20260808 14:35:30.324219 29113 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8fe7211de7694aa28a93545a2685c88b: No bootstrap required, opened a new log
Aug 08 14:35:30 dist-test-slave-twwt krb5kdc[28329](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199729, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:35:30.328920 29113 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8fe7211de7694aa28a93545a2685c88b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fe7211de7694aa28a93545a2685c88b" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 35153 } }
I20260808 14:35:30.329180 29113 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8fe7211de7694aa28a93545a2685c88b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:35:30.329270 29113 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8fe7211de7694aa28a93545a2685c88b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fe7211de7694aa28a93545a2685c88b, State: Initialized, Role: FOLLOWER
I20260808 14:35:30.329777 29113 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8fe7211de7694aa28a93545a2685c88b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fe7211de7694aa28a93545a2685c88b" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 35153 } }
I20260808 14:35:30.329977 29113 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8fe7211de7694aa28a93545a2685c88b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:35:30.330081 29113 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8fe7211de7694aa28a93545a2685c88b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:35:30.330204 29113 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8fe7211de7694aa28a93545a2685c88b [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:35:30.331354 29113 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8fe7211de7694aa28a93545a2685c88b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fe7211de7694aa28a93545a2685c88b" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 35153 } }
I20260808 14:35:30.331722 29113 leader_election.cc:302] T 00000000000000000000000000000000 P 8fe7211de7694aa28a93545a2685c88b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8fe7211de7694aa28a93545a2685c88b; no voters:
I20260808 14:35:30.332147 29113 leader_election.cc:288] T 00000000000000000000000000000000 P 8fe7211de7694aa28a93545a2685c88b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:35:30.332262 29122 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8fe7211de7694aa28a93545a2685c88b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:35:30.332549 29122 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8fe7211de7694aa28a93545a2685c88b [term 1 LEADER]: Becoming Leader. State: Replica: 8fe7211de7694aa28a93545a2685c88b, State: Running, Role: LEADER
I20260808 14:35:30.332957 29122 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8fe7211de7694aa28a93545a2685c88b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fe7211de7694aa28a93545a2685c88b" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 35153 } }
I20260808 14:35:30.333678 29113 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8fe7211de7694aa28a93545a2685c88b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:35:30.334529 29122 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fe7211de7694aa28a93545a2685c88b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8fe7211de7694aa28a93545a2685c88b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fe7211de7694aa28a93545a2685c88b" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 35153 } } }
I20260808 14:35:30.334760 29122 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fe7211de7694aa28a93545a2685c88b [sys.catalog]: This master's current role is: LEADER
I20260808 14:35:30.335037 29122 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fe7211de7694aa28a93545a2685c88b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8fe7211de7694aa28a93545a2685c88b. Latest consensus state: current_term: 1 leader_uuid: "8fe7211de7694aa28a93545a2685c88b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fe7211de7694aa28a93545a2685c88b" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 35153 } } }
I20260808 14:35:30.335184 29122 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fe7211de7694aa28a93545a2685c88b [sys.catalog]: This master's current role is: LEADER
I20260808 14:35:30.335651 29133 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:35:30.336014 29118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:30.319051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36428 (local address 127.11.131.254:35153)
0808 14:35:30.319566 (+ 515us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:30.319587 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:30.319636 (+ 49us) server_negotiation.cc:407] Connection header received
0808 14:35:30.320549 (+ 913us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:30.320578 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:30.321160 (+ 582us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:30.321573 (+ 413us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:30.322504 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:30.324115 (+ 1611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:30.325323 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:30.326056 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:30.326218 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:30.329486 (+ 3268us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:30.329493 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:30.329512 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:30.329548 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:30.331835 (+ 2287us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:30.332427 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:30.332435 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:30.332444 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:30.332585 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:30.332923 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:30.332926 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:30.332927 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:30.333460 (+ 533us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:30.333737 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:30.334533 (+ 796us) server_negotiation.cc:299] Negotiation successful
0808 14:35:30.334920 (+ 387us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":167,"threads_started":1}
I20260808 14:35:30.336169 29113 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 14:35:30.339321 29133 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:35:30.350828 29133 catalog_manager.cc:1347] Generated new cluster ID: 2de7f2d5db154508bac48a1e52d7bd05
I20260808 14:35:30.350919 29133 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:35:30.375447 29133 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:35:30.376554 29133 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:35:30.387387 29133 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8fe7211de7694aa28a93545a2685c88b: Generated new TSK 0
I20260808 14:35:30.388348 29133 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.131.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab.
Entry for principal kudu/127.11.131.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab.
I20260808 14:35:31.122360 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.131.212:33985/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.193:0
--local_ip_for_outbound_sockets=127.11.131.193
--webserver_interface=127.11.131.193
--webserver_port=0
--tserver_master_addrs=127.11.131.254:35153
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab
--principal=kudu/127.11.131.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:35561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:35:31.281471 29184 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:35:31.281837 29184 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:35:31.281915 29184 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:35:31.288048 29184 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:35:31.288133 29184 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:35:31.288223 29184 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.193
I20260808 14:35:31.294299 29184 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:35561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.11.131.212:33985/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab
--principal=kudu/127.11.131.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.131.193
--webserver_port=0
--tserver_master_addrs=127.11.131.254:35153
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29184
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.193
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:35:31.295645 29184 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:35:31.296945 29184 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:35:31.308113 29204 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:31.308502 29184 server_base.cc:1034] running on GCE node
W20260808 14:35:31.308593 29201 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:31.309742 29200 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:31.310324 29184 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:35:31.311149 29184 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:35:31.326756 29184 hybrid_clock.cc:648] HybridClock initialized: now 1786199731326704 us; error 66 us; skew 500 ppm
Aug 08 14:35:31 dist-test-slave-twwt krb5kdc[28329](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199731, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:35:31.330946 29184 init.cc:377] Logged in from keytab as kudu/127.11.131.193@KRBTEST.COM (short username kudu)
I20260808 14:35:31.332216 29184 webserver.cc:460] Webserver started at http://127.11.131.193:34161/ using document root <none> and password file <none>
I20260808 14:35:31.333053 29184 fs_manager.cc:359] Metadata directory not provided
I20260808 14:35:31.333204 29184 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:35:31.333578 29184 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 14:35:31 dist-test-slave-twwt krb5kdc[28329](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199731, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.193@KRBTEST.COM for HTTP/127.11.131.212@KRBTEST.COM
I20260808 14:35:31.354157 29184 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ts-0/data/instance:
uuid: "88ef1bd400b94a60b1106cc5063e6a1f"
format_stamp: "Formatted at 2026-08-08 14:35:31 on dist-test-slave-twwt"
server_key: "bc4d21de8ad943b552571ab8a8236b32"
server_key_iv: "16d14c7e7c17c4dc9eb005af7c8ae39f"
server_key_version: "kuduclusterkey@0"
I20260808 14:35:31.361021 29184 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ts-0/wal/instance:
uuid: "88ef1bd400b94a60b1106cc5063e6a1f"
format_stamp: "Formatted at 2026-08-08 14:35:31 on dist-test-slave-twwt"
server_key: "bc4d21de8ad943b552571ab8a8236b32"
server_key_iv: "16d14c7e7c17c4dc9eb005af7c8ae39f"
server_key_version: "kuduclusterkey@0"
I20260808 14:35:31.373100 29184 fs_manager.cc:691] Time spent creating directory manager: real 0.012s user 0.000s sys 0.004s
I20260808 14:35:31.398047 29221 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:31.399948 29184 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.002s sys 0.000s
I20260808 14:35:31.400199 29184 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ts-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ts-0/wal
uuid: "88ef1bd400b94a60b1106cc5063e6a1f"
format_stamp: "Formatted at 2026-08-08 14:35:31 on dist-test-slave-twwt"
server_key: "bc4d21de8ad943b552571ab8a8236b32"
server_key_iv: "16d14c7e7c17c4dc9eb005af7c8ae39f"
server_key_version: "kuduclusterkey@0"
I20260808 14:35:31.400470 29184 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
Aug 08 14:35:31 dist-test-slave-twwt krb5kdc[28329](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786199731, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:35:31.440644 29184 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:35:31.444165 29184 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:35:31.444460 29184 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:35:31.445257 29184 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:35:31.446446 29184 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:35:31.446561 29184 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:31.446728 29184 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:35:31.446830 29184 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:31.459045 29184 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.193:41133
I20260808 14:35:31.460305 29184 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
I20260808 14:35:31.464835 29392 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.193:41133 every 8 connection(s)
I20260808 14:35:31.468921 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 29184
I20260808 14:35:31.469048 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ts-0/wal/instance
I20260808 14:35:31.469340 11791 external_mini_cluster.cc:1428] Setting key 96670bf4a0f3699f787d309282094118
Aug 08 14:35:31 dist-test-slave-twwt krb5kdc[28329](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199731, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.193@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.131.194@KRBTEST.COM; defaulting to no policy
I20260808 14:35:31.485536 29397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:31.467059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:41487 (local address 127.11.131.254:35153)
0808 14:35:31.469953 (+ 2894us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:31.469958 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:31.469978 (+ 20us) server_negotiation.cc:407] Connection header received
0808 14:35:31.470479 (+ 501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:31.470484 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:31.470544 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:31.470726 (+ 182us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:31.472452 (+ 1726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:31.473437 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:31.475406 (+ 1969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:31.475821 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:31.475933 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:31.480588 (+ 4655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:31.480593 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:31.480596 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:31.480627 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:31.482758 (+ 2131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:31.483496 (+ 738us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:31.483499 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:31.483502 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:31.483597 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:31.484055 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:31.484058 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:31.484060 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:31.484288 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:31.484388 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:31.485070 (+ 682us) server_negotiation.cc:299] Negotiation successful
0808 14:35:31.485221 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2805,"thread_start_us":99,"threads_started":1}
I20260808 14:35:31.486532 29398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:31.467495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35153 (local address 127.11.131.193:41487)
0808 14:35:31.468844 (+ 1349us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:31.468922 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:31.470090 (+ 1168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:31.471076 (+ 986us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:31.471087 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:31.471507 (+ 420us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:35:31.472259 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:31.472281 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:31.473613 (+ 1332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:31.473617 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:31.475234 (+ 1617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:31.475247 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:31.476145 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:31.476150 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:31.476387 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:31.477164 (+ 777us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:35:31.477187 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:35:31.479193 (+ 2006us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:35:31.482903 (+ 3710us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:31.482911 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:31.482931 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:31.483377 (+ 446us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:31.483721 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:31.483727 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:31.483730 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:31.483950 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:31.484401 (+ 451us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:35:31.484410 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:35:31.484784 (+ 374us) client_negotiation.cc:769] Sending connection context
0808 14:35:31.484977 (+ 193us) client_negotiation.cc:240] Negotiation successful
0808 14:35:31.485272 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1091,"thread_start_us":164,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.194@KRBTEST.COM" created.
I20260808 14:35:31.488143 29393 heartbeater.cc:347] Connected to a master server at 127.11.131.254:35153
I20260808 14:35:31.488427 29393 heartbeater.cc:464] Registering TS with master...
I20260808 14:35:31.489048 29393 heartbeater.cc:511] Master 127.11.131.254:35153 requested a full tablet report, sending...
I20260808 14:35:31.490968 29050 ts_manager.cc:194] Registered new tserver with Master: 88ef1bd400b94a60b1106cc5063e6a1f (127.11.131.193:41133)
I20260808 14:35:31.492538 29050 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.193@KRBTEST.COM'} at 127.11.131.193:41487
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab.
Entry for principal kudu/127.11.131.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab.
I20260808 14:35:31.510561 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.131.212:33985/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.194:0
--local_ip_for_outbound_sockets=127.11.131.194
--webserver_interface=127.11.131.194
--webserver_port=0
--tserver_master_addrs=127.11.131.254:35153
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab
--principal=kudu/127.11.131.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:35561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:35:31.676110 29407 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:35:31.676576 29407 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:35:31.676712 29407 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:35:31.682520 29407 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:35:31.682708 29407 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:35:31.682857 29407 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.194
I20260808 14:35:31.690596 29407 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:35561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.11.131.212:33985/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab
--principal=kudu/127.11.131.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.131.194
--webserver_port=0
--tserver_master_addrs=127.11.131.254:35153
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29407
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.194
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:35:31.692121 29407 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:35:31.693298 29407 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:35:31.704504 29412 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:31.704690 29421 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:31.704619 29414 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:31.706033 29407 server_base.cc:1034] running on GCE node
I20260808 14:35:31.706538 29407 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:35:31.707422 29407 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:35:31.708927 29407 hybrid_clock.cc:648] HybridClock initialized: now 1786199731708902 us; error 37 us; skew 500 ppm
Aug 08 14:35:31 dist-test-slave-twwt krb5kdc[28329](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199731, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:35:31.712942 29407 init.cc:377] Logged in from keytab as kudu/127.11.131.194@KRBTEST.COM (short username kudu)
I20260808 14:35:31.714125 29407 webserver.cc:460] Webserver started at http://127.11.131.194:34913/ using document root <none> and password file <none>
I20260808 14:35:31.714896 29407 fs_manager.cc:359] Metadata directory not provided
I20260808 14:35:31.714990 29407 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:35:31.715224 29407 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 14:35:31 dist-test-slave-twwt krb5kdc[28329](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199731, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.194@KRBTEST.COM for HTTP/127.11.131.212@KRBTEST.COM
I20260808 14:35:31.729892 29407 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ts-1/data/instance:
uuid: "9340d39fe3aa43b08ba8e359c3e8084f"
format_stamp: "Formatted at 2026-08-08 14:35:31 on dist-test-slave-twwt"
server_key: "510a9c8bfb81fe69cc3b71a97936a676"
server_key_iv: "039cce42af3ed05f82f5aaab45e9795c"
server_key_version: "kuduclusterkey@0"
I20260808 14:35:31.730785 29407 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ts-1/wal/instance:
uuid: "9340d39fe3aa43b08ba8e359c3e8084f"
format_stamp: "Formatted at 2026-08-08 14:35:31 on dist-test-slave-twwt"
server_key: "510a9c8bfb81fe69cc3b71a97936a676"
server_key_iv: "039cce42af3ed05f82f5aaab45e9795c"
server_key_version: "kuduclusterkey@0"
I20260808 14:35:31.736642 29407 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260808 14:35:31.768149 29434 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:31.770057 29407 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.003s sys 0.000s
I20260808 14:35:31.770292 29407 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ts-1/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ts-1/wal
uuid: "9340d39fe3aa43b08ba8e359c3e8084f"
format_stamp: "Formatted at 2026-08-08 14:35:31 on dist-test-slave-twwt"
server_key: "510a9c8bfb81fe69cc3b71a97936a676"
server_key_iv: "039cce42af3ed05f82f5aaab45e9795c"
server_key_version: "kuduclusterkey@0"
I20260808 14:35:31.770539 29407 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:35:31.803776 29407 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:35:31.808053 29407 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:35:31.808363 29407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:35:31.809216 29407 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:35:31.810253 29407 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:35:31.810334 29407 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:31.810436 29407 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:35:31.810483 29407 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:31.822489 29407 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.194:39001
I20260808 14:35:31.825165 29407 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
I20260808 14:35:31.825951 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 29407
I20260808 14:35:31.826078 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ts-1/wal/instance
I20260808 14:35:31.826407 11791 external_mini_cluster.cc:1428] Setting key 7b20b6a1d1abd443e6115b83531c8c5c
I20260808 14:35:31.831319 29602 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.194:39001 every 8 connection(s)
WARNING: no policy specified for kudu/127.11.131.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.195@KRBTEST.COM" created.
Aug 08 14:35:31 dist-test-slave-twwt krb5kdc[28329](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199731, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.194@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:35:31.874145 29397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:31.838842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:56449 (local address 127.11.131.254:35153)
0808 14:35:31.838990 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:31.838995 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:31.847004 (+ 8009us) server_negotiation.cc:407] Connection header received
0808 14:35:31.848715 (+ 1711us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:31.848720 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:31.848787 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:31.848870 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:31.853466 (+ 4596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:31.854360 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:31.856179 (+ 1819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:31.856509 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:31.856599 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:31.863865 (+ 7266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:31.863870 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:31.863873 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:31.863909 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:31.865832 (+ 1923us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:31.868996 (+ 3164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:31.869003 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:31.869008 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:31.869117 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:31.870649 (+ 1532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:31.870656 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:31.870660 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:31.870969 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:31.871082 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:31.873756 (+ 2674us) server_negotiation.cc:299] Negotiation successful
0808 14:35:31.873934 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 14:35:31.878208 29606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:31.839633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35153 (local address 127.11.131.194:56449)
0808 14:35:31.846759 (+ 7126us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:31.846858 (+ 99us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:31.848369 (+ 1511us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:31.852027 (+ 3658us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:31.852039 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:31.852410 (+ 371us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:35:31.853250 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:31.853276 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:31.854548 (+ 1272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:31.854551 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:31.856021 (+ 1470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:31.856034 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:31.856870 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:31.856875 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:31.857098 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:31.858829 (+ 1731us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:35:31.858853 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:35:31.863583 (+ 4730us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:35:31.867434 (+ 3851us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:31.867442 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:31.867463 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:31.867995 (+ 532us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:31.869269 (+ 1274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:31.869275 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:31.869280 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:31.869553 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:31.871171 (+ 1618us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:35:31.871182 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:35:31.871636 (+ 454us) client_negotiation.cc:769] Sending connection context
0808 14:35:31.874812 (+ 3176us) client_negotiation.cc:240] Negotiation successful
0808 14:35:31.875249 (+ 437us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6770,"thread_start_us":198,"threads_started":1}
I20260808 14:35:31.880152 29603 heartbeater.cc:347] Connected to a master server at 127.11.131.254:35153
I20260808 14:35:31.880447 29603 heartbeater.cc:464] Registering TS with master...
I20260808 14:35:31.881084 29603 heartbeater.cc:511] Master 127.11.131.254:35153 requested a full tablet report, sending...
I20260808 14:35:31.882638 29050 ts_manager.cc:194] Registered new tserver with Master: 9340d39fe3aa43b08ba8e359c3e8084f (127.11.131.194:39001)
I20260808 14:35:31.883473 29050 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.194@KRBTEST.COM'} at 127.11.131.194:56449
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab.
Entry for principal kudu/127.11.131.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab.
I20260808 14:35:31.895089 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.131.212:33985/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.195:0
--local_ip_for_outbound_sockets=127.11.131.195
--webserver_interface=127.11.131.195
--webserver_port=0
--tserver_master_addrs=127.11.131.254:35153
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab
--principal=kudu/127.11.131.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:35561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 14:35:31 dist-test-slave-twwt krb5kdc[28329](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199731, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for HTTP/127.11.131.212@KRBTEST.COM
W20260808 14:35:32.069286 29608 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:35:32.069667 29608 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:35:32.069772 29608 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:35:32.073937 29608 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:35:32.074028 29608 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:35:32.074136 29608 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.195
I20260808 14:35:32.079591 29608 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:35561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.11.131.212:33985/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab
--principal=kudu/127.11.131.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.131.195
--webserver_port=0
--tserver_master_addrs=127.11.131.254:35153
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29608
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.195
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:35:32.080893 29608 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:35:32.082206 29608 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:35:32.093081 29618 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:32.093237 29608 server_base.cc:1034] running on GCE node
W20260808 14:35:32.093075 29621 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:35:32.093228 29616 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:35:32.094056 29608 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:35:32.094828 29608 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:35:32.096383 29608 hybrid_clock.cc:648] HybridClock initialized: now 1786199732096343 us; error 46 us; skew 500 ppm
Aug 08 14:35:32 dist-test-slave-twwt krb5kdc[28329](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199732, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:35:32.100340 29608 init.cc:377] Logged in from keytab as kudu/127.11.131.195@KRBTEST.COM (short username kudu)
I20260808 14:35:32.101547 29608 webserver.cc:460] Webserver started at http://127.11.131.195:37171/ using document root <none> and password file <none>
I20260808 14:35:32.102332 29608 fs_manager.cc:359] Metadata directory not provided
I20260808 14:35:32.102435 29608 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:35:32.102741 29608 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 14:35:32 dist-test-slave-twwt krb5kdc[28329](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199732, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.195@KRBTEST.COM for HTTP/127.11.131.212@KRBTEST.COM
I20260808 14:35:32.120119 29608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ts-2/data/instance:
uuid: "bf8a452b15d74c52be7939098bb49627"
format_stamp: "Formatted at 2026-08-08 14:35:32 on dist-test-slave-twwt"
server_key: "79188d98386355468387fb770c618830"
server_key_iv: "7db11daf33e267b82a223429d64804cd"
server_key_version: "kuduclusterkey@0"
I20260808 14:35:32.120981 29608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ts-2/wal/instance:
uuid: "bf8a452b15d74c52be7939098bb49627"
format_stamp: "Formatted at 2026-08-08 14:35:32 on dist-test-slave-twwt"
server_key: "79188d98386355468387fb770c618830"
server_key_iv: "7db11daf33e267b82a223429d64804cd"
server_key_version: "kuduclusterkey@0"
I20260808 14:35:32.131644 29608 fs_manager.cc:691] Time spent creating directory manager: real 0.010s user 0.000s sys 0.004s
I20260808 14:35:32.155021 29632 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:32.156808 29608 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.000s
I20260808 14:35:32.157037 29608 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ts-2/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ts-2/wal
uuid: "bf8a452b15d74c52be7939098bb49627"
format_stamp: "Formatted at 2026-08-08 14:35:32 on dist-test-slave-twwt"
server_key: "79188d98386355468387fb770c618830"
server_key_iv: "7db11daf33e267b82a223429d64804cd"
server_key_version: "kuduclusterkey@0"
I20260808 14:35:32.157269 29608 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:35:32.186856 29608 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:35:32.191010 29608 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:35:32.191226 29608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:35:32.192025 29608 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:35:32.193212 29608 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:35:32.193303 29608 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:32.193421 29608 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:35:32.193456 29608 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:35:32.205629 29608 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.195:43679
I20260808 14:35:32.207134 29608 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
I20260808 14:35:32.208293 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 29608
I20260808 14:35:32.208433 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ts-2/wal/instance
I20260808 14:35:32.208778 11791 external_mini_cluster.cc:1428] Setting key 5332a7b212497f6ca9add15d264ba21a
I20260808 14:35:32.213430 29803 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.195:43679 every 8 connection(s)
Aug 08 14:35:32 dist-test-slave-twwt krb5kdc[28329](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199732, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.195@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:35:32.226840 29397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:32.213010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:56871 (local address 127.11.131.254:35153)
0808 14:35:32.213142 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:32.213147 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:32.213162 (+ 15us) server_negotiation.cc:407] Connection header received
0808 14:35:32.214223 (+ 1061us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:32.214226 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:32.214288 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:32.214380 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:32.215852 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:32.216656 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:32.218470 (+ 1814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:32.218869 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:32.218964 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:32.222167 (+ 3203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:32.222171 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:32.222174 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:32.222205 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:32.224113 (+ 1908us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:32.224814 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:32.224818 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:32.224820 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:32.224935 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:32.225448 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:32.225452 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:32.225455 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:32.225701 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:32.225827 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:32.226480 (+ 653us) server_negotiation.cc:299] Negotiation successful
0808 14:35:32.226660 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 14:35:32.227861 29807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:32.211842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:35153 (local address 127.11.131.195:56871)
0808 14:35:32.212638 (+ 796us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:32.212725 (+ 87us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:32.213977 (+ 1252us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:32.214589 (+ 612us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:32.214598 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:32.214992 (+ 394us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:35:32.215659 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:32.215679 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:32.216813 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:32.216817 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:32.218315 (+ 1498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:32.218327 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:32.219181 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:32.219185 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:32.219387 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:32.220127 (+ 740us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:35:32.220149 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:35:32.221915 (+ 1766us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:35:32.224259 (+ 2344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:32.224266 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:32.224296 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:32.224682 (+ 386us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:32.225069 (+ 387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:35:32.225072 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:35:32.225075 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:35:32.225286 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:35:32.225845 (+ 559us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:35:32.225853 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:35:32.226183 (+ 330us) client_negotiation.cc:769] Sending connection context
0808 14:35:32.226403 (+ 220us) client_negotiation.cc:240] Negotiation successful
0808 14:35:32.226787 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":542,"thread_start_us":175,"threads_started":1}
I20260808 14:35:32.229131 29804 heartbeater.cc:347] Connected to a master server at 127.11.131.254:35153
I20260808 14:35:32.229377 29804 heartbeater.cc:464] Registering TS with master...
I20260808 14:35:32.229959 29804 heartbeater.cc:511] Master 127.11.131.254:35153 requested a full tablet report, sending...
I20260808 14:35:32.231137 29050 ts_manager.cc:194] Registered new tserver with Master: bf8a452b15d74c52be7939098bb49627 (127.11.131.195:43679)
I20260808 14:35:32.231892 29050 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.195@KRBTEST.COM'} at 127.11.131.195:56871
I20260808 14:35:32.236611 11791 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:35:32.248881 29397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:32.239348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36440 (local address 127.11.131.254:35153)
0808 14:35:32.239490 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:32.239496 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:32.239939 (+ 443us) server_negotiation.cc:407] Connection header received
0808 14:35:32.240125 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:32.240128 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:32.240175 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:32.240234 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:35:32.241214 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:32.242020 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:32.243203 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:32.243519 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:32.243588 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:32.245459 (+ 1871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:35:32.245464 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:35:32.245467 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:35:32.245494 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:35:32.247162 (+ 1668us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:32.247644 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:32.247647 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:32.247649 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:32.247747 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:35:32.248067 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:35:32.248070 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:35:32.248071 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:35:32.248264 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:35:32.248385 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:32.248651 (+ 266us) server_negotiation.cc:299] Negotiation successful
0808 14:35:32.248757 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 14:35:32.252195 29050 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36440:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:35:32.257256 29050 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
Aug 08 14:35:32 dist-test-slave-twwt krb5kdc[28329](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199731, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for HTTP/127.11.131.212@KRBTEST.COM
I20260808 14:35:32.282466 29824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:32.275265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.195:43679 (local address 127.0.0.1:53910)
0808 14:35:32.275557 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:32.275572 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:32.275659 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:32.277238 (+ 1579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:32.277245 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:32.277271 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:35:32.277434 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:32.277442 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:32.279158 (+ 1716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:32.279161 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:32.280592 (+ 1431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:32.280605 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:32.281844 (+ 1239us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:32.281849 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:32.281990 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:32.282050 (+ 60us) client_negotiation.cc:769] Sending connection context
0808 14:35:32.282152 (+ 102us) client_negotiation.cc:240] Negotiation successful
0808 14:35:32.282293 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":109,"threads_started":1}
I20260808 14:35:32.283468 29827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:32.276205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53910 (local address 127.11.131.195:43679)
0808 14:35:32.276683 (+ 478us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:32.276696 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:32.276721 (+ 25us) server_negotiation.cc:407] Connection header received
0808 14:35:32.276815 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:32.276821 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:32.277043 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:32.277608 (+ 565us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:35:32.277751 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:32.279004 (+ 1253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:32.280792 (+ 1788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:32.281674 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:32.282962 (+ 1288us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:32.283134 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:32.283195 (+ 61us) server_negotiation.cc:299] Negotiation successful
0808 14:35:32.283304 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":155,"threads_started":1}
I20260808 14:35:32.287164 29707 tablet_service.cc:1467] Processing CreateTablet for tablet 9a72f49c24464fa9a781330e4248e805 (DEFAULT_TABLE table=test-table [id=7b702b5ab93e462b9bb223e286607b6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:35:32.288475 29707 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a72f49c24464fa9a781330e4248e805. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:35:32.294379 29826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:32.275588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.194:39001 (local address 127.0.0.1:51852)
0808 14:35:32.282200 (+ 6612us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:32.282218 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:32.282340 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:32.289180 (+ 6840us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:32.289183 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:32.289203 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:35:32.289315 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:32.289322 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:32.290814 (+ 1492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:32.290817 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:32.291915 (+ 1098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:32.291926 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:32.293994 (+ 2068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:32.293997 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:32.294084 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:32.294110 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 14:35:32.294156 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 14:35:32.294223 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6528,"thread_start_us":91,"threads_started":1}
I20260808 14:35:32.295225 29832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:32.276736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51852 (local address 127.11.131.194:39001)
0808 14:35:32.288669 (+ 11933us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:32.288689 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:32.288720 (+ 31us) server_negotiation.cc:407] Connection header received
0808 14:35:32.288803 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:32.288808 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:32.289012 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:32.289481 (+ 469us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:35:32.289644 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:32.290679 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:32.292100 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:32.293856 (+ 1756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:32.294767 (+ 911us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:32.294927 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:32.294982 (+ 55us) server_negotiation.cc:299] Negotiation successful
0808 14:35:32.295082 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11799,"thread_start_us":111,"threads_started":1}
I20260808 14:35:32.296614 29833 tablet_bootstrap.cc:492] T 9a72f49c24464fa9a781330e4248e805 P bf8a452b15d74c52be7939098bb49627: Bootstrap starting.
I20260808 14:35:32.298409 29482 tablet_service.cc:1467] Processing CreateTablet for tablet 9a72f49c24464fa9a781330e4248e805 (DEFAULT_TABLE table=test-table [id=7b702b5ab93e462b9bb223e286607b6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:35:32.299547 29482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a72f49c24464fa9a781330e4248e805. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:35:32.300633 29833 tablet_bootstrap.cc:654] T 9a72f49c24464fa9a781330e4248e805 P bf8a452b15d74c52be7939098bb49627: Neither blocks nor log segments found. Creating new log.
I20260808 14:35:32.301573 29833 log.cc:824] T 9a72f49c24464fa9a781330e4248e805 P bf8a452b15d74c52be7939098bb49627: Log is configured to *not* fsync() on all Append() calls
I20260808 14:35:32.303191 29823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:32.274369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:41133 (local address 127.0.0.1:38480)
0808 14:35:32.274846 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:32.274905 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:32.275051 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:32.283192 (+ 8141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:32.283196 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:32.283215 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:35:32.283325 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:32.283331 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:32.288464 (+ 5133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:32.288468 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:32.289584 (+ 1116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:32.289596 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:32.302732 (+ 13136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:32.302737 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:32.302848 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:32.302876 (+ 28us) client_negotiation.cc:769] Sending connection context
0808 14:35:32.302965 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 14:35:32.303051 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":135,"threads_started":1}
I20260808 14:35:32.303915 29830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:32.276353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38480 (local address 127.11.131.193:41133)
0808 14:35:32.282647 (+ 6294us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:32.282656 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:32.282686 (+ 30us) server_negotiation.cc:407] Connection header received
0808 14:35:32.282773 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:32.282779 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:32.283018 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:32.283504 (+ 486us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:35:32.283670 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:32.288343 (+ 4673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:32.289743 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:32.290551 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:32.298816 (+ 8265us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:32.298976 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:32.303617 (+ 4641us) server_negotiation.cc:299] Negotiation successful
0808 14:35:32.303763 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6138,"thread_start_us":131,"threads_started":1}
I20260808 14:35:32.307308 29833 tablet_bootstrap.cc:492] T 9a72f49c24464fa9a781330e4248e805 P bf8a452b15d74c52be7939098bb49627: No bootstrap required, opened a new log
I20260808 14:35:32.307523 29833 ts_tablet_manager.cc:1397] T 9a72f49c24464fa9a781330e4248e805 P bf8a452b15d74c52be7939098bb49627: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.000s
I20260808 14:35:32.307178 29292 tablet_service.cc:1467] Processing CreateTablet for tablet 9a72f49c24464fa9a781330e4248e805 (DEFAULT_TABLE table=test-table [id=7b702b5ab93e462b9bb223e286607b6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:35:32.308388 29292 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a72f49c24464fa9a781330e4248e805. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:35:32.314015 29833 raft_consensus.cc:348] T 9a72f49c24464fa9a781330e4248e805 P bf8a452b15d74c52be7939098bb49627 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ef1bd400b94a60b1106cc5063e6a1f" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 41133 } } peers { permanent_uuid: "bf8a452b15d74c52be7939098bb49627" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 43679 } } peers { permanent_uuid: "9340d39fe3aa43b08ba8e359c3e8084f" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 39001 } }
I20260808 14:35:32.314456 29833 raft_consensus.cc:374] T 9a72f49c24464fa9a781330e4248e805 P bf8a452b15d74c52be7939098bb49627 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:35:32.314532 29833 raft_consensus.cc:729] T 9a72f49c24464fa9a781330e4248e805 P bf8a452b15d74c52be7939098bb49627 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf8a452b15d74c52be7939098bb49627, State: Initialized, Role: FOLLOWER
I20260808 14:35:32.315258 29833 consensus_queue.cc:260] T 9a72f49c24464fa9a781330e4248e805 P bf8a452b15d74c52be7939098bb49627 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ef1bd400b94a60b1106cc5063e6a1f" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 41133 } } peers { permanent_uuid: "bf8a452b15d74c52be7939098bb49627" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 43679 } } peers { permanent_uuid: "9340d39fe3aa43b08ba8e359c3e8084f" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 39001 } }
I20260808 14:35:32.316406 29833 ts_tablet_manager.cc:1428] T 9a72f49c24464fa9a781330e4248e805 P bf8a452b15d74c52be7939098bb49627: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20260808 14:35:32.316830 29804 heartbeater.cc:503] Master 127.11.131.254:35153 was elected leader, sending a full tablet report...
I20260808 14:35:32.321518 29838 tablet_bootstrap.cc:492] T 9a72f49c24464fa9a781330e4248e805 P 88ef1bd400b94a60b1106cc5063e6a1f: Bootstrap starting.
I20260808 14:35:32.326344 29838 tablet_bootstrap.cc:654] T 9a72f49c24464fa9a781330e4248e805 P 88ef1bd400b94a60b1106cc5063e6a1f: Neither blocks nor log segments found. Creating new log.
I20260808 14:35:32.329792 29838 log.cc:824] T 9a72f49c24464fa9a781330e4248e805 P 88ef1bd400b94a60b1106cc5063e6a1f: Log is configured to *not* fsync() on all Append() calls
I20260808 14:35:32.330664 29839 tablet_bootstrap.cc:492] T 9a72f49c24464fa9a781330e4248e805 P 9340d39fe3aa43b08ba8e359c3e8084f: Bootstrap starting.
I20260808 14:35:32.335340 29839 tablet_bootstrap.cc:654] T 9a72f49c24464fa9a781330e4248e805 P 9340d39fe3aa43b08ba8e359c3e8084f: Neither blocks nor log segments found. Creating new log.
I20260808 14:35:32.339215 29838 tablet_bootstrap.cc:492] T 9a72f49c24464fa9a781330e4248e805 P 88ef1bd400b94a60b1106cc5063e6a1f: No bootstrap required, opened a new log
I20260808 14:35:32.339483 29838 ts_tablet_manager.cc:1397] T 9a72f49c24464fa9a781330e4248e805 P 88ef1bd400b94a60b1106cc5063e6a1f: Time spent bootstrapping tablet: real 0.018s user 0.006s sys 0.000s
I20260808 14:35:32.343369 29838 raft_consensus.cc:348] T 9a72f49c24464fa9a781330e4248e805 P 88ef1bd400b94a60b1106cc5063e6a1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ef1bd400b94a60b1106cc5063e6a1f" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 41133 } } peers { permanent_uuid: "bf8a452b15d74c52be7939098bb49627" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 43679 } } peers { permanent_uuid: "9340d39fe3aa43b08ba8e359c3e8084f" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 39001 } }
I20260808 14:35:32.343612 29838 raft_consensus.cc:374] T 9a72f49c24464fa9a781330e4248e805 P 88ef1bd400b94a60b1106cc5063e6a1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:35:32.343688 29838 raft_consensus.cc:729] T 9a72f49c24464fa9a781330e4248e805 P 88ef1bd400b94a60b1106cc5063e6a1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88ef1bd400b94a60b1106cc5063e6a1f, State: Initialized, Role: FOLLOWER
I20260808 14:35:32.344211 29838 consensus_queue.cc:260] T 9a72f49c24464fa9a781330e4248e805 P 88ef1bd400b94a60b1106cc5063e6a1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ef1bd400b94a60b1106cc5063e6a1f" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 41133 } } peers { permanent_uuid: "bf8a452b15d74c52be7939098bb49627" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 43679 } } peers { permanent_uuid: "9340d39fe3aa43b08ba8e359c3e8084f" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 39001 } }
I20260808 14:35:32.345228 29393 heartbeater.cc:503] Master 127.11.131.254:35153 was elected leader, sending a full tablet report...
I20260808 14:35:32.345360 29838 ts_tablet_manager.cc:1428] T 9a72f49c24464fa9a781330e4248e805 P 88ef1bd400b94a60b1106cc5063e6a1f: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 14:35:32.345636 29839 log.cc:824] T 9a72f49c24464fa9a781330e4248e805 P 9340d39fe3aa43b08ba8e359c3e8084f: Log is configured to *not* fsync() on all Append() calls
I20260808 14:35:32.348448 29839 tablet_bootstrap.cc:492] T 9a72f49c24464fa9a781330e4248e805 P 9340d39fe3aa43b08ba8e359c3e8084f: No bootstrap required, opened a new log
I20260808 14:35:32.348723 29839 ts_tablet_manager.cc:1397] T 9a72f49c24464fa9a781330e4248e805 P 9340d39fe3aa43b08ba8e359c3e8084f: Time spent bootstrapping tablet: real 0.018s user 0.007s sys 0.000s
I20260808 14:35:32.359608 29839 raft_consensus.cc:348] T 9a72f49c24464fa9a781330e4248e805 P 9340d39fe3aa43b08ba8e359c3e8084f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ef1bd400b94a60b1106cc5063e6a1f" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 41133 } } peers { permanent_uuid: "bf8a452b15d74c52be7939098bb49627" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 43679 } } peers { permanent_uuid: "9340d39fe3aa43b08ba8e359c3e8084f" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 39001 } }
I20260808 14:35:32.360010 29839 raft_consensus.cc:374] T 9a72f49c24464fa9a781330e4248e805 P 9340d39fe3aa43b08ba8e359c3e8084f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:35:32.360105 29839 raft_consensus.cc:729] T 9a72f49c24464fa9a781330e4248e805 P 9340d39fe3aa43b08ba8e359c3e8084f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9340d39fe3aa43b08ba8e359c3e8084f, State: Initialized, Role: FOLLOWER
I20260808 14:35:32.360841 29839 consensus_queue.cc:260] T 9a72f49c24464fa9a781330e4248e805 P 9340d39fe3aa43b08ba8e359c3e8084f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ef1bd400b94a60b1106cc5063e6a1f" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 41133 } } peers { permanent_uuid: "bf8a452b15d74c52be7939098bb49627" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 43679 } } peers { permanent_uuid: "9340d39fe3aa43b08ba8e359c3e8084f" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 39001 } }
I20260808 14:35:32.362360 29839 ts_tablet_manager.cc:1428] T 9a72f49c24464fa9a781330e4248e805 P 9340d39fe3aa43b08ba8e359c3e8084f: Time spent starting tablet: real 0.014s user 0.007s sys 0.000s
I20260808 14:35:32.362856 29603 heartbeater.cc:503] Master 127.11.131.254:35153 was elected leader, sending a full tablet report...
W20260808 14:35:32.459909 29806 tablet.cc:2369] T 9a72f49c24464fa9a781330e4248e805 P bf8a452b15d74c52be7939098bb49627: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:35:32.467298 29394 tablet.cc:2369] T 9a72f49c24464fa9a781330e4248e805 P 88ef1bd400b94a60b1106cc5063e6a1f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:35:32.585352 29604 tablet.cc:2369] T 9a72f49c24464fa9a781330e4248e805 P 9340d39fe3aa43b08ba8e359c3e8084f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:35:32.600785 29845 raft_consensus.cc:482] T 9a72f49c24464fa9a781330e4248e805 P 9340d39fe3aa43b08ba8e359c3e8084f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:35:32.601068 29845 raft_consensus.cc:504] T 9a72f49c24464fa9a781330e4248e805 P 9340d39fe3aa43b08ba8e359c3e8084f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ef1bd400b94a60b1106cc5063e6a1f" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 41133 } } peers { permanent_uuid: "bf8a452b15d74c52be7939098bb49627" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 43679 } } peers { permanent_uuid: "9340d39fe3aa43b08ba8e359c3e8084f" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 39001 } }
I20260808 14:35:32.602334 29845 leader_election.cc:288] T 9a72f49c24464fa9a781330e4248e805 P 9340d39fe3aa43b08ba8e359c3e8084f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 88ef1bd400b94a60b1106cc5063e6a1f (127.11.131.193:41133), bf8a452b15d74c52be7939098bb49627 (127.11.131.195:43679)
I20260808 14:35:32.607129 29830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:32.602725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:42617 (local address 127.11.131.193:41133)
0808 14:35:32.602890 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:32.602895 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:32.603020 (+ 125us) server_negotiation.cc:407] Connection header received
0808 14:35:32.603219 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:32.603224 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:32.603282 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:32.603359 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:35:32.603799 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:32.604304 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:32.605706 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:32.606335 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:32.606463 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:32.606519 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:32.606839 (+ 320us) server_negotiation.cc:299] Negotiation successful
0808 14:35:32.606926 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 14:35:32.607561 29860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:32.602569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:41133 (local address 127.11.131.194:42617)
0808 14:35:32.602911 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:32.602927 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:32.603057 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:32.603526 (+ 469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:32.603529 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:32.603547 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:35:32.603677 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:32.603682 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:32.604421 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:32.604427 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:32.605489 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:32.605500 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:32.606516 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:32.606520 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:32.606686 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:32.606713 (+ 27us) client_negotiation.cc:769] Sending connection context
0808 14:35:32.607357 (+ 644us) client_negotiation.cc:240] Negotiation successful
0808 14:35:32.607445 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"mutex_wait_us":1,"thread_start_us":149,"threads_started":1}
I20260808 14:35:32.607976 29827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:32.603235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:33269 (local address 127.11.131.195:43679)
0808 14:35:32.603355 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:32.603360 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:32.603501 (+ 141us) server_negotiation.cc:407] Connection header received
0808 14:35:32.603608 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:32.603611 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:32.603663 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:32.603759 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:35:32.604720 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:32.605470 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:32.606639 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:32.607262 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:32.607379 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:32.607425 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:32.607770 (+ 345us) server_negotiation.cc:299] Negotiation successful
0808 14:35:32.607859 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 14:35:32.608351 29861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:32.603066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.195:43679 (local address 127.11.131.194:33269)
0808 14:35:32.603406 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:32.603419 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:35:32.603517 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:35:32.604450 (+ 933us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:35:32.604453 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:35:32.604474 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:35:32.604587 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:32.604593 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:32.605623 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:32.605629 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:32.606507 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:35:32.606516 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:35:32.607497 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:35:32.607501 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:35:32.607624 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:32.607648 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 14:35:32.608121 (+ 473us) client_negotiation.cc:240] Negotiation successful
0808 14:35:32.608196 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":110,"threads_started":1}
I20260808 14:35:32.608315 29326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a72f49c24464fa9a781330e4248e805" candidate_uuid: "9340d39fe3aa43b08ba8e359c3e8084f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ef1bd400b94a60b1106cc5063e6a1f" is_pre_election: true
I20260808 14:35:32.608670 29326 raft_consensus.cc:2454] T 9a72f49c24464fa9a781330e4248e805 P 88ef1bd400b94a60b1106cc5063e6a1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9340d39fe3aa43b08ba8e359c3e8084f in term 0.
I20260808 14:35:32.609038 29719 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a72f49c24464fa9a781330e4248e805" candidate_uuid: "9340d39fe3aa43b08ba8e359c3e8084f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf8a452b15d74c52be7939098bb49627" is_pre_election: true
I20260808 14:35:32.609237 29437 leader_election.cc:302] T 9a72f49c24464fa9a781330e4248e805 P 9340d39fe3aa43b08ba8e359c3e8084f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88ef1bd400b94a60b1106cc5063e6a1f, 9340d39fe3aa43b08ba8e359c3e8084f; no voters:
I20260808 14:35:32.609361 29719 raft_consensus.cc:2454] T 9a72f49c24464fa9a781330e4248e805 P bf8a452b15d74c52be7939098bb49627 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9340d39fe3aa43b08ba8e359c3e8084f in term 0.
I20260808 14:35:32.609512 29845 raft_consensus.cc:2781] T 9a72f49c24464fa9a781330e4248e805 P 9340d39fe3aa43b08ba8e359c3e8084f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:35:32.609614 29845 raft_consensus.cc:482] T 9a72f49c24464fa9a781330e4248e805 P 9340d39fe3aa43b08ba8e359c3e8084f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:35:32.609680 29845 raft_consensus.cc:3037] T 9a72f49c24464fa9a781330e4248e805 P 9340d39fe3aa43b08ba8e359c3e8084f [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:35:32.610857 29845 raft_consensus.cc:504] T 9a72f49c24464fa9a781330e4248e805 P 9340d39fe3aa43b08ba8e359c3e8084f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ef1bd400b94a60b1106cc5063e6a1f" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 41133 } } peers { permanent_uuid: "bf8a452b15d74c52be7939098bb49627" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 43679 } } peers { permanent_uuid: "9340d39fe3aa43b08ba8e359c3e8084f" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 39001 } }
I20260808 14:35:32.611235 29845 leader_election.cc:288] T 9a72f49c24464fa9a781330e4248e805 P 9340d39fe3aa43b08ba8e359c3e8084f [CANDIDATE]: Term 1 election: Requested vote from peers 88ef1bd400b94a60b1106cc5063e6a1f (127.11.131.193:41133), bf8a452b15d74c52be7939098bb49627 (127.11.131.195:43679)
I20260808 14:35:32.611709 29719 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a72f49c24464fa9a781330e4248e805" candidate_uuid: "9340d39fe3aa43b08ba8e359c3e8084f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bf8a452b15d74c52be7939098bb49627"
I20260808 14:35:32.611860 29719 raft_consensus.cc:3037] T 9a72f49c24464fa9a781330e4248e805 P bf8a452b15d74c52be7939098bb49627 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:35:32.611861 29326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a72f49c24464fa9a781330e4248e805" candidate_uuid: "9340d39fe3aa43b08ba8e359c3e8084f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "88ef1bd400b94a60b1106cc5063e6a1f"
I20260808 14:35:32.612031 29326 raft_consensus.cc:3037] T 9a72f49c24464fa9a781330e4248e805 P 88ef1bd400b94a60b1106cc5063e6a1f [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:35:32.613085 29326 raft_consensus.cc:2454] T 9a72f49c24464fa9a781330e4248e805 P 88ef1bd400b94a60b1106cc5063e6a1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9340d39fe3aa43b08ba8e359c3e8084f in term 1.
I20260808 14:35:32.613225 29719 raft_consensus.cc:2454] T 9a72f49c24464fa9a781330e4248e805 P bf8a452b15d74c52be7939098bb49627 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9340d39fe3aa43b08ba8e359c3e8084f in term 1.
I20260808 14:35:32.613481 29437 leader_election.cc:302] T 9a72f49c24464fa9a781330e4248e805 P 9340d39fe3aa43b08ba8e359c3e8084f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 88ef1bd400b94a60b1106cc5063e6a1f, 9340d39fe3aa43b08ba8e359c3e8084f; no voters:
I20260808 14:35:32.613731 29845 raft_consensus.cc:2781] T 9a72f49c24464fa9a781330e4248e805 P 9340d39fe3aa43b08ba8e359c3e8084f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:35:32.614010 29845 raft_consensus.cc:686] T 9a72f49c24464fa9a781330e4248e805 P 9340d39fe3aa43b08ba8e359c3e8084f [term 1 LEADER]: Becoming Leader. State: Replica: 9340d39fe3aa43b08ba8e359c3e8084f, State: Running, Role: LEADER
I20260808 14:35:32.614382 29845 consensus_queue.cc:237] T 9a72f49c24464fa9a781330e4248e805 P 9340d39fe3aa43b08ba8e359c3e8084f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ef1bd400b94a60b1106cc5063e6a1f" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 41133 } } peers { permanent_uuid: "bf8a452b15d74c52be7939098bb49627" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 43679 } } peers { permanent_uuid: "9340d39fe3aa43b08ba8e359c3e8084f" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 39001 } }
I20260808 14:35:32.618057 29050 catalog_manager.cc:5495] T 9a72f49c24464fa9a781330e4248e805 P 9340d39fe3aa43b08ba8e359c3e8084f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9340d39fe3aa43b08ba8e359c3e8084f (127.11.131.194). New cstate: current_term: 1 leader_uuid: "9340d39fe3aa43b08ba8e359c3e8084f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88ef1bd400b94a60b1106cc5063e6a1f" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 41133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bf8a452b15d74c52be7939098bb49627" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 43679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9340d39fe3aa43b08ba8e359c3e8084f" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 39001 } health_report { overall_health: HEALTHY } } }
I20260808 14:35:32.643738 29832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:32.639626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37368 (local address 127.11.131.194:39001)
0808 14:35:32.639761 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 14:35:32.639766 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:35:32.639781 (+ 15us) server_negotiation.cc:407] Connection header received
0808 14:35:32.639921 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:35:32.639923 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:35:32.639981 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:35:32.640074 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:35:32.640365 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:32.640870 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:32.642143 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:35:32.642395 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:35:32.642488 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:35:32.642846 (+ 358us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:35:32.643301 (+ 455us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:35:32.643398 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 14:35:32.643505 (+ 107us) server_negotiation.cc:299] Negotiation successful
0808 14:35:32.643559 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 14:35:32.650626 29326 raft_consensus.cc:1261] T 9a72f49c24464fa9a781330e4248e805 P 88ef1bd400b94a60b1106cc5063e6a1f [term 1 FOLLOWER]: Refusing update from remote peer 9340d39fe3aa43b08ba8e359c3e8084f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:35:32.650599 29719 raft_consensus.cc:1261] T 9a72f49c24464fa9a781330e4248e805 P bf8a452b15d74c52be7939098bb49627 [term 1 FOLLOWER]: Refusing update from remote peer 9340d39fe3aa43b08ba8e359c3e8084f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:35:32.651439 29864 consensus_queue.cc:1035] T 9a72f49c24464fa9a781330e4248e805 P 9340d39fe3aa43b08ba8e359c3e8084f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bf8a452b15d74c52be7939098bb49627" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 43679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:35:32.651674 29845 consensus_queue.cc:1035] T 9a72f49c24464fa9a781330e4248e805 P 9340d39fe3aa43b08ba8e359c3e8084f [LEADER]: Connected to new peer: Peer: permanent_uuid: "88ef1bd400b94a60b1106cc5063e6a1f" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 41133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:35:32.659587 29867 mvcc.cc:205] Tried to move back new op lower bound from 7316274104928555008 to 7316274104791486464. Current Snapshot: MvccSnapshot[applied={T|T < 7316274104928555008}]
I20260808 14:35:32.662344 29869 mvcc.cc:205] Tried to move back new op lower bound from 7316274104928555008 to 7316274104791486464. Current Snapshot: MvccSnapshot[applied={T|T < 7316274104928555008}]
I20260808 14:35:32.672775 29050 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36440:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:35:32.672969 29050 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36440:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:35:32.675901 29050 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8fe7211de7694aa28a93545a2685c88b: Sending DeleteTablet for 3 replicas of tablet 9a72f49c24464fa9a781330e4248e805
I20260808 14:35:32.676812 29482 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a72f49c24464fa9a781330e4248e805 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:35:32 UTC) from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:51852
I20260808 14:35:32.677067 29292 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a72f49c24464fa9a781330e4248e805 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:35:32 UTC) from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:38480
I20260808 14:35:32.677608 29884 tablet_replica.cc:330] T 9a72f49c24464fa9a781330e4248e805 P 88ef1bd400b94a60b1106cc5063e6a1f: stopping tablet replica
I20260808 14:35:32.677608 29707 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a72f49c24464fa9a781330e4248e805 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:35:32 UTC) from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:53910
I20260808 14:35:32.678021 29884 raft_consensus.cc:2229] T 9a72f49c24464fa9a781330e4248e805 P 88ef1bd400b94a60b1106cc5063e6a1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:35:32.678426 29884 raft_consensus.cc:2258] T 9a72f49c24464fa9a781330e4248e805 P 88ef1bd400b94a60b1106cc5063e6a1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:35:32.678648 29885 tablet_replica.cc:330] T 9a72f49c24464fa9a781330e4248e805 P bf8a452b15d74c52be7939098bb49627: stopping tablet replica
I20260808 14:35:32.678990 29885 raft_consensus.cc:2229] T 9a72f49c24464fa9a781330e4248e805 P bf8a452b15d74c52be7939098bb49627 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:35:32.679102 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 29184
I20260808 14:35:32.714946 29885 raft_consensus.cc:2258] T 9a72f49c24464fa9a781330e4248e805 P bf8a452b15d74c52be7939098bb49627 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:35:32.715807 29883 tablet_replica.cc:330] T 9a72f49c24464fa9a781330e4248e805 P 9340d39fe3aa43b08ba8e359c3e8084f: stopping tablet replica
I20260808 14:35:32.716341 29883 raft_consensus.cc:2229] T 9a72f49c24464fa9a781330e4248e805 P 9340d39fe3aa43b08ba8e359c3e8084f [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:35:32.716919 29883 raft_consensus.cc:2258] T 9a72f49c24464fa9a781330e4248e805 P 9340d39fe3aa43b08ba8e359c3e8084f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:35:32.717283 29885 ts_tablet_manager.cc:1905] T 9a72f49c24464fa9a781330e4248e805 P bf8a452b15d74c52be7939098bb49627: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:35:32.720872 29885 ts_tablet_manager.cc:1918] T 9a72f49c24464fa9a781330e4248e805 P bf8a452b15d74c52be7939098bb49627: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:35:32.721082 29885 log.cc:1196] T 9a72f49c24464fa9a781330e4248e805 P bf8a452b15d74c52be7939098bb49627: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786199615258783-11791-0/minicluster-data/ts-2/wal/wals/9a72f49c24464fa9a781330e4248e805
I20260808 14:35:32.721405 29883 ts_tablet_manager.cc:1905] T 9a72f49c24464fa9a781330e4248e805 P 9340d39fe3aa43b08ba8e359c3e8084f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:35:32.721572 29885 ts_tablet_manager.cc:1939] T 9a72f49c24464fa9a781330e4248e805 P bf8a452b15d74c52be7939098bb49627: Deleting consensus metadata
I20260808 14:35:32.723112 29026 catalog_manager.cc:4841] TS bf8a452b15d74c52be7939098bb49627 (127.11.131.195:43679): tablet 9a72f49c24464fa9a781330e4248e805 (table test-table [id=7b702b5ab93e462b9bb223e286607b6f]) successfully deleted
W20260808 14:35:32.724352 29026 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.131.193:41133 (error 108)
I20260808 14:35:32.724570 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 29407
I20260808 14:35:32.750123 29823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:32.749517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:41133 (local address 127.0.0.1:35422)
0808 14:35:32.749826 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:32.749974 (+ 148us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.193:41133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185}
W20260808 14:35:32.750701 29026 catalog_manager.cc:4584] TS 88ef1bd400b94a60b1106cc5063e6a1f (127.11.131.193:41133): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9a72f49c24464fa9a781330e4248e805: Network error: Client connection negotiation failed: client connection to 127.11.131.193:41133: connect: Connection refused (error 111)
I20260808 14:35:32.759388 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 29608
I20260808 14:35:32.759529 29823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:35:32.759228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.194:39001 (local address 127.0.0.1:37380)
0808 14:35:32.759353 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0808 14:35:32.759414 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.194:39001: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260808 14:35:32.773993 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 29005
I20260808 14:35:32.791368 11791 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 14:35:33.138505 11791 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 14:35:33.138705 11791 mini_ranger.cc:66] Stopping Ranger...
I20260808 14:35:33.494009 11791 mini_ranger.cc:68] Stopped Ranger
2026-08-08 14:35:33.494 UTC [28372] LOG: received smart shutdown request
2026-08-08 14:35:33.498 UTC [28372] LOG: background worker "logical replication launcher" (PID 28388) exited with exit code 1
2026-08-08 14:35:33.498 UTC [28379] LOG: shutting down
2026-08-08 14:35:33.665 UTC [28372] LOG: database system is shut down
2026-08-08T14:35:33Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (49303 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:35:33 dist-test-slave-twwt krb5kdc[29903](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:35:33 dist-test-slave-twwt krb5kdc[29903](info): set up 2 sockets
Aug 08 14:35:33 dist-test-slave-twwt krb5kdc[29903](info): commencing operation
krb5kdc: starting...
W20260808 14:35:35.036173 11791 mini_kdc.cc:121] Time spent starting KDC: real 1.225s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Aug 08 14:35:35 dist-test-slave-twwt krb5kdc[29903](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199735, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:35:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:35:35Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.11.131.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.11.131.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.11.131.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/rangeradmin_127.11.131.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.11.131.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/rangeradmin_127.11.131.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.11.131.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.11.131.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.11.131.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/rangerlookup_127.11.131.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.11.131.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/rangerlookup_127.11.131.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.131.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.11.131.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.131.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/HTTP_127.11.131.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.131.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/HTTP_127.11.131.212@KRBTEST.COM.keytab.
I20260808 14:35:35.229359 11791 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskR7JPPN/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/postgres -l logfile start
2026-08-08 14:35:37.809 UTC [29951] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 14:35:37.809 UTC [29951] LOG: listening on IPv4 address "127.11.131.212", port 34633
2026-08-08 14:35:37.813 UTC [29951] LOG: listening on Unix socket "/tmp/.s.PGSQL.34633"
2026-08-08 14:35:37.835 UTC [29955] LOG: database system was shut down at 2026-08-08 14:35:36 UTC
2026-08-08 14:35:37.839 UTC [29951] LOG: database system is ready to accept connections
I20260808 14:35:39.004455 11791 mini_postgres.cc:96] Postgres bound to 34633
2026-08-08 14:35:39.012 UTC [29965] FATAL: database "slave" does not exist
127.11.131.212:34633 - accepting connections
I20260808 14:35:39.013284 11791 mini_ranger.cc:161] Starting Ranger...
I20260808 14:35:39.030190 11791 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 14:35:39.542979 11791 mini_ranger.cc:87] Created ranger Postgres database
I20260808 14:35:39.543056 11791 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ranger-admin
2026-08-08 14:35:39,820 [I] DB FLAVOR :POSTGRES
2026-08-08 14:35:39,821 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 14:35:39,821 [I] Checking connection..
2026-08-08 14:35:39,821 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskR7JPPN/build/debug/bin/postgresql.jar:/tmp/dist-test-taskR7JPPN/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.131.212:34633/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 14:35:40,076 [I] Checking connection passed.
2026-08-08 14:35:40,077 [I] --------- Verifying version history table ---------
2026-08-08 14:35:40,077 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskR7JPPN/build/debug/bin/postgresql.jar:/tmp/dist-test-taskR7JPPN/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.131.212:34633/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 14:35:40,347 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 14:35:40,348 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskR7JPPN/build/debug/bin/postgresql.jar:/tmp/dist-test-taskR7JPPN/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.131.212:34633/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 14:35:40,613 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 14:35:40,614 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 14:35:40,614 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskR7JPPN/build/debug/bin/postgresql.jar:/tmp/dist-test-taskR7JPPN/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.131.212:34633/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskR7JPPN/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 14:35:40.877 UTC [30074] WARNING: there is no transaction in progress
2026-08-08 14:35:40,886 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 14:35:40,886 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskR7JPPN/build/debug/bin/postgresql.jar:/tmp/dist-test-taskR7JPPN/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.131.212:34633/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 14:35:41,133 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 14:35:41,133 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 14:35:41,134 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskR7JPPN/build/debug/bin/postgresql.jar:/tmp/dist-test-taskR7JPPN/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.131.212:34633/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 14:35:41,397 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskR7JPPN/build/debug/bin/postgresql.jar:/tmp/dist-test-taskR7JPPN/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.131.212:34633/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 14:35:41,650 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskR7JPPN/build/debug/bin/postgresql.jar:/tmp/dist-test-taskR7JPPN/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.131.212:34633/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-twwt.c.gcp-upstream.internal','N') ;"
2026-08-08 14:35:41,911 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskR7JPPN/build/debug/bin/postgresql.jar:/tmp/dist-test-taskR7JPPN/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.131.212:34633/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 14:35:42,181 [I] Table x_portal_user does not exist in database ranger
2026-08-08 14:35:42,181 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskR7JPPN/build/debug/bin/postgresql.jar:/tmp/dist-test-taskR7JPPN/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.131.212:34633/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 14:35:42,435 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 14:35:42,435 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskR7JPPN/build/debug/bin/postgresql.jar:/tmp/dist-test-taskR7JPPN/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.131.212:34633/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 14:35:42,697 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskR7JPPN/build/debug/bin/postgresql.jar:/tmp/dist-test-taskR7JPPN/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.131.212:34633/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 14:35:42,965 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 14:35:42,965 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskR7JPPN/build/debug/bin/postgresql.jar:/tmp/dist-test-taskR7JPPN/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.131.212:34633/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskR7JPPN/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 14:35:43.978 UTC [30246] WARNING: there is no transaction in progress
2026-08-08 14:35:43.993 UTC [30246] WARNING: there is no transaction in progress
2026-08-08 14:35:44.009 UTC [30246] WARNING: there is no transaction in progress
2026-08-08 14:35:44.024 UTC [30246] WARNING: there is no transaction in progress
2026-08-08 14:35:44.044 UTC [30246] WARNING: there is no transaction in progress
2026-08-08 14:35:44.062 UTC [30246] WARNING: there is no transaction in progress
2026-08-08 14:35:44.117 UTC [30246] WARNING: there is no transaction in progress
2026-08-08 14:35:44.124 UTC [30246] WARNING: there is no transaction in progress
2026-08-08 14:35:44.139 UTC [30246] WARNING: there is no transaction in progress
2026-08-08 14:35:44.149 UTC [30246] WARNING: there is no transaction in progress
2026-08-08 14:35:44.161 UTC [30246] WARNING: there is no transaction in progress
2026-08-08 14:35:44.175 UTC [30246] WARNING: there is no transaction in progress
2026-08-08 14:35:44.185 UTC [30246] WARNING: there is no transaction in progress
2026-08-08 14:35:44.192 UTC [30246] WARNING: there is no transaction in progress
2026-08-08 14:35:44.199 UTC [30246] WARNING: there is no transaction in progress
2026-08-08 14:35:44.206 UTC [30246] WARNING: there is no transaction in progress
2026-08-08 14:35:44,864 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 14:35:44,864 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskR7JPPN/build/debug/bin/postgresql.jar:/tmp/dist-test-taskR7JPPN/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.131.212:34633/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 14:35:45,126 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 14:35:45,127 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskR7JPPN/build/debug/bin/postgresql.jar:/tmp/dist-test-taskR7JPPN/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.131.212:34633/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 14:35:45,395 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 14:35:45,396 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskR7JPPN/build/debug/bin/postgresql.jar:/tmp/dist-test-taskR7JPPN/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.131.212:34633/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 14:35:45,674 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 14:35:45,674 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskR7JPPN/build/debug/bin/postgresql.jar:/tmp/dist-test-taskR7JPPN/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.131.212:34633/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 14:35:45,914 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskR7JPPN/build/debug/bin/postgresql.jar:/tmp/dist-test-taskR7JPPN/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.131.212:34633/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 14:35:46,188 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskR7JPPN/build/debug/bin/postgresql.jar:/tmp/dist-test-taskR7JPPN/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.131.212:34633/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-twwt.c.gcp-upstream.internal';"
2026-08-08 14:35:46,448 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 14:35:46,449 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskR7JPPN/build/debug/bin/postgresql.jar:/tmp/dist-test-taskR7JPPN/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.131.212:34633/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 14:35:46,704 [I] DB_PATCHES have already been applied
I20260808 14:35:46.710492 11791 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ranger-admin:/tmp/dist-test-taskR7JPPN/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskR7JPPN/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskR7JPPN/build/debug/bin/postgresql.jar:/tmp/dist-test-taskR7JPPN/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 14:35:46.710561 11791 mini_ranger.cc:193] Using host: 127.11.131.212
I20260808 14:35:46.715515 11791 mini_ranger.cc:227] Ranger admin URL: http://127.11.131.212:51575
Aug 08, 2026 2:35:47 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 2:35:47 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 2:35:47 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 2:35:47 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 2:35:47 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 2:35:47 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 2:35:47 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 14:35:48.094563 11791 mini_ranger.cc:160] Time spent starting Ranger: real 9.081s user 0.002s sys 0.010s
Aug 08, 2026 2:36:08 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 2:36:08 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 08, 2026 2:36:08 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 2:36:09 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 2:36:09 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 2:36:09 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 2:36:09 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 2:36:09 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 2:36:09 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 2:36:09 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 2:36:09 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 2:36:09 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 2:36:09 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 2:36:09 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 2:36:09 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 2:36:09 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 2:36:09 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 2:36:10 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 14:36:10.634111 11791 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.11.131.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.11.131.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.11.131.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/rangerkms_127.11.131.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.11.131.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/rangerkms_127.11.131.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.131.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.11.131.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.131.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/HTTP_127.11.131.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.131.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/HTTP_127.11.131.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 14:36:10 dist-test-slave-twwt krb5kdc[29903](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199770, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 14:36:10.750824 11791 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 14:36:10.763391 11791 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 14:36:11.638846 11791 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 14:36:11.638952 11791 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ranger-kms
I20260808 14:36:11.638972 11791 mini_ranger_kms.cc:227] Using postgres at 127.11.131.212:34633
2026-08-08 14:36:11,827 [I] DB FLAVOR :POSTGRES
2026-08-08 14:36:11,828 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 14:36:11,828 [I] Checking connection
2026-08-08 14:36:11,828 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskR7JPPN/build/debug/bin/postgresql.jar:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.131.212:34633/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 14:36:12,089 [I] connection success
2026-08-08 14:36:12,090 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 14:36:12,090 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 14:36:12,090 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskR7JPPN/build/debug/bin/postgresql.jar:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.131.212:34633/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 14:36:12,333 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 14:36:12,334 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 14:36:12,334 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 14:36:12,334 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskR7JPPN/build/debug/bin/postgresql.jar:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.131.212:34633/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 14:36:12,630 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 14:36:13.150175 11791 mini_ranger_kms.cc:310] Created kms service
I20260808 14:36:13.335693 11791 mini_ranger_kms.cc:326] Created kudu user
I20260808 14:36:13.386363 11791 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 14:36:13 dist-test-slave-twwt krb5kdc[29903](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199770, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.11.131.212@KRBTEST.COM
I20260808 14:36:13.842998 11791 mini_ranger_kms.cc:384] Added ranger policy
I20260808 14:36:13.843129 11791 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ranger-kms:/tmp/dist-test-taskR7JPPN/build/debug/bin/postgresql.jar:/tmp/dist-test-taskR7JPPN/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskR7JPPN/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 14:36:13.843149 11791 mini_ranger_kms.cc:240] Using host: 127.11.131.212
I20260808 14:36:13.848169 11791 mini_ranger_kms.cc:276] Ranger KMS PID: 30525
I20260808 14:36:13.848263 11791 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.11.131.212:46217
Aug 08, 2026 2:36:14 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 2:36:14 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 2:36:15 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 2:36:15 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 2:36:15 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 2:36:15 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 08 14:36:16 dist-test-slave-twwt krb5kdc[29903](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786199776, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.131.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:16.553601 11791 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.803s user 0.019s sys 0.156s
I20260808 14:36:16.553741 11791 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 14:36:16.553822 11791 mini_ranger_kms.cc:401] 127.11.131.212:46217/kms/v1/keys
Aug 08 14:36:16 dist-test-slave-twwt krb5kdc[29903](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199776, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.131.212@KRBTEST.COM for HTTP/127.11.131.212@KRBTEST.COM
Aug 08 14:36:17 dist-test-slave-twwt krb5kdc[29903](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199776, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.131.212@KRBTEST.COM for HTTP/127.11.131.212@KRBTEST.COM
Aug 08 14:36:19 dist-test-slave-twwt krb5kdc[29903](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199779, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.11.131.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
I20260808 14:36:19.466683 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:41531
--webserver_interface=127.11.131.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:32915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:41531
--ranger_config_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.131.212:46217/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:36:19.614044 30595 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:19.614329 30595 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:19.614369 30595 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:19.618312 30595 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:36:19.618372 30595 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:19.618391 30595 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:19.618407 30595 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:36:19.618422 30595 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:36:19.623804 30595 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:32915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/master-0/wal
--ranger_kms_url=127.11.131.212:46217/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:41531
--ranger_config_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:41531
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.131.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30595
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:36:19.624810 30595 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:19.625809 30595 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:19.635013 30607 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:19.635013 30609 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:19.635090 30595 server_base.cc:1034] running on GCE node
W20260808 14:36:19.635088 30605 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:19.635809 30595 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:19.636933 30595 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:19.638103 30595 hybrid_clock.cc:648] HybridClock initialized: now 1786199779638077 us; error 37 us; skew 500 ppm
Aug 08 14:36:19 dist-test-slave-twwt krb5kdc[29903](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199779, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:19.640836 30595 init.cc:377] Logged in from keytab as kudu/127.11.131.254@KRBTEST.COM (short username kudu)
I20260808 14:36:19.641638 30595 webserver.cc:460] Webserver started at http://127.11.131.254:36783/ using document root <none> and password file <none>
I20260808 14:36:19.642135 30595 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:19.642184 30595 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:19.642350 30595 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 14:36:19 dist-test-slave-twwt krb5kdc[29903](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199779, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for HTTP/127.11.131.212@KRBTEST.COM
I20260808 14:36:19.705190 30595 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/master-0/data/instance:
uuid: "2c885f5400754ef89d8bc8285cb18430"
format_stamp: "Formatted at 2026-08-08 14:36:19 on dist-test-slave-twwt"
server_key: "c792ac165e1a5ab3463e70ab00d548ac"
server_key_iv: "1b3f180a391acb21a8bc6980ab75fde9"
server_key_version: "kuduclusterkey@0"
I20260808 14:36:19.706041 30595 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/master-0/wal/instance:
uuid: "2c885f5400754ef89d8bc8285cb18430"
format_stamp: "Formatted at 2026-08-08 14:36:19 on dist-test-slave-twwt"
server_key: "c792ac165e1a5ab3463e70ab00d548ac"
server_key_iv: "1b3f180a391acb21a8bc6980ab75fde9"
server_key_version: "kuduclusterkey@0"
I20260808 14:36:19.711313 30595 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260808 14:36:19.726377 30618 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:19.727970 30595 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 14:36:19.728132 30595 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "2c885f5400754ef89d8bc8285cb18430"
format_stamp: "Formatted at 2026-08-08 14:36:19 on dist-test-slave-twwt"
server_key: "c792ac165e1a5ab3463e70ab00d548ac"
server_key_iv: "1b3f180a391acb21a8bc6980ab75fde9"
server_key_version: "kuduclusterkey@0"
I20260808 14:36:19.728251 30595 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:19.738379 30595 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:19.740862 30595 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:19.741032 30595 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:19.748715 30595 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.254:41531
I20260808 14:36:19.748736 30703 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.254:41531 every 8 connection(s)
I20260808 14:36:19.749819 30595 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:36:19.753028 30704 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:36:19.756589 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 30595
I20260808 14:36:19.756735 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/master-0/wal/instance
I20260808 14:36:19.757076 11791 external_mini_cluster.cc:1428] Setting key edb8863c743070996c145a812aff6286
I20260808 14:36:19.759747 30704 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c885f5400754ef89d8bc8285cb18430: Bootstrap starting.
I20260808 14:36:19.762461 30704 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2c885f5400754ef89d8bc8285cb18430: Neither blocks nor log segments found. Creating new log.
I20260808 14:36:19.763464 30704 log.cc:824] T 00000000000000000000000000000000 P 2c885f5400754ef89d8bc8285cb18430: Log is configured to *not* fsync() on all Append() calls
I20260808 14:36:19.765985 30704 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c885f5400754ef89d8bc8285cb18430: No bootstrap required, opened a new log
Aug 08 14:36:19 dist-test-slave-twwt krb5kdc[29903](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199779, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:36:19.769621 30704 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2c885f5400754ef89d8bc8285cb18430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c885f5400754ef89d8bc8285cb18430" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 41531 } }
I20260808 14:36:19.769896 30704 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2c885f5400754ef89d8bc8285cb18430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:36:19.769990 30704 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2c885f5400754ef89d8bc8285cb18430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c885f5400754ef89d8bc8285cb18430, State: Initialized, Role: FOLLOWER
I20260808 14:36:19.770460 30704 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2c885f5400754ef89d8bc8285cb18430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c885f5400754ef89d8bc8285cb18430" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 41531 } }
I20260808 14:36:19.770633 30704 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2c885f5400754ef89d8bc8285cb18430 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:36:19.770713 30704 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2c885f5400754ef89d8bc8285cb18430 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:36:19.770835 30704 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2c885f5400754ef89d8bc8285cb18430 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:36:19.771879 30704 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2c885f5400754ef89d8bc8285cb18430 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c885f5400754ef89d8bc8285cb18430" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 41531 } }
I20260808 14:36:19.772239 30704 leader_election.cc:302] T 00000000000000000000000000000000 P 2c885f5400754ef89d8bc8285cb18430 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2c885f5400754ef89d8bc8285cb18430; no voters:
I20260808 14:36:19.772629 30704 leader_election.cc:288] T 00000000000000000000000000000000 P 2c885f5400754ef89d8bc8285cb18430 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:36:19.772665 30710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:19.758713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59814 (local address 127.11.131.254:41531)
0808 14:36:19.759153 (+ 440us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:19.759181 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:19.759221 (+ 40us) server_negotiation.cc:407] Connection header received
0808 14:36:19.759965 (+ 744us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:19.759985 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:19.760343 (+ 358us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:19.760646 (+ 303us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:19.761592 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:19.762661 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:19.763833 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:19.764533 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:19.764666 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:19.767623 (+ 2957us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:19.767629 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:19.767645 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:19.767674 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:19.769394 (+ 1720us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:19.769884 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:19.769889 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:19.769920 (+ 31us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:19.770070 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:19.770411 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:19.770414 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:19.770416 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:19.771012 (+ 596us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:19.771232 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:19.771506 (+ 274us) server_negotiation.cc:299] Negotiation successful
0808 14:36:19.771809 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":287,"thread_start_us":142,"threads_started":1}
I20260808 14:36:19.772714 30712 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2c885f5400754ef89d8bc8285cb18430 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:36:19.773059 30712 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2c885f5400754ef89d8bc8285cb18430 [term 1 LEADER]: Becoming Leader. State: Replica: 2c885f5400754ef89d8bc8285cb18430, State: Running, Role: LEADER
I20260808 14:36:19.773439 30712 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2c885f5400754ef89d8bc8285cb18430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c885f5400754ef89d8bc8285cb18430" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 41531 } }
I20260808 14:36:19.774035 30704 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2c885f5400754ef89d8bc8285cb18430 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:36:19.774726 30712 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c885f5400754ef89d8bc8285cb18430 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2c885f5400754ef89d8bc8285cb18430" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c885f5400754ef89d8bc8285cb18430" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 41531 } } }
I20260808 14:36:19.774942 30712 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c885f5400754ef89d8bc8285cb18430 [sys.catalog]: This master's current role is: LEADER
I20260808 14:36:19.775213 30712 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c885f5400754ef89d8bc8285cb18430 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2c885f5400754ef89d8bc8285cb18430. Latest consensus state: current_term: 1 leader_uuid: "2c885f5400754ef89d8bc8285cb18430" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c885f5400754ef89d8bc8285cb18430" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 41531 } } }
I20260808 14:36:19.775375 30712 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c885f5400754ef89d8bc8285cb18430 [sys.catalog]: This master's current role is: LEADER
I20260808 14:36:19.775684 30723 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:36:19.779067 30723 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:36:19.779511 30704 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 14:36:19.789870 30723 catalog_manager.cc:1347] Generated new cluster ID: ec76018f54c147da92edc25970ba9f38
I20260808 14:36:19.789961 30723 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:36:19.808162 30723 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:36:19.809340 30723 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:36:19.815814 30723 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2c885f5400754ef89d8bc8285cb18430: Generated new TSK 0
I20260808 14:36:19.816663 30723 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.131.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab.
Entry for principal kudu/127.11.131.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab.
I20260808 14:36:20.479997 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.131.212:46217/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.193:0
--local_ip_for_outbound_sockets=127.11.131.193
--webserver_interface=127.11.131.193
--webserver_port=0
--tserver_master_addrs=127.11.131.254:41531
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab
--principal=kudu/127.11.131.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:32915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:36:20.648558 30778 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:20.648844 30778 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:20.648921 30778 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:20.652987 30778 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:20.653074 30778 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:20.653164 30778 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.193
I20260808 14:36:20.659435 30778 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:32915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.11.131.212:46217/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab
--principal=kudu/127.11.131.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.131.193
--webserver_port=0
--tserver_master_addrs=127.11.131.254:41531
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30778
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.193
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:36:20.660580 30778 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:20.661938 30778 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:20.674721 30798 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:20.674769 30793 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:20.675127 30794 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:20.675434 30778 server_base.cc:1034] running on GCE node
I20260808 14:36:20.675873 30778 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:20.676592 30778 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:20.677795 30778 hybrid_clock.cc:648] HybridClock initialized: now 1786199780677754 us; error 55 us; skew 500 ppm
Aug 08 14:36:20 dist-test-slave-twwt krb5kdc[29903](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199780, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:20.681339 30778 init.cc:377] Logged in from keytab as kudu/127.11.131.193@KRBTEST.COM (short username kudu)
I20260808 14:36:20.682566 30778 webserver.cc:460] Webserver started at http://127.11.131.193:46499/ using document root <none> and password file <none>
I20260808 14:36:20.683369 30778 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:20.683478 30778 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:20.683812 30778 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 14:36:20 dist-test-slave-twwt krb5kdc[29903](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199780, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.193@KRBTEST.COM for HTTP/127.11.131.212@KRBTEST.COM
I20260808 14:36:20.704411 30778 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-0/data/instance:
uuid: "8cbb165ca2e54a1496f1e568489dde0d"
format_stamp: "Formatted at 2026-08-08 14:36:20 on dist-test-slave-twwt"
server_key: "6d36c7e00e690ff368230cb67ab99155"
server_key_iv: "2ac8248ba6b03b5d1fb3d542b7409cf7"
server_key_version: "kuduclusterkey@0"
I20260808 14:36:20.706436 30778 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-0/wal/instance:
uuid: "8cbb165ca2e54a1496f1e568489dde0d"
format_stamp: "Formatted at 2026-08-08 14:36:20 on dist-test-slave-twwt"
server_key: "6d36c7e00e690ff368230cb67ab99155"
server_key_iv: "2ac8248ba6b03b5d1fb3d542b7409cf7"
server_key_version: "kuduclusterkey@0"
I20260808 14:36:20.716070 30778 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.003s sys 0.001s
I20260808 14:36:20.733420 30806 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:20.735378 30778 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260808 14:36:20.735654 30778 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-0/wal
uuid: "8cbb165ca2e54a1496f1e568489dde0d"
format_stamp: "Formatted at 2026-08-08 14:36:20 on dist-test-slave-twwt"
server_key: "6d36c7e00e690ff368230cb67ab99155"
server_key_iv: "2ac8248ba6b03b5d1fb3d542b7409cf7"
server_key_version: "kuduclusterkey@0"
I20260808 14:36:20.735916 30778 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:20.783077 30778 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:20.787299 30778 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:20.787578 30778 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:20.788409 30778 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:36:20.789618 30778 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:36:20.789691 30778 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:20.789783 30778 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:36:20.789822 30778 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:20.800853 30778 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.193:45817
I20260808 14:36:20.802031 30778 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
I20260808 14:36:20.802584 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 30778
I20260808 14:36:20.802738 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-0/wal/instance
I20260808 14:36:20.803026 11791 external_mini_cluster.cc:1428] Setting key 471cedca244325d94209269c5093bb7f
I20260808 14:36:20.806031 30985 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.193:45817 every 8 connection(s)
Aug 08 14:36:20 dist-test-slave-twwt krb5kdc[29903](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199780, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.193@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:36:20.823105 30988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:20.806386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:41531 (local address 127.11.131.193:46095)
0808 14:36:20.807791 (+ 1405us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:20.807852 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:20.808763 (+ 911us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:20.809453 (+ 690us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:20.809459 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:20.809777 (+ 318us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:20.810274 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:20.810288 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:20.811652 (+ 1364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:20.811656 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:20.813095 (+ 1439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:20.813112 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:20.814004 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:20.814010 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:20.814207 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:20.814949 (+ 742us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:20.814972 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:20.817019 (+ 2047us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:20.819406 (+ 2387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:20.819412 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:20.819429 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:20.819811 (+ 382us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:20.820179 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:20.820182 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:20.820184 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:20.820373 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:20.820903 (+ 530us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:20.820912 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:20.821305 (+ 393us) client_negotiation.cc:769] Sending connection context
0808 14:36:20.821538 (+ 233us) client_negotiation.cc:240] Negotiation successful
0808 14:36:20.821929 (+ 391us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1142,"thread_start_us":192,"threads_started":1}
I20260808 14:36:20.823948 30991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:20.807539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:46095 (local address 127.11.131.254:41531)
0808 14:36:20.807818 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:20.807827 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:20.807963 (+ 136us) server_negotiation.cc:407] Connection header received
0808 14:36:20.808981 (+ 1018us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:20.808984 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:20.809048 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:20.809144 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:20.810427 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:20.811247 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:20.813257 (+ 2010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:20.813662 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:20.813791 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:20.817232 (+ 3441us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:20.817237 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:20.817240 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:20.817269 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:20.819262 (+ 1993us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:20.819949 (+ 687us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:20.819952 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:20.819954 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:20.820051 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:20.820492 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:20.820496 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:20.820498 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:20.820741 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:20.820843 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:20.823699 (+ 2856us) server_negotiation.cc:299] Negotiation successful
0808 14:36:20.823825 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":212,"thread_start_us":105,"threads_started":1}
I20260808 14:36:20.825132 30986 heartbeater.cc:347] Connected to a master server at 127.11.131.254:41531
I20260808 14:36:20.825420 30986 heartbeater.cc:464] Registering TS with master...
I20260808 14:36:20.825951 30986 heartbeater.cc:511] Master 127.11.131.254:41531 requested a full tablet report, sending...
I20260808 14:36:20.827672 30641 ts_manager.cc:194] Registered new tserver with Master: 8cbb165ca2e54a1496f1e568489dde0d (127.11.131.193:45817)
I20260808 14:36:20.828886 30641 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.193@KRBTEST.COM'} at 127.11.131.193:46095
WARNING: no policy specified for kudu/127.11.131.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab.
Entry for principal kudu/127.11.131.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab.
I20260808 14:36:20.859637 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.131.212:46217/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.194:0
--local_ip_for_outbound_sockets=127.11.131.194
--webserver_interface=127.11.131.194
--webserver_port=0
--tserver_master_addrs=127.11.131.254:41531
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab
--principal=kudu/127.11.131.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:32915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 14:36:20 dist-test-slave-twwt krb5kdc[29903](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786199780, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260808 14:36:21.022850 30995 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:21.023283 30995 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:21.023358 30995 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:21.029627 30995 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:21.029724 30995 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:21.029819 30995 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.194
I20260808 14:36:21.038259 30995 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:32915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.11.131.212:46217/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab
--principal=kudu/127.11.131.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.131.194
--webserver_port=0
--tserver_master_addrs=127.11.131.254:41531
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30995
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.194
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:36:21.039752 30995 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:21.041181 30995 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:21.054522 31008 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:21.054505 31012 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:21.055164 31007 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:21.055493 30995 server_base.cc:1034] running on GCE node
I20260808 14:36:21.055979 30995 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:21.056843 30995 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:21.064289 30995 hybrid_clock.cc:648] HybridClock initialized: now 1786199781064148 us; error 161 us; skew 500 ppm
Aug 08 14:36:21 dist-test-slave-twwt krb5kdc[29903](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199781, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:21.068141 30995 init.cc:377] Logged in from keytab as kudu/127.11.131.194@KRBTEST.COM (short username kudu)
I20260808 14:36:21.069350 30995 webserver.cc:460] Webserver started at http://127.11.131.194:42933/ using document root <none> and password file <none>
I20260808 14:36:21.070174 30995 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:21.070341 30995 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:21.070685 30995 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 14:36:21 dist-test-slave-twwt krb5kdc[29903](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199781, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.194@KRBTEST.COM for HTTP/127.11.131.212@KRBTEST.COM
I20260808 14:36:21.090293 30995 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-1/data/instance:
uuid: "469984bad5534848a64fff1deaf292cf"
format_stamp: "Formatted at 2026-08-08 14:36:21 on dist-test-slave-twwt"
server_key: "4c77159b5191b614b705fcddee50a9f9"
server_key_iv: "dc37a3f45672b3766b15341ebf6f12c2"
server_key_version: "kuduclusterkey@0"
I20260808 14:36:21.099282 30995 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-1/wal/instance:
uuid: "469984bad5534848a64fff1deaf292cf"
format_stamp: "Formatted at 2026-08-08 14:36:21 on dist-test-slave-twwt"
server_key: "4c77159b5191b614b705fcddee50a9f9"
server_key_iv: "dc37a3f45672b3766b15341ebf6f12c2"
server_key_version: "kuduclusterkey@0"
I20260808 14:36:21.108201 30995 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.005s sys 0.000s
I20260808 14:36:21.130757 31024 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:21.132653 30995 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260808 14:36:21.132831 30995 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-1/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-1/wal
uuid: "469984bad5534848a64fff1deaf292cf"
format_stamp: "Formatted at 2026-08-08 14:36:21 on dist-test-slave-twwt"
server_key: "4c77159b5191b614b705fcddee50a9f9"
server_key_iv: "dc37a3f45672b3766b15341ebf6f12c2"
server_key_version: "kuduclusterkey@0"
I20260808 14:36:21.132975 30995 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:21.170197 30995 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:21.175508 30995 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:21.175912 30995 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:21.176736 30995 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:36:21.177938 30995 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:36:21.178059 30995 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:21.178165 30995 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:36:21.178234 30995 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:21.189801 30995 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.194:33957
I20260808 14:36:21.194876 30995 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
I20260808 14:36:21.196352 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 30995
I20260808 14:36:21.196485 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-1/wal/instance
I20260808 14:36:21.196816 11791 external_mini_cluster.cc:1428] Setting key 665d3fb17bbb9c3e9d2fd6f7c47a83d3
I20260808 14:36:21.198896 31185 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.194:33957 every 8 connection(s)
WARNING: no policy specified for kudu/127.11.131.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.195@KRBTEST.COM" created.
Aug 08 14:36:21 dist-test-slave-twwt krb5kdc[29903](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199781, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.194@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:36:21.220309 30991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:21.200736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:43679 (local address 127.11.131.254:41531)
0808 14:36:21.200870 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:21.200875 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:21.202801 (+ 1926us) server_negotiation.cc:407] Connection header received
0808 14:36:21.205162 (+ 2361us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:21.205168 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:21.205245 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:21.205313 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:21.207243 (+ 1930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:21.208088 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:21.210187 (+ 2099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:21.210565 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:21.210682 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:21.215835 (+ 5153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:21.215850 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:21.215856 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:21.215894 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:21.217596 (+ 1702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:21.218251 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:21.218255 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:21.218257 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:21.218362 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:21.218833 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:21.218836 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:21.218838 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:21.219081 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:21.219175 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:21.219938 (+ 763us) server_negotiation.cc:299] Negotiation successful
0808 14:36:21.220088 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 14:36:21.222257 31195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:21.201334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:41531 (local address 127.11.131.194:43679)
0808 14:36:21.202630 (+ 1296us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:21.202695 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:21.203979 (+ 1284us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:21.205907 (+ 1928us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:21.205918 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:21.206310 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:21.207043 (+ 733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:21.207066 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:21.208418 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:21.208422 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:21.210039 (+ 1617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:21.210052 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:21.211295 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:21.211300 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:21.212258 (+ 958us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:21.213050 (+ 792us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:21.213074 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:21.215625 (+ 2551us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:21.217729 (+ 2104us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:21.217736 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:21.217752 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:21.218116 (+ 364us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:21.218485 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:21.218488 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:21.218490 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:21.218711 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:21.219251 (+ 540us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:21.219258 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:21.219607 (+ 349us) client_negotiation.cc:769] Sending connection context
0808 14:36:21.220744 (+ 1137us) client_negotiation.cc:240] Negotiation successful
0808 14:36:21.221118 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1017,"thread_start_us":135,"threads_started":1}
I20260808 14:36:21.223951 31186 heartbeater.cc:347] Connected to a master server at 127.11.131.254:41531
I20260808 14:36:21.224213 31186 heartbeater.cc:464] Registering TS with master...
I20260808 14:36:21.224767 31186 heartbeater.cc:511] Master 127.11.131.254:41531 requested a full tablet report, sending...
I20260808 14:36:21.225879 30641 ts_manager.cc:194] Registered new tserver with Master: 469984bad5534848a64fff1deaf292cf (127.11.131.194:33957)
I20260808 14:36:21.226473 30641 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.194@KRBTEST.COM'} at 127.11.131.194:43679
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab.
Entry for principal kudu/127.11.131.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab.
I20260808 14:36:21.234521 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.131.212:46217/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.195:0
--local_ip_for_outbound_sockets=127.11.131.195
--webserver_interface=127.11.131.195
--webserver_port=0
--tserver_master_addrs=127.11.131.254:41531
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab
--principal=kudu/127.11.131.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:32915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 14:36:21 dist-test-slave-twwt krb5kdc[29903](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199780, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for HTTP/127.11.131.212@KRBTEST.COM
W20260808 14:36:21.405232 31199 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:21.405665 31199 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:21.405783 31199 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:21.411676 31199 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:21.411813 31199 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:21.411943 31199 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.195
I20260808 14:36:21.419737 31199 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:32915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.11.131.212:46217/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab
--principal=kudu/127.11.131.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.131.195
--webserver_port=0
--tserver_master_addrs=127.11.131.254:41531
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31199
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.195
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:36:21.421382 31199 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:21.422858 31199 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:21.436481 31211 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:21.437901 31199 server_base.cc:1034] running on GCE node
W20260808 14:36:21.438265 31213 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:21.439358 31210 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:21.439931 31199 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:21.440717 31199 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:21.448138 31199 hybrid_clock.cc:648] HybridClock initialized: now 1786199781448058 us; error 96 us; skew 500 ppm
Aug 08 14:36:21 dist-test-slave-twwt krb5kdc[29903](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199781, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:21.452247 31199 init.cc:377] Logged in from keytab as kudu/127.11.131.195@KRBTEST.COM (short username kudu)
I20260808 14:36:21.453533 31199 webserver.cc:460] Webserver started at http://127.11.131.195:44743/ using document root <none> and password file <none>
I20260808 14:36:21.454355 31199 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:21.454511 31199 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:21.454871 31199 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 14:36:21 dist-test-slave-twwt krb5kdc[29903](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199781, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.195@KRBTEST.COM for HTTP/127.11.131.212@KRBTEST.COM
I20260808 14:36:21.473927 31199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-2/data/instance:
uuid: "f7ad6925305547acbd11200d4937d0ea"
format_stamp: "Formatted at 2026-08-08 14:36:21 on dist-test-slave-twwt"
server_key: "b93a6a1db9811ce0f2ae1c46b7a180fb"
server_key_iv: "64bdafcce8d3a78f2fc62fbf24cffda7"
server_key_version: "kuduclusterkey@0"
I20260808 14:36:21.475194 31199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-2/wal/instance:
uuid: "f7ad6925305547acbd11200d4937d0ea"
format_stamp: "Formatted at 2026-08-08 14:36:21 on dist-test-slave-twwt"
server_key: "b93a6a1db9811ce0f2ae1c46b7a180fb"
server_key_iv: "64bdafcce8d3a78f2fc62fbf24cffda7"
server_key_version: "kuduclusterkey@0"
I20260808 14:36:21.480897 31199 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 14:36:21.527073 31227 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:21.529040 31199 fs_manager.cc:725] Time spent opening block manager: real 0.029s user 0.002s sys 0.001s
I20260808 14:36:21.529197 31199 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-2/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-2/wal
uuid: "f7ad6925305547acbd11200d4937d0ea"
format_stamp: "Formatted at 2026-08-08 14:36:21 on dist-test-slave-twwt"
server_key: "b93a6a1db9811ce0f2ae1c46b7a180fb"
server_key_iv: "64bdafcce8d3a78f2fc62fbf24cffda7"
server_key_version: "kuduclusterkey@0"
I20260808 14:36:21.529364 31199 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:21.548094 31199 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:21.551769 31199 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:21.552102 31199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:21.552934 31199 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:36:21.554073 31199 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:36:21.554180 31199 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:21.554294 31199 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:36:21.554373 31199 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:21.565133 31199 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.195:39929
I20260808 14:36:21.566635 31199 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
I20260808 14:36:21.571578 31407 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.195:39929 every 8 connection(s)
I20260808 14:36:21.575799 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 31199
I20260808 14:36:21.575937 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-2/wal/instance
I20260808 14:36:21.576292 11791 external_mini_cluster.cc:1428] Setting key 9310403793ab36cad884366c9d8baad1
Aug 08 14:36:21 dist-test-slave-twwt krb5kdc[29903](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199781, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.195@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:36:21.599298 30991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:21.582448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:38379 (local address 127.11.131.254:41531)
0808 14:36:21.582572 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:21.582577 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:21.583124 (+ 547us) server_negotiation.cc:407] Connection header received
0808 14:36:21.584464 (+ 1340us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:21.584468 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:21.584527 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:21.584582 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:21.586421 (+ 1839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:21.587284 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:21.589047 (+ 1763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:21.589417 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:21.589501 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:21.594661 (+ 5160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:21.594666 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:21.594669 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:21.594700 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:21.596611 (+ 1911us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:21.597283 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:21.597288 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:21.597290 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:21.597383 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:21.597825 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:21.597828 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:21.597830 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:21.598068 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:21.598160 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:21.598972 (+ 812us) server_negotiation.cc:299] Negotiation successful
0808 14:36:21.599106 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 14:36:21.607376 31413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:21.581260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:41531 (local address 127.11.131.195:38379)
0808 14:36:21.582954 (+ 1694us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:21.583023 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:21.584193 (+ 1170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:21.585070 (+ 877us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:21.585080 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:21.585500 (+ 420us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:21.586221 (+ 721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:21.586255 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:21.587453 (+ 1198us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:21.587459 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:21.588898 (+ 1439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:21.588911 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:21.591454 (+ 2543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:21.591459 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:21.591671 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:21.592441 (+ 770us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:21.592464 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:21.594421 (+ 1957us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:21.596768 (+ 2347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:21.596774 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:21.596793 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:21.597143 (+ 350us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:21.597496 (+ 353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:21.597499 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:21.597501 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:21.597693 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:21.598265 (+ 572us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:21.598272 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:21.598652 (+ 380us) client_negotiation.cc:769] Sending connection context
0808 14:36:21.599948 (+ 1296us) client_negotiation.cc:240] Negotiation successful
0808 14:36:21.600340 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1437,"thread_start_us":198,"threads_started":1}
I20260808 14:36:21.611572 31410 heartbeater.cc:347] Connected to a master server at 127.11.131.254:41531
I20260808 14:36:21.611879 31410 heartbeater.cc:464] Registering TS with master...
I20260808 14:36:21.612584 31410 heartbeater.cc:511] Master 127.11.131.254:41531 requested a full tablet report, sending...
I20260808 14:36:21.614025 30641 ts_manager.cc:194] Registered new tserver with Master: f7ad6925305547acbd11200d4937d0ea (127.11.131.195:39929)
I20260808 14:36:21.614828 30641 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.195@KRBTEST.COM'} at 127.11.131.195:38379
I20260808 14:36:21.619181 11791 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:36:21.620036 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 30778
Aug 08 14:36:21 dist-test-slave-twwt krb5kdc[29903](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199780, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for HTTP/127.11.131.212@KRBTEST.COM
I20260808 14:36:21.710485 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 30995
I20260808 14:36:21.724812 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 31199
I20260808 14:36:21.743956 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 30595
I20260808 14:36:21.761546 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:41531
--webserver_interface=127.11.131.254
--webserver_port=36783
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:32915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:41531
--ranger_config_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.131.212:46217/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.131.212:46217/kms with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:36:21.890125 31415 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:21.890475 31415 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:21.890561 31415 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:21.894793 31415 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:36:21.894888 31415 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:21.894927 31415 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:21.894964 31415 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:36:21.895000 31415 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:36:21.900744 31415 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:32915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.131.212:46217/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:41531
--ranger_config_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:41531
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.131.254
--webserver_port=36783
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31415
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:36:21.901932 31415 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:21.903155 31415 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:21.911978 31428 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:21.911999 31427 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:21.911999 31431 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:21.912801 31415 server_base.cc:1034] running on GCE node
I20260808 14:36:21.913369 31415 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:21.914565 31415 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:21.915789 31415 hybrid_clock.cc:648] HybridClock initialized: now 1786199781915761 us; error 45 us; skew 500 ppm
Aug 08 14:36:21 dist-test-slave-twwt krb5kdc[29903](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199781, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:21.918920 31415 init.cc:377] Logged in from keytab as kudu/127.11.131.254@KRBTEST.COM (short username kudu)
I20260808 14:36:21.919991 31415 webserver.cc:460] Webserver started at http://127.11.131.254:36783/ using document root <none> and password file <none>
I20260808 14:36:21.920562 31415 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:21.920755 31415 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 14:36:21 dist-test-slave-twwt krb5kdc[29903](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199781, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for HTTP/127.11.131.212@KRBTEST.COM
I20260808 14:36:22.008481 31415 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.003s
I20260808 14:36:22.010983 31444 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:22.012447 31415 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260808 14:36:22.012602 31415 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "2c885f5400754ef89d8bc8285cb18430"
format_stamp: "Formatted at 2026-08-08 14:36:19 on dist-test-slave-twwt"
server_key: "c792ac165e1a5ab3463e70ab00d548ac"
server_key_iv: "1b3f180a391acb21a8bc6980ab75fde9"
server_key_version: "kuduclusterkey@0"
I20260808 14:36:22.013232 31415 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:22.028805 31415 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:22.031937 31415 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:22.032161 31415 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:22.040439 31415 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.254:41531
I20260808 14:36:22.040449 31510 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.254:41531 every 8 connection(s)
I20260808 14:36:22.041612 31415 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:36:22.042923 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 31415
I20260808 14:36:22.043507 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.131.212:46217/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.193:45817
--local_ip_for_outbound_sockets=127.11.131.193
--tserver_master_addrs=127.11.131.254:41531
--webserver_port=46499
--webserver_interface=127.11.131.193
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab
--principal=kudu/127.11.131.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:32915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.131.212:46217/kms with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:36:22.047049 31511 sys_catalog.cc:263] Verifying existing consensus state
I20260808 14:36:22.048919 31511 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c885f5400754ef89d8bc8285cb18430: Bootstrap starting.
I20260808 14:36:22.068387 31511 log.cc:824] T 00000000000000000000000000000000 P 2c885f5400754ef89d8bc8285cb18430: Log is configured to *not* fsync() on all Append() calls
I20260808 14:36:22.075868 31511 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c885f5400754ef89d8bc8285cb18430: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:36:22.076367 31511 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c885f5400754ef89d8bc8285cb18430: Bootstrap complete.
I20260808 14:36:22.081185 31511 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2c885f5400754ef89d8bc8285cb18430 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c885f5400754ef89d8bc8285cb18430" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 41531 } }
I20260808 14:36:22.081653 31511 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2c885f5400754ef89d8bc8285cb18430 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c885f5400754ef89d8bc8285cb18430, State: Initialized, Role: FOLLOWER
I20260808 14:36:22.082231 31511 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2c885f5400754ef89d8bc8285cb18430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c885f5400754ef89d8bc8285cb18430" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 41531 } }
I20260808 14:36:22.082361 31511 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2c885f5400754ef89d8bc8285cb18430 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:36:22.082460 31511 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2c885f5400754ef89d8bc8285cb18430 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:36:22.082566 31511 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2c885f5400754ef89d8bc8285cb18430 [term 1 FOLLOWER]: Advancing to term 2
I20260808 14:36:22.084780 31511 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2c885f5400754ef89d8bc8285cb18430 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c885f5400754ef89d8bc8285cb18430" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 41531 } }
I20260808 14:36:22.085165 31511 leader_election.cc:302] T 00000000000000000000000000000000 P 2c885f5400754ef89d8bc8285cb18430 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2c885f5400754ef89d8bc8285cb18430; no voters:
I20260808 14:36:22.085546 31511 leader_election.cc:288] T 00000000000000000000000000000000 P 2c885f5400754ef89d8bc8285cb18430 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 14:36:22.085695 31516 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2c885f5400754ef89d8bc8285cb18430 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 14:36:22.085968 31516 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2c885f5400754ef89d8bc8285cb18430 [term 2 LEADER]: Becoming Leader. State: Replica: 2c885f5400754ef89d8bc8285cb18430, State: Running, Role: LEADER
I20260808 14:36:22.086392 31516 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2c885f5400754ef89d8bc8285cb18430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c885f5400754ef89d8bc8285cb18430" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 41531 } }
I20260808 14:36:22.086983 31511 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2c885f5400754ef89d8bc8285cb18430 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:36:22.087946 31519 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c885f5400754ef89d8bc8285cb18430 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "2c885f5400754ef89d8bc8285cb18430" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c885f5400754ef89d8bc8285cb18430" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 41531 } } }
I20260808 14:36:22.088071 31519 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c885f5400754ef89d8bc8285cb18430 [sys.catalog]: This master's current role is: LEADER
I20260808 14:36:22.088843 31522 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c885f5400754ef89d8bc8285cb18430 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2c885f5400754ef89d8bc8285cb18430. Latest consensus state: current_term: 2 leader_uuid: "2c885f5400754ef89d8bc8285cb18430" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c885f5400754ef89d8bc8285cb18430" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 41531 } } }
I20260808 14:36:22.089089 31522 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c885f5400754ef89d8bc8285cb18430 [sys.catalog]: This master's current role is: LEADER
I20260808 14:36:22.089365 31535 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:36:22.089659 31511 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 14:36:22.096966 31535 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:36:22.097993 31535 catalog_manager.cc:1259] Loaded cluster ID: ec76018f54c147da92edc25970ba9f38
I20260808 14:36:22.098067 31535 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:36:22.101017 31535 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:36:22.101820 31535 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 2c885f5400754ef89d8bc8285cb18430: Loaded TSK: 0
I20260808 14:36:22.103333 31535 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 14:36:22.172226 31514 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:22.172536 31514 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:22.172606 31514 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:22.177606 31514 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:22.177695 31514 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:22.177793 31514 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.193
I20260808 14:36:22.184267 31514 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:32915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.131.212:46217/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab
--principal=kudu/127.11.131.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.193:45817
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.131.193
--webserver_port=46499
--tserver_master_addrs=127.11.131.254:41531
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31514
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.193
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:36:22.185645 31514 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:22.186793 31514 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:22.197573 31580 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:22.197988 31514 server_base.cc:1034] running on GCE node
W20260808 14:36:22.198199 31576 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:22.198395 31577 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:22.198899 31514 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:22.199638 31514 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:22.200826 31514 hybrid_clock.cc:648] HybridClock initialized: now 1786199782200787 us; error 50 us; skew 500 ppm
Aug 08 14:36:22 dist-test-slave-twwt krb5kdc[29903](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199782, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:22.203851 31514 init.cc:377] Logged in from keytab as kudu/127.11.131.193@KRBTEST.COM (short username kudu)
I20260808 14:36:22.204919 31514 webserver.cc:460] Webserver started at http://127.11.131.193:46499/ using document root <none> and password file <none>
I20260808 14:36:22.205521 31514 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:22.205633 31514 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 14:36:22 dist-test-slave-twwt krb5kdc[29903](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199782, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.193@KRBTEST.COM for HTTP/127.11.131.212@KRBTEST.COM
I20260808 14:36:22.230060 31514 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.003s sys 0.000s
I20260808 14:36:22.235641 31593 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:22.237422 31514 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.002s sys 0.000s
I20260808 14:36:22.237571 31514 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-0/wal
uuid: "8cbb165ca2e54a1496f1e568489dde0d"
format_stamp: "Formatted at 2026-08-08 14:36:20 on dist-test-slave-twwt"
server_key: "6d36c7e00e690ff368230cb67ab99155"
server_key_iv: "2ac8248ba6b03b5d1fb3d542b7409cf7"
server_key_version: "kuduclusterkey@0"
I20260808 14:36:22.238371 31514 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:22.306198 31514 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:22.310820 31514 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:22.311195 31514 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:22.312027 31514 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:36:22.313186 31514 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:36:22.313261 31514 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:22.313326 31514 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:36:22.313355 31514 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:22.328033 31514 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.193:45817
I20260808 14:36:22.329401 31514 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
I20260808 14:36:22.333083 31771 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.193:45817 every 8 connection(s)
I20260808 14:36:22.334272 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 31514
I20260808 14:36:22.334959 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.131.212:46217/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.194:33957
--local_ip_for_outbound_sockets=127.11.131.194
--tserver_master_addrs=127.11.131.254:41531
--webserver_port=42933
--webserver_interface=127.11.131.194
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab
--principal=kudu/127.11.131.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:32915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.131.212:46217/kms with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 14:36:22 dist-test-slave-twwt krb5kdc[29903](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199782, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.193@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:36:22.359853 31775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:22.336438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:41531 (local address 127.11.131.193:56471)
0808 14:36:22.338969 (+ 2531us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:22.339037 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:22.340232 (+ 1195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:22.344559 (+ 4327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:22.344569 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:22.345000 (+ 431us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:22.345750 (+ 750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:22.345776 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:22.347711 (+ 1935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:22.347715 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:22.348898 (+ 1183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:22.348917 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:22.350252 (+ 1335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:22.350256 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:22.350487 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:22.351312 (+ 825us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:22.351334 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:22.353089 (+ 1755us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:22.355926 (+ 2837us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:22.355933 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:22.355948 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:22.356328 (+ 380us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:22.356788 (+ 460us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:22.356791 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:22.356793 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:22.356994 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:22.357834 (+ 840us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:22.357841 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:22.358166 (+ 325us) client_negotiation.cc:769] Sending connection context
0808 14:36:22.358391 (+ 225us) client_negotiation.cc:240] Negotiation successful
0808 14:36:22.358811 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2245,"thread_start_us":178,"threads_started":1}
I20260808 14:36:22.361831 31777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:22.338113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:56471 (local address 127.11.131.254:41531)
0808 14:36:22.339526 (+ 1413us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:22.339550 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:22.339605 (+ 55us) server_negotiation.cc:407] Connection header received
0808 14:36:22.342980 (+ 3375us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:22.342999 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:22.343509 (+ 510us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:22.343964 (+ 455us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:22.345994 (+ 2030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:22.347511 (+ 1517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:22.349085 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:22.349915 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:22.350099 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:22.353339 (+ 3240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:22.353346 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:22.353364 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:22.353397 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:22.355779 (+ 2382us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:22.356484 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:22.356491 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:22.356497 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:22.356664 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:22.357112 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:22.357116 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:22.357118 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:22.357630 (+ 512us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:22.357759 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:22.360578 (+ 2819us) server_negotiation.cc:299] Negotiation successful
0808 14:36:22.360875 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1215,"thread_start_us":148,"threads_started":1}
I20260808 14:36:22.364593 31772 heartbeater.cc:347] Connected to a master server at 127.11.131.254:41531
I20260808 14:36:22.364874 31772 heartbeater.cc:464] Registering TS with master...
I20260808 14:36:22.365504 31772 heartbeater.cc:511] Master 127.11.131.254:41531 requested a full tablet report, sending...
W20260808 14:36:22.368098 31772 heartbeater.cc:644] Failed to heartbeat to 127.11.131.254:41531 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 14:36:22.368238 31772 heartbeater.cc:464] Registering TS with master...
I20260808 14:36:22.368427 31772 heartbeater.cc:511] Master 127.11.131.254:41531 requested a full tablet report, sending...
I20260808 14:36:22.369415 31772 heartbeater.cc:464] Registering TS with master...
I20260808 14:36:22.369627 31772 heartbeater.cc:511] Master 127.11.131.254:41531 requested a full tablet report, sending...
W20260808 14:36:22.370541 31772 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 14:36:22.504900 31776 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:22.505275 31776 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:22.505405 31776 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:22.510912 31776 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:22.511027 31776 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:22.511158 31776 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.194
I20260808 14:36:22.519559 31776 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:32915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.131.212:46217/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab
--principal=kudu/127.11.131.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.194:33957
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.131.194
--webserver_port=42933
--tserver_master_addrs=127.11.131.254:41531
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31776
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.194
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:36:22.520756 31776 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:22.521957 31776 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:22.534013 31787 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:22.534121 31789 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:22.534013 31785 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:22.534555 31776 server_base.cc:1034] running on GCE node
I20260808 14:36:22.537256 31776 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:22.537997 31776 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:22.539232 31776 hybrid_clock.cc:648] HybridClock initialized: now 1786199782539209 us; error 38 us; skew 500 ppm
Aug 08 14:36:22 dist-test-slave-twwt krb5kdc[29903](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199782, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:22.542243 31776 init.cc:377] Logged in from keytab as kudu/127.11.131.194@KRBTEST.COM (short username kudu)
I20260808 14:36:22.543339 31776 webserver.cc:460] Webserver started at http://127.11.131.194:42933/ using document root <none> and password file <none>
I20260808 14:36:22.543952 31776 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:22.544063 31776 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 14:36:22 dist-test-slave-twwt krb5kdc[29903](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199782, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.194@KRBTEST.COM for HTTP/127.11.131.212@KRBTEST.COM
I20260808 14:36:22.569370 31776 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.002s sys 0.001s
I20260808 14:36:22.573240 31801 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:22.574934 31776 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260808 14:36:22.575116 31776 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-1/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-1/wal
uuid: "469984bad5534848a64fff1deaf292cf"
format_stamp: "Formatted at 2026-08-08 14:36:21 on dist-test-slave-twwt"
server_key: "4c77159b5191b614b705fcddee50a9f9"
server_key_iv: "dc37a3f45672b3766b15341ebf6f12c2"
server_key_version: "kuduclusterkey@0"
I20260808 14:36:22.575939 31776 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:22.609671 31776 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:22.613327 31776 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:22.613564 31776 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:22.614241 31776 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:36:22.615260 31776 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:36:22.615315 31776 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:22.615360 31776 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:36:22.615382 31776 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:22.628311 31776 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.194:33957
I20260808 14:36:22.628346 31984 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.194:33957 every 8 connection(s)
I20260808 14:36:22.629408 31776 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
I20260808 14:36:22.635327 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 31776
I20260808 14:36:22.635887 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.131.212:46217/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.195:39929
--local_ip_for_outbound_sockets=127.11.131.195
--tserver_master_addrs=127.11.131.254:41531
--webserver_port=44743
--webserver_interface=127.11.131.195
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab
--principal=kudu/127.11.131.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:32915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.131.212:46217/kms with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 14:36:22 dist-test-slave-twwt krb5kdc[29903](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199782, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.194@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:36:22.647301 31777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:22.631462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:53981 (local address 127.11.131.254:41531)
0808 14:36:22.631611 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:22.631615 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:22.632752 (+ 1137us) server_negotiation.cc:407] Connection header received
0808 14:36:22.633879 (+ 1127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:22.633883 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:22.633946 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:22.634027 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:22.635530 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:22.636349 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:22.638202 (+ 1853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:22.638643 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:22.638740 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:22.642090 (+ 3350us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:22.642097 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:22.642103 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:22.642140 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:22.644160 (+ 2020us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:22.644971 (+ 811us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:22.644977 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:22.644982 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:22.645082 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:22.645648 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:22.645654 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:22.645657 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:22.645933 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:22.646023 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:22.646887 (+ 864us) server_negotiation.cc:299] Negotiation successful
0808 14:36:22.647052 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 14:36:22.649268 31987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:22.632022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:41531 (local address 127.11.131.194:53981)
0808 14:36:22.632571 (+ 549us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:22.632624 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:22.633651 (+ 1027us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:22.634214 (+ 563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:22.634222 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:22.634508 (+ 286us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:22.635324 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:22.635350 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:22.636539 (+ 1189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:22.636545 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:22.638033 (+ 1488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:22.638048 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:22.638979 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:22.638985 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:22.639213 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:22.639956 (+ 743us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:22.639982 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:22.641841 (+ 1859us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:22.644400 (+ 2559us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:22.644408 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:22.644430 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:22.644830 (+ 400us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:22.645216 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:22.645222 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:22.645226 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:22.645515 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:22.646122 (+ 607us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:22.646131 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:22.646521 (+ 390us) client_negotiation.cc:769] Sending connection context
0808 14:36:22.647592 (+ 1071us) client_negotiation.cc:240] Negotiation successful
0808 14:36:22.648003 (+ 411us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":160,"threads_started":1}
I20260808 14:36:22.650856 31985 heartbeater.cc:347] Connected to a master server at 127.11.131.254:41531
I20260808 14:36:22.651145 31985 heartbeater.cc:464] Registering TS with master...
I20260808 14:36:22.651782 31985 heartbeater.cc:511] Master 127.11.131.254:41531 requested a full tablet report, sending...
W20260808 14:36:22.653486 31985 heartbeater.cc:644] Failed to heartbeat to 127.11.131.254:41531 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 14:36:22.653614 31985 heartbeater.cc:464] Registering TS with master...
I20260808 14:36:22.653784 31985 heartbeater.cc:511] Master 127.11.131.254:41531 requested a full tablet report, sending...
I20260808 14:36:22.654547 31985 heartbeater.cc:464] Registering TS with master...
I20260808 14:36:22.654747 31985 heartbeater.cc:511] Master 127.11.131.254:41531 requested a full tablet report, sending...
W20260808 14:36:22.655454 31985 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 14:36:22.780568 31988 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:22.780905 31988 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:22.780994 31988 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:22.785519 31988 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:22.785578 31988 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:22.785673 31988 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.195
I20260808 14:36:22.791568 31988 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:32915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.131.212:46217/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab
--principal=kudu/127.11.131.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.195:39929
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.131.195
--webserver_port=44743
--tserver_master_addrs=127.11.131.254:41531
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31988
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.195
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:36:22.792891 31988 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:22.794212 31988 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:22.807071 31996 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:22.807087 32001 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:22.807577 31999 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:22.812716 31988 server_base.cc:1034] running on GCE node
I20260808 14:36:22.813308 31988 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:22.814241 31988 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:22.815510 31988 hybrid_clock.cc:648] HybridClock initialized: now 1786199782815512 us; error 112 us; skew 500 ppm
Aug 08 14:36:22 dist-test-slave-twwt krb5kdc[29903](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199782, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:22.819078 31988 init.cc:377] Logged in from keytab as kudu/127.11.131.195@KRBTEST.COM (short username kudu)
I20260808 14:36:22.820293 31988 webserver.cc:460] Webserver started at http://127.11.131.195:44743/ using document root <none> and password file <none>
I20260808 14:36:22.821110 31988 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:22.821275 31988 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 14:36:22 dist-test-slave-twwt krb5kdc[29903](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199782, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.195@KRBTEST.COM for HTTP/127.11.131.212@KRBTEST.COM
I20260808 14:36:22.842285 31988 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 14:36:22.845566 32015 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:22.847071 31988 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:36:22.847242 31988 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-2/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-2/wal
uuid: "f7ad6925305547acbd11200d4937d0ea"
format_stamp: "Formatted at 2026-08-08 14:36:21 on dist-test-slave-twwt"
server_key: "b93a6a1db9811ce0f2ae1c46b7a180fb"
server_key_iv: "64bdafcce8d3a78f2fc62fbf24cffda7"
server_key_version: "kuduclusterkey@0"
I20260808 14:36:22.847855 31988 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:22.867578 31988 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:22.871098 31988 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:22.871316 31988 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:22.871981 31988 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:36:22.873078 31988 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:36:22.873152 31988 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:22.873216 31988 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:36:22.873250 31988 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:22.886090 31988 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.195:39929
I20260808 14:36:22.886369 32185 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.195:39929 every 8 connection(s)
I20260808 14:36:22.887687 31988 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
I20260808 14:36:22.896067 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 31988
Aug 08 14:36:22 dist-test-slave-twwt krb5kdc[29903](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199782, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.195@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:36:22.908639 31777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:22.892369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:57165 (local address 127.11.131.254:41531)
0808 14:36:22.892518 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:22.892523 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:22.893692 (+ 1169us) server_negotiation.cc:407] Connection header received
0808 14:36:22.895131 (+ 1439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:22.895135 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:22.895194 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:22.895252 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:22.898101 (+ 2849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:22.898952 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:22.900725 (+ 1773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:22.901095 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:22.901200 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:22.904434 (+ 3234us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:22.904441 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:22.904445 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:22.904474 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:22.906283 (+ 1809us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:22.906964 (+ 681us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:22.906969 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:22.906971 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:22.907057 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:22.907427 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:22.907430 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:22.907433 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:22.907608 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:22.907716 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:22.908347 (+ 631us) server_negotiation.cc:299] Negotiation successful
0808 14:36:22.908471 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 14:36:22.909726 32188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:22.892911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:41531 (local address 127.11.131.195:57165)
0808 14:36:22.893508 (+ 597us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:22.893577 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:22.894854 (+ 1277us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:22.895683 (+ 829us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:22.895692 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:22.897176 (+ 1484us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:22.897898 (+ 722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:22.897922 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:22.899130 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:22.899133 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:22.900560 (+ 1427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:22.900572 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:22.901267 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:22.901273 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:22.901491 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:22.902395 (+ 904us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:22.902420 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:22.904221 (+ 1801us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:22.906411 (+ 2190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:22.906417 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:22.906434 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:22.906835 (+ 401us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:22.907154 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:22.907158 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:22.907160 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:22.907315 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:22.907715 (+ 400us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:22.907722 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:22.908040 (+ 318us) client_negotiation.cc:769] Sending connection context
0808 14:36:22.908238 (+ 198us) client_negotiation.cc:240] Negotiation successful
0808 14:36:22.908572 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":344,"thread_start_us":159,"threads_started":1}
I20260808 14:36:22.911134 32186 heartbeater.cc:347] Connected to a master server at 127.11.131.254:41531
I20260808 14:36:22.911481 32186 heartbeater.cc:464] Registering TS with master...
I20260808 14:36:22.912128 32186 heartbeater.cc:511] Master 127.11.131.254:41531 requested a full tablet report, sending...
W20260808 14:36:22.913969 32186 heartbeater.cc:644] Failed to heartbeat to 127.11.131.254:41531 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 14:36:22.914101 32186 heartbeater.cc:464] Registering TS with master...
I20260808 14:36:22.914283 32186 heartbeater.cc:511] Master 127.11.131.254:41531 requested a full tablet report, sending...
I20260808 14:36:22.914315 32189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:22.896799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37578 (local address 127.11.131.254:41531)
0808 14:36:22.900840 (+ 4041us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:22.900845 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:22.901821 (+ 976us) server_negotiation.cc:407] Connection header received
0808 14:36:22.902089 (+ 268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:22.902094 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:22.902151 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:22.902216 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:22.905859 (+ 3643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:22.906685 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:22.907933 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:22.908269 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:22.908370 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:22.910524 (+ 2154us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:22.910528 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:22.910530 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:22.910561 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:22.912355 (+ 1794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:22.912867 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:22.912870 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:22.912872 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:22.912969 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:22.913416 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:22.913422 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:22.913423 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:22.913608 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:22.913813 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:22.914032 (+ 219us) server_negotiation.cc:299] Negotiation successful
0808 14:36:22.914159 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3955,"thread_start_us":93,"threads_started":1}
I20260808 14:36:22.915246 32186 heartbeater.cc:464] Registering TS with master...
I20260808 14:36:22.915428 32186 heartbeater.cc:511] Master 127.11.131.254:41531 requested a full tablet report, sending...
W20260808 14:36:22.916224 32186 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 08 14:36:23 dist-test-slave-twwt krb5kdc[29903](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786199783, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:23.370792 31772 heartbeater.cc:464] Registering TS with master...
I20260808 14:36:23.371129 31772 heartbeater.cc:511] Master 127.11.131.254:41531 requested a full tablet report, sending...
I20260808 14:36:23.372493 31469 ts_manager.cc:194] Registered new tserver with Master: 8cbb165ca2e54a1496f1e568489dde0d (127.11.131.193:45817)
I20260808 14:36:23.374253 31469 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.193@KRBTEST.COM'} at 127.11.131.193:56471
Aug 08 14:36:23 dist-test-slave-twwt krb5kdc[29903](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199783, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for HTTP/127.11.131.212@KRBTEST.COM
I20260808 14:36:23.655694 31985 heartbeater.cc:464] Registering TS with master...
I20260808 14:36:23.656014 31985 heartbeater.cc:511] Master 127.11.131.254:41531 requested a full tablet report, sending...
I20260808 14:36:23.656911 31469 ts_manager.cc:194] Registered new tserver with Master: 469984bad5534848a64fff1deaf292cf (127.11.131.194:33957)
I20260808 14:36:23.657701 31469 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.194@KRBTEST.COM'} at 127.11.131.194:53981
Aug 08 14:36:23 dist-test-slave-twwt krb5kdc[29903](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199783, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for HTTP/127.11.131.212@KRBTEST.COM
I20260808 14:36:23.916456 32186 heartbeater.cc:464] Registering TS with master...
I20260808 14:36:23.916803 32186 heartbeater.cc:511] Master 127.11.131.254:41531 requested a full tablet report, sending...
I20260808 14:36:23.917505 31465 ts_manager.cc:194] Registered new tserver with Master: f7ad6925305547acbd11200d4937d0ea (127.11.131.195:39929)
I20260808 14:36:23.918191 31465 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.195@KRBTEST.COM'} at 127.11.131.195:57165
I20260808 14:36:23.927737 11791 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:36:23.939527 32223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:23.929387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37594 (local address 127.11.131.254:41531)
0808 14:36:23.929681 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:23.929686 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:23.930059 (+ 373us) server_negotiation.cc:407] Connection header received
0808 14:36:23.930187 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:23.930190 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:23.930253 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:23.930355 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:23.931227 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:23.932038 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:23.933187 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:23.933530 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:23.933598 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:23.935418 (+ 1820us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:23.935422 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:23.935425 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:23.935453 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:23.937300 (+ 1847us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:23.938001 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:23.938005 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:23.938008 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:23.938110 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:23.938443 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:23.938447 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:23.938449 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:23.938708 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:23.938822 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:23.939195 (+ 373us) server_negotiation.cc:299] Negotiation successful
0808 14:36:23.939346 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":209,"thread_start_us":106,"threads_started":1}
I20260808 14:36:23.944422 31465 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37594:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:36:23.949755 31465 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:36:23.985045 32236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:23.969996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.194:33957 (local address 127.0.0.1:44938)
0808 14:36:23.973897 (+ 3901us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:23.973956 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:23.974094 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:23.976832 (+ 2738us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:23.976839 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:23.976864 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:36:23.977017 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:23.977024 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:23.980445 (+ 3421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:23.980448 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:23.982966 (+ 2518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:23.982981 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:23.984433 (+ 1452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:23.984437 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:23.984564 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:23.984611 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 14:36:23.984736 (+ 125us) client_negotiation.cc:240] Negotiation successful
0808 14:36:23.984877 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3693,"thread_start_us":153,"threads_started":1}
I20260808 14:36:23.986951 32237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:23.971264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44938 (local address 127.11.131.194:33957)
0808 14:36:23.974880 (+ 3616us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:23.974889 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:23.974918 (+ 29us) server_negotiation.cc:407] Connection header received
0808 14:36:23.975001 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:23.975007 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:23.976468 (+ 1461us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:23.976634 (+ 166us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:36:23.979064 (+ 2430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:23.980279 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:23.983128 (+ 2849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:23.984042 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:23.984175 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:23.984332 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:23.986667 (+ 2335us) server_negotiation.cc:299] Negotiation successful
0808 14:36:23.986793 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3492,"thread_start_us":159,"threads_started":1}
I20260808 14:36:23.988428 32230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:23.970026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.195:39929 (local address 127.0.0.1:41562)
0808 14:36:23.976195 (+ 6169us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:23.976210 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:23.976302 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:23.977948 (+ 1646us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:23.977951 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:23.977969 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:36:23.978917 (+ 948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:23.978929 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:23.985369 (+ 6440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:23.985371 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:23.986630 (+ 1259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:23.986643 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:23.988005 (+ 1362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:23.988009 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:23.988107 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:23.988136 (+ 29us) client_negotiation.cc:769] Sending connection context
0808 14:36:23.988194 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 14:36:23.988271 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6099,"thread_start_us":116,"threads_started":1}
I20260808 14:36:23.989651 32238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:23.971691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41562 (local address 127.11.131.195:39929)
0808 14:36:23.977304 (+ 5613us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:23.977311 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:23.977336 (+ 25us) server_negotiation.cc:407] Connection header received
0808 14:36:23.977430 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:23.977436 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:23.977645 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:23.977798 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:36:23.982892 (+ 5094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:23.984097 (+ 1205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:23.986798 (+ 2701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:23.987716 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:23.987840 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:23.989339 (+ 1499us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:23.989401 (+ 62us) server_negotiation.cc:299] Negotiation successful
0808 14:36:23.989504 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5493,"thread_start_us":119,"threads_started":1}
I20260808 14:36:23.990881 31883 tablet_service.cc:1467] Processing CreateTablet for tablet 93ff9519417f48de8a53494fba800281 (DEFAULT_TABLE table=test-table [id=90db977039604e4b83c6e2c578b37c07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:36:23.992280 31883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93ff9519417f48de8a53494fba800281. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:36:23.993211 32239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:23.972137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:45817 (local address 127.0.0.1:35836)
0808 14:36:23.982047 (+ 9910us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:23.982064 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:23.982166 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:23.985103 (+ 2937us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:23.985107 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:23.985125 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:36:23.985211 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:23.985216 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:23.990279 (+ 5063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:23.990282 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:23.991455 (+ 1173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:23.991469 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:23.992778 (+ 1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:23.992782 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:23.992878 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:23.992921 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 14:36:23.992995 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 14:36:23.993070 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9833,"thread_start_us":92,"threads_started":1}
I20260808 14:36:23.993954 32242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:23.972580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35836 (local address 127.11.131.193:45817)
0808 14:36:23.984435 (+ 11855us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:23.984443 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:23.984470 (+ 27us) server_negotiation.cc:407] Connection header received
0808 14:36:23.984555 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:23.984562 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:23.984789 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:23.984949 (+ 160us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:36:23.988922 (+ 3973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:23.990115 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:23.991614 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:23.992417 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:23.992555 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:23.992708 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:23.993708 (+ 1000us) server_negotiation.cc:299] Negotiation successful
0808 14:36:23.993815 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11709,"thread_start_us":133,"threads_started":1}
I20260808 14:36:23.997269 32076 tablet_service.cc:1467] Processing CreateTablet for tablet 93ff9519417f48de8a53494fba800281 (DEFAULT_TABLE table=test-table [id=90db977039604e4b83c6e2c578b37c07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:36:23.997273 31659 tablet_service.cc:1467] Processing CreateTablet for tablet 93ff9519417f48de8a53494fba800281 (DEFAULT_TABLE table=test-table [id=90db977039604e4b83c6e2c578b37c07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:36:23.998529 31659 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93ff9519417f48de8a53494fba800281. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:36:23.998592 32076 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 93ff9519417f48de8a53494fba800281. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:36:24.009305 32243 tablet_bootstrap.cc:492] T 93ff9519417f48de8a53494fba800281 P 8cbb165ca2e54a1496f1e568489dde0d: Bootstrap starting.
I20260808 14:36:24.012137 32243 tablet_bootstrap.cc:654] T 93ff9519417f48de8a53494fba800281 P 8cbb165ca2e54a1496f1e568489dde0d: Neither blocks nor log segments found. Creating new log.
I20260808 14:36:24.013274 32243 log.cc:824] T 93ff9519417f48de8a53494fba800281 P 8cbb165ca2e54a1496f1e568489dde0d: Log is configured to *not* fsync() on all Append() calls
I20260808 14:36:24.015050 32246 tablet_bootstrap.cc:492] T 93ff9519417f48de8a53494fba800281 P 469984bad5534848a64fff1deaf292cf: Bootstrap starting.
I20260808 14:36:24.017870 32246 tablet_bootstrap.cc:654] T 93ff9519417f48de8a53494fba800281 P 469984bad5534848a64fff1deaf292cf: Neither blocks nor log segments found. Creating new log.
I20260808 14:36:24.018884 32246 log.cc:824] T 93ff9519417f48de8a53494fba800281 P 469984bad5534848a64fff1deaf292cf: Log is configured to *not* fsync() on all Append() calls
I20260808 14:36:24.021960 32243 tablet_bootstrap.cc:492] T 93ff9519417f48de8a53494fba800281 P 8cbb165ca2e54a1496f1e568489dde0d: No bootstrap required, opened a new log
I20260808 14:36:24.022264 32243 ts_tablet_manager.cc:1397] T 93ff9519417f48de8a53494fba800281 P 8cbb165ca2e54a1496f1e568489dde0d: Time spent bootstrapping tablet: real 0.013s user 0.007s sys 0.000s
I20260808 14:36:24.026814 32243 raft_consensus.cc:348] T 93ff9519417f48de8a53494fba800281 P 8cbb165ca2e54a1496f1e568489dde0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "469984bad5534848a64fff1deaf292cf" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 33957 } } peers { permanent_uuid: "f7ad6925305547acbd11200d4937d0ea" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 39929 } } peers { permanent_uuid: "8cbb165ca2e54a1496f1e568489dde0d" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 45817 } }
I20260808 14:36:24.027616 32246 tablet_bootstrap.cc:492] T 93ff9519417f48de8a53494fba800281 P 469984bad5534848a64fff1deaf292cf: No bootstrap required, opened a new log
I20260808 14:36:24.027872 32246 ts_tablet_manager.cc:1397] T 93ff9519417f48de8a53494fba800281 P 469984bad5534848a64fff1deaf292cf: Time spent bootstrapping tablet: real 0.013s user 0.007s sys 0.000s
I20260808 14:36:24.029546 32243 raft_consensus.cc:374] T 93ff9519417f48de8a53494fba800281 P 8cbb165ca2e54a1496f1e568489dde0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:36:24.029693 32243 raft_consensus.cc:729] T 93ff9519417f48de8a53494fba800281 P 8cbb165ca2e54a1496f1e568489dde0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cbb165ca2e54a1496f1e568489dde0d, State: Initialized, Role: FOLLOWER
I20260808 14:36:24.030450 32243 consensus_queue.cc:260] T 93ff9519417f48de8a53494fba800281 P 8cbb165ca2e54a1496f1e568489dde0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "469984bad5534848a64fff1deaf292cf" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 33957 } } peers { permanent_uuid: "f7ad6925305547acbd11200d4937d0ea" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 39929 } } peers { permanent_uuid: "8cbb165ca2e54a1496f1e568489dde0d" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 45817 } }
I20260808 14:36:24.031868 32243 ts_tablet_manager.cc:1428] T 93ff9519417f48de8a53494fba800281 P 8cbb165ca2e54a1496f1e568489dde0d: Time spent starting tablet: real 0.009s user 0.003s sys 0.003s
I20260808 14:36:24.032315 31772 heartbeater.cc:503] Master 127.11.131.254:41531 was elected leader, sending a full tablet report...
I20260808 14:36:24.032172 32246 raft_consensus.cc:348] T 93ff9519417f48de8a53494fba800281 P 469984bad5534848a64fff1deaf292cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "469984bad5534848a64fff1deaf292cf" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 33957 } } peers { permanent_uuid: "f7ad6925305547acbd11200d4937d0ea" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 39929 } } peers { permanent_uuid: "8cbb165ca2e54a1496f1e568489dde0d" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 45817 } }
I20260808 14:36:24.032474 32246 raft_consensus.cc:374] T 93ff9519417f48de8a53494fba800281 P 469984bad5534848a64fff1deaf292cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:36:24.032526 32246 raft_consensus.cc:729] T 93ff9519417f48de8a53494fba800281 P 469984bad5534848a64fff1deaf292cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 469984bad5534848a64fff1deaf292cf, State: Initialized, Role: FOLLOWER
I20260808 14:36:24.032994 32246 consensus_queue.cc:260] T 93ff9519417f48de8a53494fba800281 P 469984bad5534848a64fff1deaf292cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "469984bad5534848a64fff1deaf292cf" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 33957 } } peers { permanent_uuid: "f7ad6925305547acbd11200d4937d0ea" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 39929 } } peers { permanent_uuid: "8cbb165ca2e54a1496f1e568489dde0d" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 45817 } }
I20260808 14:36:24.034116 32246 ts_tablet_manager.cc:1428] T 93ff9519417f48de8a53494fba800281 P 469984bad5534848a64fff1deaf292cf: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 14:36:24.034514 31985 heartbeater.cc:503] Master 127.11.131.254:41531 was elected leader, sending a full tablet report...
I20260808 14:36:24.036868 32250 tablet_bootstrap.cc:492] T 93ff9519417f48de8a53494fba800281 P f7ad6925305547acbd11200d4937d0ea: Bootstrap starting.
I20260808 14:36:24.041326 32250 tablet_bootstrap.cc:654] T 93ff9519417f48de8a53494fba800281 P f7ad6925305547acbd11200d4937d0ea: Neither blocks nor log segments found. Creating new log.
I20260808 14:36:24.042287 32250 log.cc:824] T 93ff9519417f48de8a53494fba800281 P f7ad6925305547acbd11200d4937d0ea: Log is configured to *not* fsync() on all Append() calls
I20260808 14:36:24.045163 32250 tablet_bootstrap.cc:492] T 93ff9519417f48de8a53494fba800281 P f7ad6925305547acbd11200d4937d0ea: No bootstrap required, opened a new log
I20260808 14:36:24.045380 32250 ts_tablet_manager.cc:1397] T 93ff9519417f48de8a53494fba800281 P f7ad6925305547acbd11200d4937d0ea: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.002s
I20260808 14:36:24.049399 32250 raft_consensus.cc:348] T 93ff9519417f48de8a53494fba800281 P f7ad6925305547acbd11200d4937d0ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "469984bad5534848a64fff1deaf292cf" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 33957 } } peers { permanent_uuid: "f7ad6925305547acbd11200d4937d0ea" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 39929 } } peers { permanent_uuid: "8cbb165ca2e54a1496f1e568489dde0d" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 45817 } }
I20260808 14:36:24.049726 32250 raft_consensus.cc:374] T 93ff9519417f48de8a53494fba800281 P f7ad6925305547acbd11200d4937d0ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:36:24.049853 32250 raft_consensus.cc:729] T 93ff9519417f48de8a53494fba800281 P f7ad6925305547acbd11200d4937d0ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7ad6925305547acbd11200d4937d0ea, State: Initialized, Role: FOLLOWER
I20260808 14:36:24.050654 32250 consensus_queue.cc:260] T 93ff9519417f48de8a53494fba800281 P f7ad6925305547acbd11200d4937d0ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "469984bad5534848a64fff1deaf292cf" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 33957 } } peers { permanent_uuid: "f7ad6925305547acbd11200d4937d0ea" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 39929 } } peers { permanent_uuid: "8cbb165ca2e54a1496f1e568489dde0d" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 45817 } }
I20260808 14:36:24.052028 32250 ts_tablet_manager.cc:1428] T 93ff9519417f48de8a53494fba800281 P f7ad6925305547acbd11200d4937d0ea: Time spent starting tablet: real 0.007s user 0.004s sys 0.002s
I20260808 14:36:24.052567 32186 heartbeater.cc:503] Master 127.11.131.254:41531 was elected leader, sending a full tablet report...
W20260808 14:36:24.085405 31774 tablet.cc:2369] T 93ff9519417f48de8a53494fba800281 P 8cbb165ca2e54a1496f1e568489dde0d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:36:24.131840 31986 tablet.cc:2369] T 93ff9519417f48de8a53494fba800281 P 469984bad5534848a64fff1deaf292cf: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:36:24.145326 32187 tablet.cc:2369] T 93ff9519417f48de8a53494fba800281 P f7ad6925305547acbd11200d4937d0ea: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:36:24.173105 32254 raft_consensus.cc:482] T 93ff9519417f48de8a53494fba800281 P f7ad6925305547acbd11200d4937d0ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:36:24.173336 32254 raft_consensus.cc:504] T 93ff9519417f48de8a53494fba800281 P f7ad6925305547acbd11200d4937d0ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "469984bad5534848a64fff1deaf292cf" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 33957 } } peers { permanent_uuid: "f7ad6925305547acbd11200d4937d0ea" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 39929 } } peers { permanent_uuid: "8cbb165ca2e54a1496f1e568489dde0d" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 45817 } }
I20260808 14:36:24.174512 32254 leader_election.cc:288] T 93ff9519417f48de8a53494fba800281 P f7ad6925305547acbd11200d4937d0ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 469984bad5534848a64fff1deaf292cf (127.11.131.194:33957), 8cbb165ca2e54a1496f1e568489dde0d (127.11.131.193:45817)
I20260808 14:36:24.180042 32242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:24.175484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:37399 (local address 127.11.131.193:45817)
0808 14:36:24.175654 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:24.175659 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:24.175854 (+ 195us) server_negotiation.cc:407] Connection header received
0808 14:36:24.175977 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:24.175979 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:24.176019 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:24.176078 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:36:24.176353 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:24.177076 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:24.178698 (+ 1622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:24.179294 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:24.179425 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:24.179479 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:24.179832 (+ 353us) server_negotiation.cc:299] Negotiation successful
0808 14:36:24.179915 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 14:36:24.180042 32237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:24.175006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:56941 (local address 127.11.131.194:33957)
0808 14:36:24.175186 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:24.175192 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:24.175380 (+ 188us) server_negotiation.cc:407] Connection header received
0808 14:36:24.175557 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:24.175561 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:24.175612 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:24.175693 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:36:24.176155 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:24.176958 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:24.178698 (+ 1740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:24.179294 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:24.179425 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:24.179479 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:24.179832 (+ 353us) server_negotiation.cc:299] Negotiation successful
0808 14:36:24.179905 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 14:36:24.180095 32266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:24.174838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.194:33957 (local address 127.11.131.195:56941)
0808 14:36:24.175254 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:24.175267 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:24.175424 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:24.175730 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:24.175735 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:24.175764 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:36:24.176006 (+ 242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:24.176013 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:24.177072 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:24.177075 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:24.178548 (+ 1473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:24.178562 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:24.179435 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:24.179439 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:24.179653 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:24.179720 (+ 67us) client_negotiation.cc:769] Sending connection context
0808 14:36:24.179798 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 14:36:24.179913 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":324,"mutex_wait_us":129,"spinlock_wait_cycles":23296,"thread_start_us":163,"threads_started":1}
I20260808 14:36:24.180104 32267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:24.175352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:45817 (local address 127.11.131.195:37399)
0808 14:36:24.175730 (+ 378us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:24.175744 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:24.175862 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:24.176121 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:24.176127 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:24.176145 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:36:24.176248 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:24.176252 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:24.177183 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:24.177186 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:24.178554 (+ 1368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:24.178562 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:24.179435 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:24.179439 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:24.179616 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:24.179716 (+ 100us) client_negotiation.cc:769] Sending connection context
0808 14:36:24.179798 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 14:36:24.179930 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"mutex_wait_us":203,"thread_start_us":117,"threads_started":1}
I20260808 14:36:24.180922 31700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93ff9519417f48de8a53494fba800281" candidate_uuid: "f7ad6925305547acbd11200d4937d0ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cbb165ca2e54a1496f1e568489dde0d" is_pre_election: true
I20260808 14:36:24.180958 31901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93ff9519417f48de8a53494fba800281" candidate_uuid: "f7ad6925305547acbd11200d4937d0ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "469984bad5534848a64fff1deaf292cf" is_pre_election: true
I20260808 14:36:24.181289 31901 raft_consensus.cc:2454] T 93ff9519417f48de8a53494fba800281 P 469984bad5534848a64fff1deaf292cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7ad6925305547acbd11200d4937d0ea in term 0.
I20260808 14:36:24.181293 31700 raft_consensus.cc:2454] T 93ff9519417f48de8a53494fba800281 P 8cbb165ca2e54a1496f1e568489dde0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7ad6925305547acbd11200d4937d0ea in term 0.
I20260808 14:36:24.181850 32019 leader_election.cc:302] T 93ff9519417f48de8a53494fba800281 P f7ad6925305547acbd11200d4937d0ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8cbb165ca2e54a1496f1e568489dde0d, f7ad6925305547acbd11200d4937d0ea; no voters:
I20260808 14:36:24.182179 32254 raft_consensus.cc:2781] T 93ff9519417f48de8a53494fba800281 P f7ad6925305547acbd11200d4937d0ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:36:24.182262 32254 raft_consensus.cc:482] T 93ff9519417f48de8a53494fba800281 P f7ad6925305547acbd11200d4937d0ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:36:24.182294 32254 raft_consensus.cc:3037] T 93ff9519417f48de8a53494fba800281 P f7ad6925305547acbd11200d4937d0ea [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:36:24.183451 32254 raft_consensus.cc:504] T 93ff9519417f48de8a53494fba800281 P f7ad6925305547acbd11200d4937d0ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "469984bad5534848a64fff1deaf292cf" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 33957 } } peers { permanent_uuid: "f7ad6925305547acbd11200d4937d0ea" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 39929 } } peers { permanent_uuid: "8cbb165ca2e54a1496f1e568489dde0d" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 45817 } }
I20260808 14:36:24.183763 32254 leader_election.cc:288] T 93ff9519417f48de8a53494fba800281 P f7ad6925305547acbd11200d4937d0ea [CANDIDATE]: Term 1 election: Requested vote from peers 469984bad5534848a64fff1deaf292cf (127.11.131.194:33957), 8cbb165ca2e54a1496f1e568489dde0d (127.11.131.193:45817)
I20260808 14:36:24.184146 31901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93ff9519417f48de8a53494fba800281" candidate_uuid: "f7ad6925305547acbd11200d4937d0ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "469984bad5534848a64fff1deaf292cf"
I20260808 14:36:24.184207 31700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "93ff9519417f48de8a53494fba800281" candidate_uuid: "f7ad6925305547acbd11200d4937d0ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cbb165ca2e54a1496f1e568489dde0d"
I20260808 14:36:24.184267 31901 raft_consensus.cc:3037] T 93ff9519417f48de8a53494fba800281 P 469984bad5534848a64fff1deaf292cf [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:36:24.184363 31700 raft_consensus.cc:3037] T 93ff9519417f48de8a53494fba800281 P 8cbb165ca2e54a1496f1e568489dde0d [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:36:24.185393 31901 raft_consensus.cc:2454] T 93ff9519417f48de8a53494fba800281 P 469984bad5534848a64fff1deaf292cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7ad6925305547acbd11200d4937d0ea in term 1.
I20260808 14:36:24.185469 31700 raft_consensus.cc:2454] T 93ff9519417f48de8a53494fba800281 P 8cbb165ca2e54a1496f1e568489dde0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7ad6925305547acbd11200d4937d0ea in term 1.
I20260808 14:36:24.185688 32019 leader_election.cc:302] T 93ff9519417f48de8a53494fba800281 P f7ad6925305547acbd11200d4937d0ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 469984bad5534848a64fff1deaf292cf, f7ad6925305547acbd11200d4937d0ea; no voters:
I20260808 14:36:24.185859 32254 raft_consensus.cc:2781] T 93ff9519417f48de8a53494fba800281 P f7ad6925305547acbd11200d4937d0ea [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:36:24.186101 32254 raft_consensus.cc:686] T 93ff9519417f48de8a53494fba800281 P f7ad6925305547acbd11200d4937d0ea [term 1 LEADER]: Becoming Leader. State: Replica: f7ad6925305547acbd11200d4937d0ea, State: Running, Role: LEADER
I20260808 14:36:24.186463 32254 consensus_queue.cc:237] T 93ff9519417f48de8a53494fba800281 P f7ad6925305547acbd11200d4937d0ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "469984bad5534848a64fff1deaf292cf" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 33957 } } peers { permanent_uuid: "f7ad6925305547acbd11200d4937d0ea" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 39929 } } peers { permanent_uuid: "8cbb165ca2e54a1496f1e568489dde0d" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 45817 } }
I20260808 14:36:24.190042 31469 catalog_manager.cc:5495] T 93ff9519417f48de8a53494fba800281 P f7ad6925305547acbd11200d4937d0ea reported cstate change: term changed from 0 to 1, leader changed from <none> to f7ad6925305547acbd11200d4937d0ea (127.11.131.195). New cstate: current_term: 1 leader_uuid: "f7ad6925305547acbd11200d4937d0ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "469984bad5534848a64fff1deaf292cf" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 33957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f7ad6925305547acbd11200d4937d0ea" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 39929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8cbb165ca2e54a1496f1e568489dde0d" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 45817 } health_report { overall_health: UNKNOWN } } }
I20260808 14:36:24.217149 32238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:24.213697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41568 (local address 127.11.131.195:39929)
0808 14:36:24.213841 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:24.213845 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:24.213858 (+ 13us) server_negotiation.cc:407] Connection header received
0808 14:36:24.213939 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:24.213942 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:24.213998 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:24.214091 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:36:24.214312 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:24.214880 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:24.215707 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:24.215917 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:24.215992 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:24.216252 (+ 260us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:36:24.216714 (+ 462us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:36:24.216805 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:24.216868 (+ 63us) server_negotiation.cc:299] Negotiation successful
0808 14:36:24.216919 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 14:36:24.223681 31700 raft_consensus.cc:1261] T 93ff9519417f48de8a53494fba800281 P 8cbb165ca2e54a1496f1e568489dde0d [term 1 FOLLOWER]: Refusing update from remote peer f7ad6925305547acbd11200d4937d0ea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:36:24.223681 31901 raft_consensus.cc:1261] T 93ff9519417f48de8a53494fba800281 P 469984bad5534848a64fff1deaf292cf [term 1 FOLLOWER]: Refusing update from remote peer f7ad6925305547acbd11200d4937d0ea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:36:24.224463 32254 consensus_queue.cc:1035] T 93ff9519417f48de8a53494fba800281 P f7ad6925305547acbd11200d4937d0ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cbb165ca2e54a1496f1e568489dde0d" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 45817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:36:24.224918 32268 consensus_queue.cc:1035] T 93ff9519417f48de8a53494fba800281 P f7ad6925305547acbd11200d4937d0ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "469984bad5534848a64fff1deaf292cf" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 33957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:36:24.232704 32276 mvcc.cc:205] Tried to move back new op lower bound from 7316274316171247616 to 7316274316031115264. Current Snapshot: MvccSnapshot[applied={T|T < 7316274316171247616}]
I20260808 14:36:24.235981 32278 mvcc.cc:205] Tried to move back new op lower bound from 7316274316171247616 to 7316274316031115264. Current Snapshot: MvccSnapshot[applied={T|T < 7316274316171247616}]
I20260808 14:36:24.241954 31469 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37594:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:36:24.242137 31469 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37594:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:36:24.244745 31469 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2c885f5400754ef89d8bc8285cb18430: Sending DeleteTablet for 3 replicas of tablet 93ff9519417f48de8a53494fba800281
I20260808 14:36:24.245587 32076 tablet_service.cc:1514] Processing DeleteTablet for tablet 93ff9519417f48de8a53494fba800281 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:36:24 UTC) from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:41562
I20260808 14:36:24.245587 31659 tablet_service.cc:1514] Processing DeleteTablet for tablet 93ff9519417f48de8a53494fba800281 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:36:24 UTC) from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:35836
I20260808 14:36:24.245675 31883 tablet_service.cc:1514] Processing DeleteTablet for tablet 93ff9519417f48de8a53494fba800281 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:36:24 UTC) from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:44938
I20260808 14:36:24.246141 32299 tablet_replica.cc:330] T 93ff9519417f48de8a53494fba800281 P 8cbb165ca2e54a1496f1e568489dde0d: stopping tablet replica
I20260808 14:36:24.246383 32300 tablet_replica.cc:330] T 93ff9519417f48de8a53494fba800281 P f7ad6925305547acbd11200d4937d0ea: stopping tablet replica
I20260808 14:36:24.246531 32299 raft_consensus.cc:2229] T 93ff9519417f48de8a53494fba800281 P 8cbb165ca2e54a1496f1e568489dde0d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:36:24.246750 32300 raft_consensus.cc:2229] T 93ff9519417f48de8a53494fba800281 P f7ad6925305547acbd11200d4937d0ea [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:36:24.246959 32299 raft_consensus.cc:2258] T 93ff9519417f48de8a53494fba800281 P 8cbb165ca2e54a1496f1e568489dde0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:36:24.246977 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 31514
I20260808 14:36:24.247190 32300 raft_consensus.cc:2258] T 93ff9519417f48de8a53494fba800281 P f7ad6925305547acbd11200d4937d0ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:36:24.247963 32301 tablet_replica.cc:330] T 93ff9519417f48de8a53494fba800281 P 469984bad5534848a64fff1deaf292cf: stopping tablet replica
I20260808 14:36:24.248307 32301 raft_consensus.cc:2229] T 93ff9519417f48de8a53494fba800281 P 469984bad5534848a64fff1deaf292cf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:36:24.248628 32301 raft_consensus.cc:2258] T 93ff9519417f48de8a53494fba800281 P 469984bad5534848a64fff1deaf292cf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:36:24.251092 32301 ts_tablet_manager.cc:1905] T 93ff9519417f48de8a53494fba800281 P 469984bad5534848a64fff1deaf292cf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:36:24.252075 32300 ts_tablet_manager.cc:1905] T 93ff9519417f48de8a53494fba800281 P f7ad6925305547acbd11200d4937d0ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:36:24.254452 32301 ts_tablet_manager.cc:1918] T 93ff9519417f48de8a53494fba800281 P 469984bad5534848a64fff1deaf292cf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:36:24.254621 32301 log.cc:1196] T 93ff9519417f48de8a53494fba800281 P 469984bad5534848a64fff1deaf292cf: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-1/wal/wals/93ff9519417f48de8a53494fba800281
I20260808 14:36:24.255048 32301 ts_tablet_manager.cc:1939] T 93ff9519417f48de8a53494fba800281 P 469984bad5534848a64fff1deaf292cf: Deleting consensus metadata
I20260808 14:36:24.255333 32300 ts_tablet_manager.cc:1918] T 93ff9519417f48de8a53494fba800281 P f7ad6925305547acbd11200d4937d0ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:36:24.255498 32300 log.cc:1196] T 93ff9519417f48de8a53494fba800281 P f7ad6925305547acbd11200d4937d0ea: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786199615258783-11791-0/minicluster-data/ts-2/wal/wals/93ff9519417f48de8a53494fba800281
I20260808 14:36:24.255888 32300 ts_tablet_manager.cc:1939] T 93ff9519417f48de8a53494fba800281 P f7ad6925305547acbd11200d4937d0ea: Deleting consensus metadata
I20260808 14:36:24.257041 31446 catalog_manager.cc:4841] TS 469984bad5534848a64fff1deaf292cf (127.11.131.194:33957): tablet 93ff9519417f48de8a53494fba800281 (table test-table [id=90db977039604e4b83c6e2c578b37c07]) successfully deleted
I20260808 14:36:24.257253 31447 catalog_manager.cc:4841] TS f7ad6925305547acbd11200d4937d0ea (127.11.131.195:39929): tablet 93ff9519417f48de8a53494fba800281 (table test-table [id=90db977039604e4b83c6e2c578b37c07]) successfully deleted
W20260808 14:36:24.262360 31446 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.131.193:45817 (error 108)
I20260808 14:36:24.263324 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 31776
I20260808 14:36:24.263607 32239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:24.263283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:45817 (local address 127.0.0.1:35846)
0808 14:36:24.263441 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:24.263513 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.193:45817: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260808 14:36:24.269744 31446 catalog_manager.cc:4584] TS 8cbb165ca2e54a1496f1e568489dde0d (127.11.131.193:45817): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 93ff9519417f48de8a53494fba800281: Network error: Client connection negotiation failed: client connection to 127.11.131.193:45817: connect: Connection refused (error 111)
I20260808 14:36:24.276032 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 31988
I20260808 14:36:24.286934 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 31415
I20260808 14:36:24.307622 11791 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 14:36:24.652354 11791 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 14:36:24.652495 11791 mini_ranger.cc:66] Stopping Ranger...
I20260808 14:36:25.008119 11791 mini_ranger.cc:68] Stopped Ranger
2026-08-08 14:36:25.008 UTC [29951] LOG: received smart shutdown request
2026-08-08 14:36:25.013 UTC [29951] LOG: background worker "logical replication launcher" (PID 29963) exited with exit code 1
2026-08-08 14:36:25.013 UTC [29956] LOG: shutting down
2026-08-08 14:36:25.198 UTC [29951] LOG: database system is shut down
2026-08-08T14:36:25Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (51537 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:36:25 dist-test-slave-twwt krb5kdc[32314](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:36:25 dist-test-slave-twwt krb5kdc[32314](info): set up 2 sockets
Aug 08 14:36:25 dist-test-slave-twwt krb5kdc[32314](info): commencing operation
krb5kdc: starting...
W20260808 14:36:26.595614 11791 mini_kdc.cc:121] Time spent starting KDC: real 1.247s user 0.003s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Aug 08 14:36:26 dist-test-slave-twwt krb5kdc[32314](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199786, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:36:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:36:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.131.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
I20260808 14:36:26.732121 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:46019
--webserver_interface=127.11.131.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:36519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:46019,127.11.131.253:36531,127.11.131.252:41095
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:36:26.850483 32333 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:26.850869 32333 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:26.850955 32333 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:26.854951 32333 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:36:26.855044 32333 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:26.855085 32333 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:26.855162 32333 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:36:26.855208 32333 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:36:26.860821 32333 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:36519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:46019,127.11.131.253:36531,127.11.131.252:41095
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:46019
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.131.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32333
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:36:26.862023 32333 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:26.863166 32333 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 14:36:26.872323 32333 server_base.cc:1034] running on GCE node
W20260808 14:36:26.872229 32346 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:26.872252 32344 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:26.872229 32343 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:26.873209 32333 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:26.874349 32333 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:26.875523 32333 hybrid_clock.cc:648] HybridClock initialized: now 1786199786875482 us; error 51 us; skew 500 ppm
Aug 08 14:36:26 dist-test-slave-twwt krb5kdc[32314](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199786, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:26.878371 32333 init.cc:377] Logged in from keytab as kudu/127.11.131.254@KRBTEST.COM (short username kudu)
I20260808 14:36:26.879418 32333 webserver.cc:460] Webserver started at http://127.11.131.254:40211/ using document root <none> and password file <none>
I20260808 14:36:26.880023 32333 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:26.880120 32333 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:26.880373 32333 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:36:26.882503 32333 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/minicluster-data/master-0/data/instance:
uuid: "5808aa5e1dfb4cea9003f17eb4a4a1c9"
format_stamp: "Formatted at 2026-08-08 14:36:26 on dist-test-slave-twwt"
server_key: "57cb3ba103d8f8211d30c1d8be598cff"
server_key_iv: "cf410b75021e40b33531e6dd9b3c6a0d"
server_key_version: "encryptionkey@0"
I20260808 14:36:26.883173 32333 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/minicluster-data/master-0/wal/instance:
uuid: "5808aa5e1dfb4cea9003f17eb4a4a1c9"
format_stamp: "Formatted at 2026-08-08 14:36:26 on dist-test-slave-twwt"
server_key: "57cb3ba103d8f8211d30c1d8be598cff"
server_key_iv: "cf410b75021e40b33531e6dd9b3c6a0d"
server_key_version: "encryptionkey@0"
I20260808 14:36:26.887048 32333 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 14:36:26.889520 32356 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:26.890838 32333 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 14:36:26.890981 32333 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "5808aa5e1dfb4cea9003f17eb4a4a1c9"
format_stamp: "Formatted at 2026-08-08 14:36:26 on dist-test-slave-twwt"
server_key: "57cb3ba103d8f8211d30c1d8be598cff"
server_key_iv: "cf410b75021e40b33531e6dd9b3c6a0d"
server_key_version: "encryptionkey@0"
I20260808 14:36:26.891098 32333 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:26.908114 32333 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:26.911332 32333 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:26.911547 32333 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:26.919251 32333 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.254:46019
I20260808 14:36:26.919605 32433 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.254:46019 every 8 connection(s)
I20260808 14:36:26.920297 32333 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:36:26.923287 32437 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:36:26.927400 32437 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46019 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:36:26.930037 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 32333
I20260808 14:36:26.930176 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/minicluster-data/master-0/wal/instance
I20260808 14:36:26.930514 11791 external_mini_cluster.cc:1428] Setting key 7de1118b29f2d20b371aebf29473a6d5
Aug 08 14:36:26 dist-test-slave-twwt krb5kdc[32314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199786, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.131.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.253@KRBTEST.COM" created.
I20260808 14:36:26.942862 32439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:26.929660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54910 (local address 127.11.131.254:46019)
0808 14:36:26.930119 (+ 459us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:26.930140 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:26.930449 (+ 309us) server_negotiation.cc:407] Connection header received
0808 14:36:26.931568 (+ 1119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:26.931573 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:26.931756 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:26.931958 (+ 202us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:26.932819 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:26.933678 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:26.934740 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:26.935099 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:26.935272 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:26.937641 (+ 2369us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:26.937648 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:26.937658 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:26.937678 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:26.939440 (+ 1762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:26.939933 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:26.939946 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:26.939948 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:26.940049 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:26.940367 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:26.940372 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:26.940374 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:26.940872 (+ 498us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:26.941018 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:26.941398 (+ 380us) server_negotiation.cc:299] Negotiation successful
0808 14:36:26.941721 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":24,"server-negotiator.queue_time_us":292,"thread_start_us":136,"threads_started":1}
I20260808 14:36:26.942862 32440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:26.929660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:46019 (local address 127.0.0.1:54910)
0808 14:36:26.930291 (+ 631us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:26.930340 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:26.931220 (+ 880us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:26.931953 (+ 733us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:26.931958 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:26.932415 (+ 457us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:26.932650 (+ 235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:26.932663 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:26.933827 (+ 1164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:26.933829 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:26.934539 (+ 710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:26.934548 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:26.935264 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:26.935268 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:26.935377 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:26.936019 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:26.936036 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:26.937490 (+ 1454us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:26.939552 (+ 2062us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:26.939563 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:26.939573 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:26.939819 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:26.940145 (+ 326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:26.940150 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:26.940152 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:26.940273 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:26.940987 (+ 714us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:26.940993 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:26.941142 (+ 149us) client_negotiation.cc:769] Sending connection context
0808 14:36:26.941320 (+ 178us) client_negotiation.cc:240] Negotiation successful
0808 14:36:26.941773 (+ 453us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":431,"mutex_wait_us":160,"spinlock_wait_cycles":5376,"thread_start_us":189,"threads_started":1}
I20260808 14:36:26.945657 32437 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36531 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:36:26.946523 32440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:26.946176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.253:36531 (local address 127.0.0.1:58656)
0808 14:36:26.946330 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:26.946422 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.253:36531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260808 14:36:26.946822 32359 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.131.253:36531: connect: Connection refused (error 111)
I20260808 14:36:26.948076 32440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:26.947777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.253:36531 (local address 127.0.0.1:58660)
0808 14:36:26.947931 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:26.947989 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.253:36531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260808 14:36:26.948231 32437 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.131.253:36531: Network error: Client connection negotiation failed: client connection to 127.11.131.253:36531: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.253.keytab.
Entry for principal kudu/127.11.131.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.253.keytab.
I20260808 14:36:26.961262 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.253:36531
--webserver_interface=127.11.131.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.253.keytab
--principal=kudu/127.11.131.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:36519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:46019,127.11.131.253:36531,127.11.131.252:41095
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:36:26.997517 32437 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36531 } attempt: 1
I20260808 14:36:26.998450 32440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:26.998137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.253:36531 (local address 127.0.0.1:58666)
0808 14:36:26.998299 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:26.998367 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.253:36531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260808 14:36:26.999207 32440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:26.998987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.253:36531 (local address 127.0.0.1:58676)
0808 14:36:26.999100 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:26.999153 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.253:36531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260808 14:36:26.999327 32437 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.131.253:36531: Network error: Client connection negotiation failed: client connection to 127.11.131.253:36531: connect: Connection refused (error 111)
I20260808 14:36:27.067484 32437 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36531 } attempt: 2
I20260808 14:36:27.068519 32440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:27.068141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.253:36531 (local address 127.0.0.1:58686)
0808 14:36:27.068334 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:27.068410 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.253:36531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260808 14:36:27.069347 32440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:27.069109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.253:36531 (local address 127.0.0.1:58690)
0808 14:36:27.069225 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:27.069280 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.253:36531: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260808 14:36:27.069499 32437 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.131.253:36531: Network error: Client connection negotiation failed: client connection to 127.11.131.253:36531: connect: Connection refused (error 111)
W20260808 14:36:27.079165 32450 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:27.079420 32450 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:27.079460 32450 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:27.083472 32450 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:36:27.083524 32450 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:27.083545 32450 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:27.083561 32450 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:36:27.083576 32450 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:36:27.088982 32450 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:36519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:46019,127.11.131.253:36531,127.11.131.252:41095
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.253.keytab
--principal=kudu/127.11.131.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.253:36531
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.131.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32450
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:36:27.090062 32450 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:27.091163 32450 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:27.099973 32460 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:27.099968 32462 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:27.099964 32459 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:27.100308 32450 server_base.cc:1034] running on GCE node
I20260808 14:36:27.100843 32450 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:27.101994 32450 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:27.103199 32450 hybrid_clock.cc:648] HybridClock initialized: now 1786199787103177 us; error 32 us; skew 500 ppm
Aug 08 14:36:27 dist-test-slave-twwt krb5kdc[32314](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199787, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:27.106003 32450 init.cc:377] Logged in from keytab as kudu/127.11.131.253@KRBTEST.COM (short username kudu)
I20260808 14:36:27.106951 32450 webserver.cc:460] Webserver started at http://127.11.131.253:34683/ using document root <none> and password file <none>
I20260808 14:36:27.107527 32450 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:27.107617 32450 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:27.107863 32450 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:36:27.109915 32450 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/minicluster-data/master-1/data/instance:
uuid: "d4e5b704ddc5494c89e4e25c898d0955"
format_stamp: "Formatted at 2026-08-08 14:36:27 on dist-test-slave-twwt"
server_key: "8d94b41991bd2e5327b9816ff8de6adf"
server_key_iv: "4e1432f69d870f896288f00b8119fde9"
server_key_version: "encryptionkey@0"
I20260808 14:36:27.110495 32450 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/minicluster-data/master-1/wal/instance:
uuid: "d4e5b704ddc5494c89e4e25c898d0955"
format_stamp: "Formatted at 2026-08-08 14:36:27 on dist-test-slave-twwt"
server_key: "8d94b41991bd2e5327b9816ff8de6adf"
server_key_iv: "4e1432f69d870f896288f00b8119fde9"
server_key_version: "encryptionkey@0"
I20260808 14:36:27.114190 32450 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260808 14:36:27.116671 32475 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:27.117885 32450 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 14:36:27.118037 32450 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/minicluster-data/master-1/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/minicluster-data/master-1/wal
uuid: "d4e5b704ddc5494c89e4e25c898d0955"
format_stamp: "Formatted at 2026-08-08 14:36:27 on dist-test-slave-twwt"
server_key: "8d94b41991bd2e5327b9816ff8de6adf"
server_key_iv: "4e1432f69d870f896288f00b8119fde9"
server_key_version: "encryptionkey@0"
I20260808 14:36:27.118150 32450 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:27.138759 32450 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:27.141691 32450 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:27.141917 32450 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:27.149437 32450 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.253:36531
I20260808 14:36:27.149760 32555 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.253:36531 every 8 connection(s)
I20260808 14:36:27.150463 32450 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/minicluster-data/master-1/data/info.pb
I20260808 14:36:27.153469 32556 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:36:27.157312 32556 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46019 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:36:27.158214 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 32450
I20260808 14:36:27.158381 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/minicluster-data/master-1/wal/instance
I20260808 14:36:27.158731 11791 external_mini_cluster.cc:1428] Setting key a7be9e33bb9704790d93ab45d2f440f5
I20260808 14:36:27.160645 32437 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36531 } attempt: 3
Aug 08 14:36:27 dist-test-slave-twwt krb5kdc[32314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199787, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.253@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
Aug 08 14:36:27 dist-test-slave-twwt krb5kdc[32314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199786, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for kudu/127.11.131.253@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.131.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.252@KRBTEST.COM" created.
I20260808 14:36:27.173537 32439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:27.159377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54922 (local address 127.11.131.254:46019)
0808 14:36:27.159558 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:27.159566 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:27.160433 (+ 867us) server_negotiation.cc:407] Connection header received
0808 14:36:27.161698 (+ 1265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:27.161701 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:27.161758 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:27.161837 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:27.163214 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.163749 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.164876 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.165296 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.165423 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:27.168663 (+ 3240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:27.168667 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:27.168670 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:27.168702 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:27.171234 (+ 2532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:27.171806 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:27.171809 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:27.171811 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:27.171906 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:27.172309 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:27.172313 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:27.172315 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:27.172576 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:27.172700 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:27.173200 (+ 500us) server_negotiation.cc:299] Negotiation successful
0808 14:36:27.173351 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 14:36:27.173892 32440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:27.161144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.253:36531 (local address 127.0.0.1:58706)
0808 14:36:27.161345 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:27.161361 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:27.161448 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:27.162389 (+ 941us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:27.162392 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:27.162561 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:27.162716 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:27.162725 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.164497 (+ 1772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.164500 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:27.165140 (+ 640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:27.165150 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.165961 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.165969 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:27.166484 (+ 515us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:27.167061 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:27.167080 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:27.168511 (+ 1431us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:27.171135 (+ 2624us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:27.171138 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:27.171139 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:27.171418 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:27.171926 (+ 508us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:27.171928 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:27.171930 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:27.172047 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:27.173006 (+ 959us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:27.173010 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:27.173117 (+ 107us) client_negotiation.cc:769] Sending connection context
0808 14:36:27.173224 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 14:36:27.173597 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"mutex_wait_us":231}
I20260808 14:36:27.174851 32558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:27.159732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:46019 (local address 127.0.0.1:54922)
0808 14:36:27.160244 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:27.160304 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:27.161466 (+ 1162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:27.161989 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:27.161996 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:27.162363 (+ 367us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:27.163084 (+ 721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:27.163097 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.163870 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.163873 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:27.164736 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:27.164748 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.165452 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.165455 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:27.165721 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:27.166412 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:27.166428 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:27.168494 (+ 2066us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:27.171346 (+ 2852us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:27.171358 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:27.171372 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:27.171697 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:27.172032 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:27.172035 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:27.172038 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:27.172202 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:27.172700 (+ 498us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:27.172709 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:27.172929 (+ 220us) client_negotiation.cc:769] Sending connection context
0808 14:36:27.173133 (+ 204us) client_negotiation.cc:240] Negotiation successful
0808 14:36:27.173542 (+ 409us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"mutex_wait_us":30,"spinlock_wait_cycles":15616,"thread_start_us":103,"threads_started":1}
I20260808 14:36:27.174853 32561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:27.161266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58706 (local address 127.11.131.253:36531)
0808 14:36:27.161718 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:27.161746 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:27.161795 (+ 49us) server_negotiation.cc:407] Connection header received
0808 14:36:27.161956 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:27.161964 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:27.162193 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:27.162389 (+ 196us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:27.162879 (+ 490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.164371 (+ 1492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.165260 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.165813 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.165941 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:27.168723 (+ 2782us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:27.168744 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:27.168762 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:27.168797 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:27.171004 (+ 2207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:27.171595 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:27.171604 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:27.171609 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:27.171805 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:27.172245 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:27.172252 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:27.172257 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:27.172879 (+ 622us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:27.173038 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:27.173406 (+ 368us) server_negotiation.cc:299] Negotiation successful
0808 14:36:27.174484 (+ 1078us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":941,"server-negotiator.queue_time_us":339,"spinlock_wait_cycles":12672,"thread_start_us":150,"threads_started":1}
I20260808 14:36:27.176231 32556 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36531 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:36:27.177327 32437 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.131.252" port: 41095 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:36:27.178086 32440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:27.177824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.252:41095 (local address 127.0.0.1:58740)
0808 14:36:27.177957 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:27.178016 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.252:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260808 14:36:27.179003 32440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:27.178603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.252:41095 (local address 127.0.0.1:58748)
0808 14:36:27.178859 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:27.178920 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.252:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143}
W20260808 14:36:27.179235 32437 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.131.252:41095: Network error: Client connection negotiation failed: client connection to 127.11.131.252:41095: connect: Connection refused (error 111)
Aug 08 14:36:27 dist-test-slave-twwt krb5kdc[32314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199787, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.253@KRBTEST.COM for kudu/127.11.131.253@KRBTEST.COM
I20260808 14:36:27.184867 32558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:27.176758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.253:36531 (local address 127.0.0.1:58722)
0808 14:36:27.176991 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:27.177006 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:27.177081 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:27.177365 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:27.177368 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:27.177562 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:27.177655 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:27.177661 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.178649 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.178653 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:27.179268 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:27.179278 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.179733 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.179737 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:27.179858 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:27.180353 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:27.180367 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:27.181605 (+ 1238us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:27.183386 (+ 1781us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:27.183391 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:27.183393 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:27.183584 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:27.183864 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:27.183867 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:27.183869 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:27.183951 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:27.184325 (+ 374us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:27.184328 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:27.184424 (+ 96us) client_negotiation.cc:769] Sending connection context
0808 14:36:27.184530 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 14:36:27.184678 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"mutex_wait_us":20}
I20260808 14:36:27.184867 32561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:27.177013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58722 (local address 127.11.131.253:36531)
0808 14:36:27.177145 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:27.177151 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:27.177167 (+ 16us) server_negotiation.cc:407] Connection header received
0808 14:36:27.177207 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:27.177213 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:27.177265 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:27.177350 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:27.177765 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.178500 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.179404 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.179631 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.179735 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:27.181735 (+ 2000us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:27.181738 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:27.181741 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:27.181764 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:27.183261 (+ 1497us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:27.183680 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:27.183685 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:27.183687 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:27.183762 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:27.184045 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:27.184048 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:27.184050 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:27.184228 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:27.184336 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:27.184576 (+ 240us) server_negotiation.cc:299] Negotiation successful
0808 14:36:27.184735 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":65,"server-negotiator.queue_time_us":49}
I20260808 14:36:27.185742 32556 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.131.252" port: 41095 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:36:27.186764 32558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:27.186387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.252:41095 (local address 127.0.0.1:58762)
0808 14:36:27.186506 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:27.186589 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.252:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260808 14:36:27.187058 32479 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.131.252:41095: connect: Connection refused (error 111)
I20260808 14:36:27.188191 32558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:27.187917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.252:41095 (local address 127.0.0.1:58774)
0808 14:36:27.188073 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:27.188135 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.252:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260808 14:36:27.188388 32556 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.131.252:41095: Network error: Client connection negotiation failed: client connection to 127.11.131.252:41095: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.252.keytab.
Entry for principal kudu/127.11.131.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.252.keytab.
I20260808 14:36:27.193917 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.252:41095
--webserver_interface=127.11.131.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.252.keytab
--principal=kudu/127.11.131.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:36519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:46019,127.11.131.253:36531,127.11.131.252:41095
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:36:27.210412 32437 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.131.252" port: 41095 } attempt: 1
I20260808 14:36:27.211366 32440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:27.211011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.252:41095 (local address 127.0.0.1:58790)
0808 14:36:27.211187 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:27.211263 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.252:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260808 14:36:27.212141 32440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:27.211923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.252:41095 (local address 127.0.0.1:58792)
0808 14:36:27.212033 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:27.212083 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.252:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260808 14:36:27.212317 32437 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.131.252:41095: Network error: Client connection negotiation failed: client connection to 127.11.131.252:41095: connect: Connection refused (error 111)
I20260808 14:36:27.237691 32556 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.131.252" port: 41095 } attempt: 1
I20260808 14:36:27.238706 32558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:27.238312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.252:41095 (local address 127.0.0.1:58808)
0808 14:36:27.238499 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:27.238577 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.252:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260808 14:36:27.239594 32558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:27.239298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.252:41095 (local address 127.0.0.1:58814)
0808 14:36:27.239438 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:27.239503 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.252:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260808 14:36:27.239758 32556 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.131.252:41095: Network error: Client connection negotiation failed: client connection to 127.11.131.252:41095: connect: Connection refused (error 111)
I20260808 14:36:27.287510 32437 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.131.252" port: 41095 } attempt: 2
I20260808 14:36:27.288502 32440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:27.288167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.252:41095 (local address 127.0.0.1:58822)
0808 14:36:27.288339 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:27.288405 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.252:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260808 14:36:27.289251 32440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:27.289026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.252:41095 (local address 127.0.0.1:58824)
0808 14:36:27.289142 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:27.289194 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.252:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260808 14:36:27.289404 32437 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.131.252:41095: Network error: Client connection negotiation failed: client connection to 127.11.131.252:41095: connect: Connection refused (error 111)
I20260808 14:36:27.307932 32556 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.131.252" port: 41095 } attempt: 2
I20260808 14:36:27.308807 32558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:27.308455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.252:41095 (local address 127.0.0.1:58832)
0808 14:36:27.308644 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:27.308713 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.252:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260808 14:36:27.309595 32558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:27.309373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.252:41095 (local address 127.0.0.1:58848)
0808 14:36:27.309487 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:27.309537 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.252:41095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260808 14:36:27.309827 32556 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.131.252:41095: Network error: Client connection negotiation failed: client connection to 127.11.131.252:41095: connect: Connection refused (error 111)
W20260808 14:36:27.313994 32565 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:27.314224 32565 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:27.314332 32565 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:27.318295 32565 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:36:27.318351 32565 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:27.318370 32565 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:27.318418 32565 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:36:27.318449 32565 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:36:27.323905 32565 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:36519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:46019,127.11.131.253:36531,127.11.131.252:41095
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.252.keytab
--principal=kudu/127.11.131.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.252:41095
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.131.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32565
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:36:27.324987 32565 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:27.326129 32565 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:27.334545 32575 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:27.334547 32573 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:27.334626 32580 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:27.335079 32565 server_base.cc:1034] running on GCE node
I20260808 14:36:27.335640 32565 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:27.336735 32565 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:27.337925 32565 hybrid_clock.cc:648] HybridClock initialized: now 1786199787337907 us; error 27 us; skew 500 ppm
Aug 08 14:36:27 dist-test-slave-twwt krb5kdc[32314](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199787, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:27.340853 32565 init.cc:377] Logged in from keytab as kudu/127.11.131.252@KRBTEST.COM (short username kudu)
I20260808 14:36:27.341831 32565 webserver.cc:460] Webserver started at http://127.11.131.252:44219/ using document root <none> and password file <none>
I20260808 14:36:27.342410 32565 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:27.342500 32565 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:27.342790 32565 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:36:27.344887 32565 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/minicluster-data/master-2/data/instance:
uuid: "6915d02611134f4283b806279a5202e1"
format_stamp: "Formatted at 2026-08-08 14:36:27 on dist-test-slave-twwt"
server_key: "774241d6dfc37edab0296979c125d7ac"
server_key_iv: "76138162e5c527cde4607bf5259674e5"
server_key_version: "encryptionkey@0"
I20260808 14:36:27.345477 32565 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/minicluster-data/master-2/wal/instance:
uuid: "6915d02611134f4283b806279a5202e1"
format_stamp: "Formatted at 2026-08-08 14:36:27 on dist-test-slave-twwt"
server_key: "774241d6dfc37edab0296979c125d7ac"
server_key_iv: "76138162e5c527cde4607bf5259674e5"
server_key_version: "encryptionkey@0"
I20260808 14:36:27.349491 32565 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260808 14:36:27.352149 32587 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:27.353400 32565 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 14:36:27.353543 32565 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/minicluster-data/master-2/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/minicluster-data/master-2/wal
uuid: "6915d02611134f4283b806279a5202e1"
format_stamp: "Formatted at 2026-08-08 14:36:27 on dist-test-slave-twwt"
server_key: "774241d6dfc37edab0296979c125d7ac"
server_key_iv: "76138162e5c527cde4607bf5259674e5"
server_key_version: "encryptionkey@0"
I20260808 14:36:27.353660 32565 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:27.365579 32565 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:27.368324 32565 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:27.368525 32565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:27.375964 32565 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.252:41095
I20260808 14:36:27.376281 32682 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.252:41095 every 8 connection(s)
I20260808 14:36:27.377005 32565 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/minicluster-data/master-2/data/info.pb
I20260808 14:36:27.379976 32683 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:36:27.382053 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 32565
I20260808 14:36:27.382207 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786199615258783-11791-0/minicluster-data/master-2/wal/instance
I20260808 14:36:27.382529 11791 external_mini_cluster.cc:1428] Setting key 5d686bfcf5e954f09a034353eb0ffd86
I20260808 14:36:27.384611 32683 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46019 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:36:27.388558 32437 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.131.252" port: 41095 } attempt: 3
Aug 08 14:36:27 dist-test-slave-twwt krb5kdc[32314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199786, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.131.252@KRBTEST.COM
Aug 08 14:36:27 dist-test-slave-twwt krb5kdc[32314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199787, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.252@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
Aug 08 14:36:27 dist-test-slave-twwt krb5kdc[32314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199786, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for kudu/127.11.131.252@KRBTEST.COM
I20260808 14:36:27.399212 32440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:27.388998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.252:41095 (local address 127.0.0.1:58870)
0808 14:36:27.389169 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:27.389184 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:27.389286 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:27.389735 (+ 449us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:27.389738 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:27.389925 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:27.390014 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:27.390020 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.391105 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.391108 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:27.392288 (+ 1180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:27.392302 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.392956 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.392960 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:27.393050 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:27.393528 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:27.393547 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:27.394838 (+ 1291us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:27.397162 (+ 2324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:27.397165 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:27.397167 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:27.397432 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:27.397869 (+ 437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:27.397872 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:27.397874 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:27.397960 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:27.398703 (+ 743us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:27.398706 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:27.398795 (+ 89us) client_negotiation.cc:769] Sending connection context
0808 14:36:27.398919 (+ 124us) client_negotiation.cc:240] Negotiation successful
0808 14:36:27.399051 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102}
I20260808 14:36:27.399989 32439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:27.387105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54936 (local address 127.11.131.254:46019)
0808 14:36:27.387248 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:27.387253 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:27.387562 (+ 309us) server_negotiation.cc:407] Connection header received
0808 14:36:27.387760 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:27.387763 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:27.387809 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:27.387877 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:27.388795 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.389514 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.390930 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.391241 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.391364 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:27.395254 (+ 3890us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:27.395260 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:27.395262 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:27.395287 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:27.397169 (+ 1882us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:27.397770 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:27.397774 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:27.397776 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:27.397868 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:27.398204 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:27.398207 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:27.398209 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:27.398494 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:27.398600 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:27.399060 (+ 460us) server_negotiation.cc:299] Negotiation successful
0808 14:36:27.399185 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 14:36:27.400358 32692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:27.389204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58870 (local address 127.11.131.252:41095)
0808 14:36:27.389505 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:27.389512 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:27.389521 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:36:27.389547 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:27.389549 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:27.389608 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:27.389700 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:27.390139 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.390959 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.392427 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.392838 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.392921 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:27.394985 (+ 2064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:27.394994 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:27.395011 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:27.395041 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:27.397005 (+ 1964us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:27.397561 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:27.397569 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:27.397573 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:27.397724 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:27.398062 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:27.398066 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:27.398068 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:27.398581 (+ 513us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:27.398742 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:27.399025 (+ 283us) server_negotiation.cc:299] Negotiation successful
0808 14:36:27.399321 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":79,"server-negotiator.queue_time_us":247,"spinlock_wait_cycles":3456,"thread_start_us":81,"threads_started":1}
I20260808 14:36:27.400362 32690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:27.383930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58864 (local address 127.11.131.252:41095)
0808 14:36:27.384373 (+ 443us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:27.384391 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:27.384429 (+ 38us) server_negotiation.cc:407] Connection header received
0808 14:36:27.385092 (+ 663us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:27.385111 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:27.385491 (+ 380us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:27.385805 (+ 314us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:27.387713 (+ 1908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.389157 (+ 1444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.390336 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.390918 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.391076 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:27.395102 (+ 4026us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:27.395105 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:27.395107 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:27.395130 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:27.397798 (+ 2668us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:27.398269 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:27.398274 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:27.398276 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:27.398356 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:27.398696 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:27.398699 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:27.398700 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:27.398893 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:27.399057 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:27.399681 (+ 624us) server_negotiation.cc:299] Negotiation successful
0808 14:36:27.399794 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":36,"server-negotiator.queue_time_us":271,"thread_start_us":140,"threads_started":1}
I20260808 14:36:27.400367 32691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:27.387071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:46019 (local address 127.0.0.1:54936)
0808 14:36:27.387432 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:27.387480 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:27.387621 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:27.387959 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:27.387965 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:27.388414 (+ 449us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:27.388631 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:27.388644 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.389637 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.389643 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:27.390806 (+ 1163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:27.390817 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.391407 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.391411 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:27.391511 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:27.392073 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:27.392090 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:27.395107 (+ 3017us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:27.397273 (+ 2166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:27.397282 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:27.397292 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:27.397672 (+ 380us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:27.397949 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:27.397952 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:27.397953 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:27.398094 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:27.398637 (+ 543us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:27.398646 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:27.398815 (+ 169us) client_negotiation.cc:769] Sending connection context
0808 14:36:27.399238 (+ 423us) client_negotiation.cc:240] Negotiation successful
0808 14:36:27.399445 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":216,"mutex_wait_us":97,"spinlock_wait_cycles":10624,"thread_start_us":111,"threads_started":1}
I20260808 14:36:27.400980 32556 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.131.252" port: 41095 } attempt: 3
I20260808 14:36:27.405069 32437 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5808aa5e1dfb4cea9003f17eb4a4a1c9: Bootstrap starting.
Aug 08 14:36:27 dist-test-slave-twwt krb5kdc[32314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199787, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.253@KRBTEST.COM for kudu/127.11.131.252@KRBTEST.COM
I20260808 14:36:27.407932 32437 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5808aa5e1dfb4cea9003f17eb4a4a1c9: Neither blocks nor log segments found. Creating new log.
I20260808 14:36:27.408701 32437 log.cc:824] T 00000000000000000000000000000000 P 5808aa5e1dfb4cea9003f17eb4a4a1c9: Log is configured to *not* fsync() on all Append() calls
I20260808 14:36:27.402472 32683 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36531 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:36:27 dist-test-slave-twwt krb5kdc[32314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199787, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.252@KRBTEST.COM for kudu/127.11.131.253@KRBTEST.COM
I20260808 14:36:27.416107 32437 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5808aa5e1dfb4cea9003f17eb4a4a1c9: No bootstrap required, opened a new log
I20260808 14:36:27.416343 32558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:27.401454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.252:41095 (local address 127.0.0.1:58882)
0808 14:36:27.401598 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:27.401614 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:27.401698 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:27.401987 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:27.401990 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:27.402176 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:27.402263 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:27.402269 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.403272 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.403275 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:27.404100 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:27.404110 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.404681 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.404685 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:27.404776 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:27.405251 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:27.405265 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:27.406771 (+ 1506us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:27.413370 (+ 6599us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:27.413373 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:27.413375 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:27.413636 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:27.414682 (+ 1046us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:27.414687 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:27.414689 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:27.414798 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:27.415775 (+ 977us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:27.415778 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:27.415895 (+ 117us) client_negotiation.cc:769] Sending connection context
0808 14:36:27.416003 (+ 108us) client_negotiation.cc:240] Negotiation successful
0808 14:36:27.416162 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260808 14:36:27.416924 32690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:27.401543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58882 (local address 127.11.131.252:41095)
0808 14:36:27.401763 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:27.401767 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:27.401779 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:36:27.401811 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:27.401825 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:27.401866 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:27.401964 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:27.402432 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.403127 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.404217 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.404541 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.405007 (+ 466us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:27.406933 (+ 1926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:27.406937 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:27.406940 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:27.406964 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:27.413251 (+ 6287us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:27.413760 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:27.413766 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:27.413771 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:27.413966 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:27.415410 (+ 1444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:27.415413 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:27.415415 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:27.415651 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:27.416508 (+ 857us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:27.416612 (+ 104us) server_negotiation.cc:299] Negotiation successful
0808 14:36:27.416737 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160}
I20260808 14:36:27.419962 32556 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4e5b704ddc5494c89e4e25c898d0955: Bootstrap starting.
I20260808 14:36:27.420039 32437 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5808aa5e1dfb4cea9003f17eb4a4a1c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5808aa5e1dfb4cea9003f17eb4a4a1c9" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46019 } } peers { permanent_uuid: "d4e5b704ddc5494c89e4e25c898d0955" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36531 } } peers { permanent_uuid: "6915d02611134f4283b806279a5202e1" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 41095 } }
I20260808 14:36:27.420265 32437 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5808aa5e1dfb4cea9003f17eb4a4a1c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:36:27.420312 32437 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5808aa5e1dfb4cea9003f17eb4a4a1c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5808aa5e1dfb4cea9003f17eb4a4a1c9, State: Initialized, Role: FOLLOWER
I20260808 14:36:27.420739 32437 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5808aa5e1dfb4cea9003f17eb4a4a1c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5808aa5e1dfb4cea9003f17eb4a4a1c9" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46019 } } peers { permanent_uuid: "d4e5b704ddc5494c89e4e25c898d0955" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36531 } } peers { permanent_uuid: "6915d02611134f4283b806279a5202e1" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 41095 } }
I20260808 14:36:27.421212 32694 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5808aa5e1dfb4cea9003f17eb4a4a1c9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5808aa5e1dfb4cea9003f17eb4a4a1c9" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46019 } } peers { permanent_uuid: "d4e5b704ddc5494c89e4e25c898d0955" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36531 } } peers { permanent_uuid: "6915d02611134f4283b806279a5202e1" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 41095 } } }
I20260808 14:36:27.421361 32694 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5808aa5e1dfb4cea9003f17eb4a4a1c9 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:36:27.422065 32437 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5808aa5e1dfb4cea9003f17eb4a4a1c9 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:36:27.422904 32556 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d4e5b704ddc5494c89e4e25c898d0955: Neither blocks nor log segments found. Creating new log.
I20260808 14:36:27.423904 32556 log.cc:824] T 00000000000000000000000000000000 P d4e5b704ddc5494c89e4e25c898d0955: Log is configured to *not* fsync() on all Append() calls
I20260808 14:36:27.426461 32691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:27.409650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.253:36531 (local address 127.0.0.1:58732)
0808 14:36:27.410142 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:27.410156 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:27.410276 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:27.410638 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:27.410641 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:27.410805 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:27.410910 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:27.410916 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.411927 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.411930 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:27.412777 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:27.412789 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.413519 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.413522 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:27.413634 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:27.414067 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:27.414115 (+ 48us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:27.416893 (+ 2778us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:27.424481 (+ 7588us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:27.424488 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:27.424493 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:27.424761 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:27.425170 (+ 409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:27.425175 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:27.425178 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:27.425279 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:27.425897 (+ 618us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:27.425900 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:27.426033 (+ 133us) client_negotiation.cc:769] Sending connection context
0808 14:36:27.426145 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 14:36:27.426292 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":426}
I20260808 14:36:27.426815 32556 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4e5b704ddc5494c89e4e25c898d0955: No bootstrap required, opened a new log
I20260808 14:36:27.427342 32561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:27.409933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58732 (local address 127.11.131.253:36531)
0808 14:36:27.410042 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:27.410046 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:27.410209 (+ 163us) server_negotiation.cc:407] Connection header received
0808 14:36:27.410394 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:27.410397 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:27.410438 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:27.410485 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:27.411032 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.411794 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.412920 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.413284 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.413371 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:27.417289 (+ 3918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:27.417294 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:27.417297 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:27.417322 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:27.424280 (+ 6958us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:27.424937 (+ 657us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:27.424943 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:27.424945 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:27.425044 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:27.425408 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:27.425412 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:27.425414 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:27.425655 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:27.425747 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:27.427064 (+ 1317us) server_negotiation.cc:299] Negotiation successful
0808 14:36:27.427192 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 14:36:27.428149 32683 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.131.252" port: 41095 } has no permanent_uuid. Determining permanent_uuid...
W20260808 14:36:27.428176 32714 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5808aa5e1dfb4cea9003f17eb4a4a1c9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:36:27.428247 32714 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:36:27.430845 32556 raft_consensus.cc:348] T 00000000000000000000000000000000 P d4e5b704ddc5494c89e4e25c898d0955 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5808aa5e1dfb4cea9003f17eb4a4a1c9" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46019 } } peers { permanent_uuid: "d4e5b704ddc5494c89e4e25c898d0955" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36531 } } peers { permanent_uuid: "6915d02611134f4283b806279a5202e1" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 41095 } }
I20260808 14:36:27.431061 32556 raft_consensus.cc:374] T 00000000000000000000000000000000 P d4e5b704ddc5494c89e4e25c898d0955 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:36:27.431114 32556 raft_consensus.cc:729] T 00000000000000000000000000000000 P d4e5b704ddc5494c89e4e25c898d0955 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4e5b704ddc5494c89e4e25c898d0955, State: Initialized, Role: FOLLOWER
I20260808 14:36:27.431620 32556 consensus_queue.cc:260] T 00000000000000000000000000000000 P d4e5b704ddc5494c89e4e25c898d0955 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5808aa5e1dfb4cea9003f17eb4a4a1c9" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46019 } } peers { permanent_uuid: "d4e5b704ddc5494c89e4e25c898d0955" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36531 } } peers { permanent_uuid: "6915d02611134f4283b806279a5202e1" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 41095 } }
Aug 08 14:36:27 dist-test-slave-twwt krb5kdc[32314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199786, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:36:27.428251 32333 master_runner.cc:186] Error getting master registration for 127.11.131.253:36531: OK, instance_id { permanent_uuid: "d4e5b704ddc5494c89e4e25c898d0955" instance_seqno: 1786199787147360 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 14:36:27.432410 32333 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 14:36:27.433063 32556 sys_catalog.cc:564] T 00000000000000000000000000000000 P d4e5b704ddc5494c89e4e25c898d0955 [sys.catalog]: configured and running, proceeding with master startup.
Aug 08 14:36:27 dist-test-slave-twwt krb5kdc[32314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199787, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.252@KRBTEST.COM for kudu/127.11.131.252@KRBTEST.COM
W20260808 14:36:27.439880 32734 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d4e5b704ddc5494c89e4e25c898d0955: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:36:27.439968 32734 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:36:27.440281 32691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:27.428674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.252:41095 (local address 127.0.0.1:58892)
0808 14:36:27.428818 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:27.428834 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:27.428913 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:27.429163 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:27.429166 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:27.429344 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:27.429444 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:27.429450 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.430491 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.430495 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:27.431275 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:27.431287 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.432856 (+ 1569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.432859 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:27.432931 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:27.433790 (+ 859us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:27.433811 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:27.435543 (+ 1732us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:27.438666 (+ 3123us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:27.438669 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:27.438671 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:27.438901 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:27.439172 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:27.439174 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:27.439176 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:27.439255 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:27.439691 (+ 436us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:27.439693 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:27.439771 (+ 78us) client_negotiation.cc:769] Sending connection context
0808 14:36:27.439856 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 14:36:27.440100 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 14:36:27.441068 32690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:27.428801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58892 (local address 127.11.131.252:41095)
0808 14:36:27.428897 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:27.428901 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:27.428916 (+ 15us) server_negotiation.cc:407] Connection header received
0808 14:36:27.429003 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:27.429006 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:27.429047 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:27.429129 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:27.429583 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.430370 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.432205 (+ 1835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.432623 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.432747 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:27.435687 (+ 2940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:27.435690 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:27.435692 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:27.435714 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:27.438526 (+ 2812us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:27.439004 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:27.439007 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:27.439009 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:27.439082 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:27.439366 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:27.439368 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:27.439370 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:27.439570 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:27.439658 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:27.440819 (+ 1161us) server_negotiation.cc:299] Negotiation successful
0808 14:36:27.440939 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 14:36:27.441803 32717 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4e5b704ddc5494c89e4e25c898d0955 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5808aa5e1dfb4cea9003f17eb4a4a1c9" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46019 } } peers { permanent_uuid: "d4e5b704ddc5494c89e4e25c898d0955" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36531 } } peers { permanent_uuid: "6915d02611134f4283b806279a5202e1" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 41095 } } }
I20260808 14:36:27.441931 32717 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4e5b704ddc5494c89e4e25c898d0955 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:36:27.444594 32683 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6915d02611134f4283b806279a5202e1: Bootstrap starting.
I20260808 14:36:27.442423 32450 master_runner.cc:186] Error getting master registration for 127.11.131.252:41095: OK, instance_id { permanent_uuid: "6915d02611134f4283b806279a5202e1" instance_seqno: 1786199787373837 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 14:36:27.446107 32450 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 14:36:27.447091 32439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:27.409109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54942 (local address 127.11.131.254:46019)
0808 14:36:27.409229 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:27.409235 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:27.409251 (+ 16us) server_negotiation.cc:407] Connection header received
0808 14:36:27.409288 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:27.409291 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:27.409330 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:27.409407 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:27.410301 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.411059 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.414106 (+ 3047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.414450 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.414531 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:27.433780 (+ 19249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:27.433785 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:27.433788 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:27.433835 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:27.435635 (+ 1800us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:27.436599 (+ 964us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:27.436614 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:27.436616 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:27.436749 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:27.437173 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:27.437177 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:27.437179 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:27.437408 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:27.437599 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:27.446752 (+ 9153us) server_negotiation.cc:299] Negotiation successful
0808 14:36:27.446924 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 14:36:27.447685 32683 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6915d02611134f4283b806279a5202e1: Neither blocks nor log segments found. Creating new log.
I20260808 14:36:27.448670 32683 log.cc:824] T 00000000000000000000000000000000 P 6915d02611134f4283b806279a5202e1: Log is configured to *not* fsync() on all Append() calls
Aug 08 14:36:27 dist-test-slave-twwt krb5kdc[32314](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199786, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.131.253@KRBTEST.COM
I20260808 14:36:27.459689 32561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:27.448865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58736 (local address 127.11.131.253:36531)
0808 14:36:27.448986 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:27.448991 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:27.449197 (+ 206us) server_negotiation.cc:407] Connection header received
0808 14:36:27.449325 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:27.449328 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:27.449391 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:27.449483 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:27.450289 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.451181 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.452279 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.452648 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.452784 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:27.455933 (+ 3149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:27.455938 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:27.455941 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:27.455970 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:27.457748 (+ 1778us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:27.458235 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:27.458239 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:27.458241 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:27.458334 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:27.458673 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:27.458677 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:27.458679 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:27.458925 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:27.459160 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:27.459382 (+ 222us) server_negotiation.cc:299] Negotiation successful
0808 14:36:27.459515 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 14:36:27.461198 32683 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6915d02611134f4283b806279a5202e1: No bootstrap required, opened a new log
I20260808 14:36:27.463479 11791 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:36:27.466910 32683 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6915d02611134f4283b806279a5202e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5808aa5e1dfb4cea9003f17eb4a4a1c9" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46019 } } peers { permanent_uuid: "d4e5b704ddc5494c89e4e25c898d0955" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36531 } } peers { permanent_uuid: "6915d02611134f4283b806279a5202e1" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 41095 } }
I20260808 14:36:27.467331 32683 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6915d02611134f4283b806279a5202e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:36:27.467438 32683 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6915d02611134f4283b806279a5202e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6915d02611134f4283b806279a5202e1, State: Initialized, Role: FOLLOWER
I20260808 14:36:27.468058 32683 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6915d02611134f4283b806279a5202e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5808aa5e1dfb4cea9003f17eb4a4a1c9" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46019 } } peers { permanent_uuid: "d4e5b704ddc5494c89e4e25c898d0955" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36531 } } peers { permanent_uuid: "6915d02611134f4283b806279a5202e1" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 41095 } }
I20260808 14:36:27.469653 32683 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6915d02611134f4283b806279a5202e1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:36:27.477545 32565 master_runner.cc:263] No leader master found from master 6915d02611134f4283b806279a5202e1
I20260808 14:36:27.477615 32565 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260808 14:36:27.481751 32765 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6915d02611134f4283b806279a5202e1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:36:27.484310 32765 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:36:27.484139 32748 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6915d02611134f4283b806279a5202e1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5808aa5e1dfb4cea9003f17eb4a4a1c9" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46019 } } peers { permanent_uuid: "d4e5b704ddc5494c89e4e25c898d0955" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36531 } } peers { permanent_uuid: "6915d02611134f4283b806279a5202e1" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 41095 } } }
I20260808 14:36:27.484572 32748 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6915d02611134f4283b806279a5202e1 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:36:27.491120 32439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:27.465943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54950 (local address 127.11.131.254:46019)
0808 14:36:27.466066 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:27.466071 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:27.467255 (+ 1184us) server_negotiation.cc:407] Connection header received
0808 14:36:27.467517 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:27.467521 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:27.467577 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:27.467629 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:27.470258 (+ 2629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.471123 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.475862 (+ 4739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.476204 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.476280 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:27.483406 (+ 7126us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:27.483413 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:27.483419 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:27.483455 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:27.485235 (+ 1780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:27.489261 (+ 4026us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:27.489265 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:27.489267 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:27.489371 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:27.489677 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:27.489680 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:27.489682 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:27.489904 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:27.490018 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:27.490811 (+ 793us) server_negotiation.cc:299] Negotiation successful
0808 14:36:27.490947 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 14:36:27.496238 32561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:27.466258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58740 (local address 127.11.131.253:36531)
0808 14:36:27.466361 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:27.466365 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:27.468811 (+ 2446us) server_negotiation.cc:407] Connection header received
0808 14:36:27.469214 (+ 403us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:27.469218 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:27.469268 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:27.469317 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:27.473696 (+ 4379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.474467 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.479915 (+ 5448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.480289 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.480373 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:27.486863 (+ 6490us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:27.486867 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:27.486870 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:27.486899 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:27.488772 (+ 1873us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:27.490318 (+ 1546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:27.490322 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:27.490324 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:27.490424 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:27.492718 (+ 2294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:27.492722 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:27.492724 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:27.492952 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:27.493065 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:27.495919 (+ 2854us) server_negotiation.cc:299] Negotiation successful
0808 14:36:27.496053 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 14:36:27.498485 32690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:27.466646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58900 (local address 127.11.131.252:41095)
0808 14:36:27.466762 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:27.466767 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:27.471429 (+ 4662us) server_negotiation.cc:407] Connection header received
0808 14:36:27.472652 (+ 1223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:27.472656 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:27.472725 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:27.472776 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:27.477009 (+ 4233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.477777 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.482315 (+ 4538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:27.482688 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:27.482761 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:27.493182 (+ 10421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:27.493186 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:27.493189 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:27.493217 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:27.495011 (+ 1794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:27.496874 (+ 1863us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:27.496878 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:27.496880 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:27.496984 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:27.497416 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:27.497420 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:27.497422 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:27.497697 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:27.497816 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:27.498194 (+ 378us) server_negotiation.cc:299] Negotiation successful
0808 14:36:27.498324 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 14:36:27.580395 32694 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5808aa5e1dfb4cea9003f17eb4a4a1c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:36:27.580637 32694 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5808aa5e1dfb4cea9003f17eb4a4a1c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5808aa5e1dfb4cea9003f17eb4a4a1c9" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46019 } } peers { permanent_uuid: "d4e5b704ddc5494c89e4e25c898d0955" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36531 } } peers { permanent_uuid: "6915d02611134f4283b806279a5202e1" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 41095 } }
I20260808 14:36:27.581808 32694 leader_election.cc:288] T 00000000000000000000000000000000 P 5808aa5e1dfb4cea9003f17eb4a4a1c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4e5b704ddc5494c89e4e25c898d0955 (127.11.131.253:36531), 6915d02611134f4283b806279a5202e1 (127.11.131.252:41095)
I20260808 14:36:27.582594 32518 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5808aa5e1dfb4cea9003f17eb4a4a1c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e5b704ddc5494c89e4e25c898d0955" is_pre_election: true
I20260808 14:36:27.582988 32518 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d4e5b704ddc5494c89e4e25c898d0955 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5808aa5e1dfb4cea9003f17eb4a4a1c9 in term 0.
I20260808 14:36:27.583572 32359 leader_election.cc:302] T 00000000000000000000000000000000 P 5808aa5e1dfb4cea9003f17eb4a4a1c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5808aa5e1dfb4cea9003f17eb4a4a1c9, d4e5b704ddc5494c89e4e25c898d0955; no voters:
I20260808 14:36:27.584313 32694 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5808aa5e1dfb4cea9003f17eb4a4a1c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:36:27.584414 32694 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5808aa5e1dfb4cea9003f17eb4a4a1c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:36:27.584465 32694 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5808aa5e1dfb4cea9003f17eb4a4a1c9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:36:27.585882 32694 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5808aa5e1dfb4cea9003f17eb4a4a1c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5808aa5e1dfb4cea9003f17eb4a4a1c9" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46019 } } peers { permanent_uuid: "d4e5b704ddc5494c89e4e25c898d0955" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36531 } } peers { permanent_uuid: "6915d02611134f4283b806279a5202e1" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 41095 } }
I20260808 14:36:27.586274 32694 leader_election.cc:288] T 00000000000000000000000000000000 P 5808aa5e1dfb4cea9003f17eb4a4a1c9 [CANDIDATE]: Term 1 election: Requested vote from peers d4e5b704ddc5494c89e4e25c898d0955 (127.11.131.253:36531), 6915d02611134f4283b806279a5202e1 (127.11.131.252:41095)
I20260808 14:36:27.586756 32518 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5808aa5e1dfb4cea9003f17eb4a4a1c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4e5b704ddc5494c89e4e25c898d0955"
I20260808 14:36:27.586925 32518 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d4e5b704ddc5494c89e4e25c898d0955 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:36:27.588307 32518 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d4e5b704ddc5494c89e4e25c898d0955 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5808aa5e1dfb4cea9003f17eb4a4a1c9 in term 1.
I20260808 14:36:27.588671 32359 leader_election.cc:302] T 00000000000000000000000000000000 P 5808aa5e1dfb4cea9003f17eb4a4a1c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5808aa5e1dfb4cea9003f17eb4a4a1c9, d4e5b704ddc5494c89e4e25c898d0955; no voters:
I20260808 14:36:27.590355 32643 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5808aa5e1dfb4cea9003f17eb4a4a1c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6915d02611134f4283b806279a5202e1" is_pre_election: true
I20260808 14:36:27.590785 32643 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6915d02611134f4283b806279a5202e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5808aa5e1dfb4cea9003f17eb4a4a1c9 in term 0.
I20260808 14:36:27.591496 32642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5808aa5e1dfb4cea9003f17eb4a4a1c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6915d02611134f4283b806279a5202e1"
I20260808 14:36:27.591640 32642 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6915d02611134f4283b806279a5202e1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:36:27.593094 32642 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6915d02611134f4283b806279a5202e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5808aa5e1dfb4cea9003f17eb4a4a1c9 in term 1.
I20260808 14:36:27.594077 32694 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5808aa5e1dfb4cea9003f17eb4a4a1c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:36:27.594388 32694 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5808aa5e1dfb4cea9003f17eb4a4a1c9 [term 1 LEADER]: Becoming Leader. State: Replica: 5808aa5e1dfb4cea9003f17eb4a4a1c9, State: Running, Role: LEADER
I20260808 14:36:27.594833 32694 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5808aa5e1dfb4cea9003f17eb4a4a1c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5808aa5e1dfb4cea9003f17eb4a4a1c9" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46019 } } peers { permanent_uuid: "d4e5b704ddc5494c89e4e25c898d0955" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36531 } } peers { permanent_uuid: "6915d02611134f4283b806279a5202e1" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 41095 } }
I20260808 14:36:27.597261 32694 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5808aa5e1dfb4cea9003f17eb4a4a1c9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5808aa5e1dfb4cea9003f17eb4a4a1c9. Latest consensus state: current_term: 1 leader_uuid: "5808aa5e1dfb4cea9003f17eb4a4a1c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5808aa5e1dfb4cea9003f17eb4a4a1c9" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46019 } } peers { permanent_uuid: "d4e5b704ddc5494c89e4e25c898d0955" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36531 } } peers { permanent_uuid: "6915d02611134f4283b806279a5202e1" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 41095 } } }
I20260808 14:36:27.597401 32694 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5808aa5e1dfb4cea9003f17eb4a4a1c9 [sys.catalog]: This master's current role is: LEADER
I20260808 14:36:27.597872 305 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:36:27.598991 305 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:36:27.609058 32642 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6915d02611134f4283b806279a5202e1 [term 1 FOLLOWER]: Refusing update from remote peer 5808aa5e1dfb4cea9003f17eb4a4a1c9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:36:27.609743 300 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5808aa5e1dfb4cea9003f17eb4a4a1c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6915d02611134f4283b806279a5202e1" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 41095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:36:27.614224 32748 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6915d02611134f4283b806279a5202e1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5808aa5e1dfb4cea9003f17eb4a4a1c9. Latest consensus state: current_term: 1 leader_uuid: "5808aa5e1dfb4cea9003f17eb4a4a1c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5808aa5e1dfb4cea9003f17eb4a4a1c9" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46019 } } peers { permanent_uuid: "d4e5b704ddc5494c89e4e25c898d0955" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36531 } } peers { permanent_uuid: "6915d02611134f4283b806279a5202e1" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 41095 } } }
I20260808 14:36:27.614373 32748 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6915d02611134f4283b806279a5202e1 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:36:27.614755 32518 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d4e5b704ddc5494c89e4e25c898d0955 [term 1 FOLLOWER]: Refusing update from remote peer 5808aa5e1dfb4cea9003f17eb4a4a1c9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:36:27.615388 300 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5808aa5e1dfb4cea9003f17eb4a4a1c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4e5b704ddc5494c89e4e25c898d0955" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 14:36:27.619820 32599 tablet.cc:2369] T 00000000000000000000000000000000 P 6915d02611134f4283b806279a5202e1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:36:27.622586 32717 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4e5b704ddc5494c89e4e25c898d0955 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5808aa5e1dfb4cea9003f17eb4a4a1c9. Latest consensus state: current_term: 1 leader_uuid: "5808aa5e1dfb4cea9003f17eb4a4a1c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5808aa5e1dfb4cea9003f17eb4a4a1c9" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46019 } } peers { permanent_uuid: "d4e5b704ddc5494c89e4e25c898d0955" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36531 } } peers { permanent_uuid: "6915d02611134f4283b806279a5202e1" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 41095 } } }
I20260808 14:36:27.622732 32717 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4e5b704ddc5494c89e4e25c898d0955 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:36:27.628021 300 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5808aa5e1dfb4cea9003f17eb4a4a1c9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5808aa5e1dfb4cea9003f17eb4a4a1c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5808aa5e1dfb4cea9003f17eb4a4a1c9" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46019 } } peers { permanent_uuid: "d4e5b704ddc5494c89e4e25c898d0955" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36531 } } peers { permanent_uuid: "6915d02611134f4283b806279a5202e1" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 41095 } } }
I20260808 14:36:27.628199 300 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5808aa5e1dfb4cea9003f17eb4a4a1c9 [sys.catalog]: This master's current role is: LEADER
I20260808 14:36:27.629449 32748 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6915d02611134f4283b806279a5202e1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5808aa5e1dfb4cea9003f17eb4a4a1c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5808aa5e1dfb4cea9003f17eb4a4a1c9" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46019 } } peers { permanent_uuid: "d4e5b704ddc5494c89e4e25c898d0955" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36531 } } peers { permanent_uuid: "6915d02611134f4283b806279a5202e1" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 41095 } } }
I20260808 14:36:27.629585 32748 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6915d02611134f4283b806279a5202e1 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:36:27.629990 308 mvcc.cc:205] Tried to move back new op lower bound from 7316274330027769856 to 7316274329993695232. Current Snapshot: MvccSnapshot[applied={T|T < 7316274330027769856}]
I20260808 14:36:27.632345 309 mvcc.cc:205] Tried to move back new op lower bound from 7316274330027769856 to 7316274329993695232. Current Snapshot: MvccSnapshot[applied={T|T < 7316274330027769856}]
I20260808 14:36:27.634090 32694 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5808aa5e1dfb4cea9003f17eb4a4a1c9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5808aa5e1dfb4cea9003f17eb4a4a1c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5808aa5e1dfb4cea9003f17eb4a4a1c9" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46019 } } peers { permanent_uuid: "d4e5b704ddc5494c89e4e25c898d0955" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36531 } } peers { permanent_uuid: "6915d02611134f4283b806279a5202e1" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 41095 } } }
I20260808 14:36:27.634258 32694 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5808aa5e1dfb4cea9003f17eb4a4a1c9 [sys.catalog]: This master's current role is: LEADER
I20260808 14:36:27.635581 32717 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4e5b704ddc5494c89e4e25c898d0955 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5808aa5e1dfb4cea9003f17eb4a4a1c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5808aa5e1dfb4cea9003f17eb4a4a1c9" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46019 } } peers { permanent_uuid: "d4e5b704ddc5494c89e4e25c898d0955" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 36531 } } peers { permanent_uuid: "6915d02611134f4283b806279a5202e1" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 41095 } } }
I20260808 14:36:27.635744 32717 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4e5b704ddc5494c89e4e25c898d0955 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:36:27.638824 311 mvcc.cc:205] Tried to move back new op lower bound from 7316274330027769856 to 7316274329993695232. Current Snapshot: MvccSnapshot[applied={T|T < 7316274330027769856}]
I20260808 14:36:27.639708 305 catalog_manager.cc:1347] Generated new cluster ID: 6fc6c76e620f46c08c9023cb964dc085
I20260808 14:36:27.639780 305 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:36:27.671739 305 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:36:27.672971 305 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:36:27.679608 305 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5808aa5e1dfb4cea9003f17eb4a4a1c9: Generated new TSK 0
I20260808 14:36:27.680546 305 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:36:28.441491 32734 catalog_manager.cc:1259] Loaded cluster ID: 6fc6c76e620f46c08c9023cb964dc085
I20260808 14:36:28.441612 32734 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d4e5b704ddc5494c89e4e25c898d0955: loading cluster ID for follower catalog manager: success
I20260808 14:36:28.443369 32734 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d4e5b704ddc5494c89e4e25c898d0955: acquiring CA information for follower catalog manager: success
I20260808 14:36:28.444597 32734 catalog_manager.cc:1602] T 00000000000000000000000000000000 P d4e5b704ddc5494c89e4e25c898d0955: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 14:36:28.486116 32765 catalog_manager.cc:1259] Loaded cluster ID: 6fc6c76e620f46c08c9023cb964dc085
I20260808 14:36:28.486224 32765 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 6915d02611134f4283b806279a5202e1: loading cluster ID for follower catalog manager: success
I20260808 14:36:28.488168 32765 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 6915d02611134f4283b806279a5202e1: acquiring CA information for follower catalog manager: success
I20260808 14:36:28.489517 32765 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 6915d02611134f4283b806279a5202e1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 14:36:28.741504 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 32333
I20260808 14:36:28.756420 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 32450
I20260808 14:36:28.769747 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 32565
2026-08-08T14:36:28Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3448 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786199615258783-11791-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:36:28 dist-test-slave-twwt krb5kdc[336](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:36:28 dist-test-slave-twwt krb5kdc[336](info): set up 2 sockets
Aug 08 14:36:28 dist-test-slave-twwt krb5kdc[336](info): commencing operation
krb5kdc: starting...
W20260808 14:36:30.016161 11791 mini_kdc.cc:121] Time spent starting KDC: real 1.219s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Aug 08 14:36:30 dist-test-slave-twwt krb5kdc[336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199790, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:36:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:36:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.131.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
I20260808 14:36:30.153393 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:46229
--webserver_interface=127.11.131.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:35693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:46229
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:36:30.271489 358 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:30.271788 358 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:30.271862 358 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:30.275920 358 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:36:30.276019 358 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:30.276059 358 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:30.276096 358 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:36:30.276127 358 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:36:30.281762 358 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:35693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786199615258783-11791-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:46229
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:46229
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.131.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.358
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:36:30.282991 358 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:30.284054 358 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:30.293103 365 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:30.293301 358 server_base.cc:1034] running on GCE node
W20260808 14:36:30.293133 364 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:30.293109 367 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:30.294018 358 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:30.295194 358 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:30.296379 358 hybrid_clock.cc:648] HybridClock initialized: now 1786199790296359 us; error 32 us; skew 500 ppm
Aug 08 14:36:30 dist-test-slave-twwt krb5kdc[336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199790, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:30.299171 358 init.cc:377] Logged in from keytab as kudu/127.11.131.254@KRBTEST.COM (short username kudu)
I20260808 14:36:30.300020 358 webserver.cc:460] Webserver started at http://127.11.131.254:46651/ using document root <none> and password file <none>
I20260808 14:36:30.300545 358 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:30.300603 358 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:30.300771 358 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:36:30.302870 358 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786199615258783-11791-0/minicluster-data/master-0/data/instance:
uuid: "66ad43014dc04ed18b3ed57b9c5a9c8e"
format_stamp: "Formatted at 2026-08-08 14:36:30 on dist-test-slave-twwt"
server_key: "1ce9fca55c08d65df5de5c2d4877e4e2"
server_key_iv: "b2559363b757184524b3e9f73a03ca38"
server_key_version: "encryptionkey@0"
I20260808 14:36:30.303406 358 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786199615258783-11791-0/minicluster-data/master-0/wal/instance:
uuid: "66ad43014dc04ed18b3ed57b9c5a9c8e"
format_stamp: "Formatted at 2026-08-08 14:36:30 on dist-test-slave-twwt"
server_key: "1ce9fca55c08d65df5de5c2d4877e4e2"
server_key_iv: "b2559363b757184524b3e9f73a03ca38"
server_key_version: "encryptionkey@0"
I20260808 14:36:30.307080 358 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260808 14:36:30.309368 377 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:30.310552 358 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 14:36:30.310719 358 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "66ad43014dc04ed18b3ed57b9c5a9c8e"
format_stamp: "Formatted at 2026-08-08 14:36:30 on dist-test-slave-twwt"
server_key: "1ce9fca55c08d65df5de5c2d4877e4e2"
server_key_iv: "b2559363b757184524b3e9f73a03ca38"
server_key_version: "encryptionkey@0"
I20260808 14:36:30.310839 358 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:30.334666 358 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:30.337729 358 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:30.337965 358 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:30.345587 358 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.254:46229
I20260808 14:36:30.345638 454 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.254:46229 every 8 connection(s)
I20260808 14:36:30.346642 358 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:36:30.349792 455 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:36:30.350884 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 358
I20260808 14:36:30.351039 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786199615258783-11791-0/minicluster-data/master-0/wal/instance
I20260808 14:36:30.351454 11791 external_mini_cluster.cc:1428] Setting key 36c3d68f7622fc77dff47607625dcec8
I20260808 14:36:30.357017 455 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66ad43014dc04ed18b3ed57b9c5a9c8e: Bootstrap starting.
I20260808 14:36:30.359709 455 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 66ad43014dc04ed18b3ed57b9c5a9c8e: Neither blocks nor log segments found. Creating new log.
I20260808 14:36:30.360519 455 log.cc:824] T 00000000000000000000000000000000 P 66ad43014dc04ed18b3ed57b9c5a9c8e: Log is configured to *not* fsync() on all Append() calls
Aug 08 14:36:30 dist-test-slave-twwt krb5kdc[336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199790, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:36:30.363312 455 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66ad43014dc04ed18b3ed57b9c5a9c8e: No bootstrap required, opened a new log
I20260808 14:36:30.367206 459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:30.353031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38720 (local address 127.11.131.254:46229)
0808 14:36:30.353551 (+ 520us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:30.353566 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:30.353604 (+ 38us) server_negotiation.cc:407] Connection header received
0808 14:36:30.354355 (+ 751us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:30.354375 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:30.354808 (+ 433us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:30.355161 (+ 353us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:30.355986 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:30.356971 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:30.357877 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:30.358394 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:30.358578 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:30.361419 (+ 2841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:30.361449 (+ 30us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:30.361471 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:30.361504 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:30.363778 (+ 2274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:30.364216 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:30.364223 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:30.364230 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:30.364387 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:30.364666 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:30.364669 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:30.364671 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:30.365243 (+ 572us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:30.365464 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:30.365723 (+ 259us) server_negotiation.cc:299] Negotiation successful
0808 14:36:30.366103 (+ 380us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":362,"thread_start_us":174,"threads_started":1}
I20260808 14:36:30.368559 455 raft_consensus.cc:348] T 00000000000000000000000000000000 P 66ad43014dc04ed18b3ed57b9c5a9c8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66ad43014dc04ed18b3ed57b9c5a9c8e" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46229 } }
I20260808 14:36:30.368854 455 raft_consensus.cc:374] T 00000000000000000000000000000000 P 66ad43014dc04ed18b3ed57b9c5a9c8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:36:30.368932 455 raft_consensus.cc:729] T 00000000000000000000000000000000 P 66ad43014dc04ed18b3ed57b9c5a9c8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66ad43014dc04ed18b3ed57b9c5a9c8e, State: Initialized, Role: FOLLOWER
I20260808 14:36:30.369486 455 consensus_queue.cc:260] T 00000000000000000000000000000000 P 66ad43014dc04ed18b3ed57b9c5a9c8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66ad43014dc04ed18b3ed57b9c5a9c8e" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46229 } }
I20260808 14:36:30.369688 455 raft_consensus.cc:388] T 00000000000000000000000000000000 P 66ad43014dc04ed18b3ed57b9c5a9c8e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:36:30.369771 455 raft_consensus.cc:482] T 00000000000000000000000000000000 P 66ad43014dc04ed18b3ed57b9c5a9c8e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:36:30.369891 455 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 66ad43014dc04ed18b3ed57b9c5a9c8e [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:36:30.370412 11791 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:36:30.371086 455 raft_consensus.cc:504] T 00000000000000000000000000000000 P 66ad43014dc04ed18b3ed57b9c5a9c8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66ad43014dc04ed18b3ed57b9c5a9c8e" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46229 } }
I20260808 14:36:30.371519 455 leader_election.cc:302] T 00000000000000000000000000000000 P 66ad43014dc04ed18b3ed57b9c5a9c8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66ad43014dc04ed18b3ed57b9c5a9c8e; no voters:
I20260808 14:36:30.371956 455 leader_election.cc:288] T 00000000000000000000000000000000 P 66ad43014dc04ed18b3ed57b9c5a9c8e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:36:30.372035 462 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 66ad43014dc04ed18b3ed57b9c5a9c8e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:36:30.372289 462 raft_consensus.cc:686] T 00000000000000000000000000000000 P 66ad43014dc04ed18b3ed57b9c5a9c8e [term 1 LEADER]: Becoming Leader. State: Replica: 66ad43014dc04ed18b3ed57b9c5a9c8e, State: Running, Role: LEADER
I20260808 14:36:30.372663 462 consensus_queue.cc:237] T 00000000000000000000000000000000 P 66ad43014dc04ed18b3ed57b9c5a9c8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66ad43014dc04ed18b3ed57b9c5a9c8e" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46229 } }
I20260808 14:36:30.373389 455 sys_catalog.cc:564] T 00000000000000000000000000000000 P 66ad43014dc04ed18b3ed57b9c5a9c8e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:36:30.374559 463 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66ad43014dc04ed18b3ed57b9c5a9c8e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 66ad43014dc04ed18b3ed57b9c5a9c8e. Latest consensus state: current_term: 1 leader_uuid: "66ad43014dc04ed18b3ed57b9c5a9c8e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66ad43014dc04ed18b3ed57b9c5a9c8e" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46229 } } }
I20260808 14:36:30.374557 465 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66ad43014dc04ed18b3ed57b9c5a9c8e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "66ad43014dc04ed18b3ed57b9c5a9c8e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66ad43014dc04ed18b3ed57b9c5a9c8e" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46229 } } }
I20260808 14:36:30.374743 463 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66ad43014dc04ed18b3ed57b9c5a9c8e [sys.catalog]: This master's current role is: LEADER
I20260808 14:36:30.374747 465 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66ad43014dc04ed18b3ed57b9c5a9c8e [sys.catalog]: This master's current role is: LEADER
I20260808 14:36:30.375588 475 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:36:30.378475 475 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:36:30.384594 475 catalog_manager.cc:1347] Generated new cluster ID: 748bee77525f4934836d3ed0a0b9306d
I20260808 14:36:30.384666 475 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:36:30.398625 475 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:36:30.399957 475 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:36:30.406545 475 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 66ad43014dc04ed18b3ed57b9c5a9c8e: Generated new TSK 0
I20260808 14:36:30.407404 475 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:36:30.427224 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 358
2026-08-08T14:36:30Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1658 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:36:30 dist-test-slave-twwt krb5kdc[492](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:36:30 dist-test-slave-twwt krb5kdc[492](info): set up 2 sockets
Aug 08 14:36:30 dist-test-slave-twwt krb5kdc[492](info): commencing operation
krb5kdc: starting...
W20260808 14:36:31.777012 11791 mini_kdc.cc:121] Time spent starting KDC: real 1.321s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Aug 08 14:36:31 dist-test-slave-twwt krb5kdc[492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199791, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:36:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:36:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.131.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
I20260808 14:36:31.909477 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:44663
--webserver_interface=127.11.131.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:33213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:44663
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:36:32.029917 517 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:32.030268 517 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:32.030355 517 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:32.034489 517 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:36:32.034610 517 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:32.034685 517 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:32.034725 517 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:36:32.034765 517 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:36:32.040663 517 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:33213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:44663
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:44663
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.131.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.517
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:36:32.041965 517 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:32.043149 517 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:32.052253 526 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:32.052313 528 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:32.052275 525 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:32.052591 517 server_base.cc:1034] running on GCE node
I20260808 14:36:32.053258 517 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:32.054415 517 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:32.055627 517 hybrid_clock.cc:648] HybridClock initialized: now 1786199792055613 us; error 34 us; skew 500 ppm
Aug 08 14:36:32 dist-test-slave-twwt krb5kdc[492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199792, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:32.063138 517 init.cc:377] Logged in from keytab as kudu/127.11.131.254@KRBTEST.COM (short username kudu)
I20260808 14:36:32.064214 517 webserver.cc:460] Webserver started at http://127.11.131.254:33201/ using document root <none> and password file <none>
I20260808 14:36:32.064833 517 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:32.064930 517 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:32.065174 517 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:36:32.067502 517 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/master-0/data/instance:
uuid: "c25cfea087da4be89ca4a19a61663646"
format_stamp: "Formatted at 2026-08-08 14:36:32 on dist-test-slave-twwt"
server_key: "34ad92ccfe1ca2873173d6febc904798"
server_key_iv: "82afe1da871b47d68dfc13a8b42ab91c"
server_key_version: "encryptionkey@0"
I20260808 14:36:32.068095 517 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/master-0/wal/instance:
uuid: "c25cfea087da4be89ca4a19a61663646"
format_stamp: "Formatted at 2026-08-08 14:36:32 on dist-test-slave-twwt"
server_key: "34ad92ccfe1ca2873173d6febc904798"
server_key_iv: "82afe1da871b47d68dfc13a8b42ab91c"
server_key_version: "encryptionkey@0"
I20260808 14:36:32.071900 517 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 14:36:32.074445 539 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:32.075774 517 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 14:36:32.075927 517 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "c25cfea087da4be89ca4a19a61663646"
format_stamp: "Formatted at 2026-08-08 14:36:32 on dist-test-slave-twwt"
server_key: "34ad92ccfe1ca2873173d6febc904798"
server_key_iv: "82afe1da871b47d68dfc13a8b42ab91c"
server_key_version: "encryptionkey@0"
I20260808 14:36:32.076046 517 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:32.093041 517 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:32.096246 517 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:32.096481 517 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:32.104537 517 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.254:44663
I20260808 14:36:32.104862 631 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.254:44663 every 8 connection(s)
I20260808 14:36:32.105723 517 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:36:32.107100 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 517
I20260808 14:36:32.107241 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/master-0/wal/instance
I20260808 14:36:32.107568 11791 external_mini_cluster.cc:1428] Setting key 1e87b8e6d43688ad1b59fcd496ba6db2
I20260808 14:36:32.109104 633 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:36:32.116153 633 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646: Bootstrap starting.
Aug 08 14:36:32 dist-test-slave-twwt krb5kdc[492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199791, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:36:32.118830 633 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646: Neither blocks nor log segments found. Creating new log.
I20260808 14:36:32.119827 633 log.cc:824] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646: Log is configured to *not* fsync() on all Append() calls
I20260808 14:36:32.121822 633 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646: No bootstrap required, opened a new log
I20260808 14:36:32.123546 637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:32.109096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53362 (local address 127.11.131.254:44663)
0808 14:36:32.109619 (+ 523us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:32.109639 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:32.109683 (+ 44us) server_negotiation.cc:407] Connection header received
0808 14:36:32.110536 (+ 853us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:32.110558 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:32.111012 (+ 454us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:32.111390 (+ 378us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:32.112163 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:32.113702 (+ 1539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:32.114601 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:32.115345 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:32.115522 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:32.118388 (+ 2866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:32.118394 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:32.118418 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:32.118450 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:32.120474 (+ 2024us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:32.120931 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:32.120943 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:32.120948 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:32.121059 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:32.121354 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:32.121358 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:32.121360 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:32.121767 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:32.121964 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:32.122297 (+ 333us) server_negotiation.cc:299] Negotiation successful
0808 14:36:32.122589 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":372,"thread_start_us":149,"threads_started":1}
I20260808 14:36:32.125276 633 raft_consensus.cc:348] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c25cfea087da4be89ca4a19a61663646" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 44663 } }
I20260808 14:36:32.125576 633 raft_consensus.cc:374] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:36:32.125711 633 raft_consensus.cc:729] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c25cfea087da4be89ca4a19a61663646, State: Initialized, Role: FOLLOWER
I20260808 14:36:32.126156 633 consensus_queue.cc:260] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c25cfea087da4be89ca4a19a61663646" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 44663 } }
I20260808 14:36:32.126286 633 raft_consensus.cc:388] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:36:32.126406 633 raft_consensus.cc:482] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:36:32.126533 633 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:36:32.127723 633 raft_consensus.cc:504] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c25cfea087da4be89ca4a19a61663646" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 44663 } }
I20260808 14:36:32.128077 633 leader_election.cc:302] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c25cfea087da4be89ca4a19a61663646; no voters:
I20260808 14:36:32.128361 633 leader_election.cc:288] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:36:32.128512 640 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:36:32.128780 640 raft_consensus.cc:686] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646 [term 1 LEADER]: Becoming Leader. State: Replica: c25cfea087da4be89ca4a19a61663646, State: Running, Role: LEADER
I20260808 14:36:32.129086 640 consensus_queue.cc:237] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c25cfea087da4be89ca4a19a61663646" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 44663 } }
I20260808 14:36:32.129598 633 sys_catalog.cc:564] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:36:32.130944 643 sys_catalog.cc:455] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c25cfea087da4be89ca4a19a61663646. Latest consensus state: current_term: 1 leader_uuid: "c25cfea087da4be89ca4a19a61663646" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c25cfea087da4be89ca4a19a61663646" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 44663 } } }
I20260808 14:36:32.131096 643 sys_catalog.cc:458] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646 [sys.catalog]: This master's current role is: LEADER
I20260808 14:36:32.131420 641 sys_catalog.cc:455] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c25cfea087da4be89ca4a19a61663646" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c25cfea087da4be89ca4a19a61663646" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 44663 } } }
I20260808 14:36:32.131490 659 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:36:32.131603 641 sys_catalog.cc:458] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646 [sys.catalog]: This master's current role is: LEADER
I20260808 14:36:32.134994 659 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:36:32.140795 659 catalog_manager.cc:1347] Generated new cluster ID: aa9b72fb94ad4266bdd488adc338bd5a
I20260808 14:36:32.140923 659 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:36:32.148481 659 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:36:32.149680 659 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:36:32.162638 659 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646: Generated new TSK 0
I20260808 14:36:32.163499 659 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.131.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab.
Entry for principal kudu/127.11.131.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab.
I20260808 14:36:32.202698 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.193:0
--local_ip_for_outbound_sockets=127.11.131.193
--webserver_interface=127.11.131.193
--webserver_port=0
--tserver_master_addrs=127.11.131.254:44663
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab
--principal=kudu/127.11.131.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:33213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:36:32.323280 679 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:32.323572 679 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:32.323618 679 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:32.328047 679 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:32.328115 679 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:32.328229 679 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.193
I20260808 14:36:32.334051 679 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:33213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab
--principal=kudu/127.11.131.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.131.193
--webserver_port=0
--tserver_master_addrs=127.11.131.254:44663
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.679
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.193
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:36:32.335260 679 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:32.336344 679 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:32.346531 692 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:32.346560 694 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:32.346547 690 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:32.346901 679 server_base.cc:1034] running on GCE node
I20260808 14:36:32.347332 679 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:32.348018 679 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:32.351274 679 hybrid_clock.cc:648] HybridClock initialized: now 1786199792351237 us; error 49 us; skew 500 ppm
Aug 08 14:36:32 dist-test-slave-twwt krb5kdc[492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199792, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:32.354024 679 init.cc:377] Logged in from keytab as kudu/127.11.131.193@KRBTEST.COM (short username kudu)
I20260808 14:36:32.354951 679 webserver.cc:460] Webserver started at http://127.11.131.193:40425/ using document root <none> and password file <none>
I20260808 14:36:32.355489 679 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:32.355547 679 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:32.355716 679 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:36:32.357695 679 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-0/data/instance:
uuid: "68477b24ffc048fea013a7ed5d867784"
format_stamp: "Formatted at 2026-08-08 14:36:32 on dist-test-slave-twwt"
server_key: "24d668584e86044003bc6395e69d54f8"
server_key_iv: "7e2955c6b9a22650ad394858e95b114f"
server_key_version: "encryptionkey@0"
I20260808 14:36:32.358201 679 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-0/wal/instance:
uuid: "68477b24ffc048fea013a7ed5d867784"
format_stamp: "Formatted at 2026-08-08 14:36:32 on dist-test-slave-twwt"
server_key: "24d668584e86044003bc6395e69d54f8"
server_key_iv: "7e2955c6b9a22650ad394858e95b114f"
server_key_version: "encryptionkey@0"
I20260808 14:36:32.361946 679 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 14:36:32.364320 701 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:32.365523 679 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 14:36:32.365619 679 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-0/wal
uuid: "68477b24ffc048fea013a7ed5d867784"
format_stamp: "Formatted at 2026-08-08 14:36:32 on dist-test-slave-twwt"
server_key: "24d668584e86044003bc6395e69d54f8"
server_key_iv: "7e2955c6b9a22650ad394858e95b114f"
server_key_version: "encryptionkey@0"
I20260808 14:36:32.365701 679 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:32.398089 679 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:32.402029 679 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:32.402205 679 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:32.402874 679 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:36:32.403735 679 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:36:32.403785 679 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:32.403827 679 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:36:32.403846 679 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:32.413159 679 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.193:45657
I20260808 14:36:32.413187 879 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.193:45657 every 8 connection(s)
I20260808 14:36:32.414077 679 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
I20260808 14:36:32.421234 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 679
I20260808 14:36:32.421355 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-0/wal/instance
I20260808 14:36:32.421700 11791 external_mini_cluster.cc:1428] Setting key 0efc427264ac2e6a299649bfccb77ed2
Aug 08 14:36:32 dist-test-slave-twwt krb5kdc[492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199792, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.193@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:36:32.428929 637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:32.415950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:60839 (local address 127.11.131.254:44663)
0808 14:36:32.416124 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:32.416129 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:32.416965 (+ 836us) server_negotiation.cc:407] Connection header received
0808 14:36:32.418332 (+ 1367us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:32.418334 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:32.418381 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:32.418456 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:32.419716 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:32.420254 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:32.421437 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:32.421749 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:32.421895 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:32.425030 (+ 3135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:32.425038 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:32.425044 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:32.425079 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:32.426598 (+ 1519us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:32.427304 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:32.427307 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:32.427308 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:32.427383 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:32.427787 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:32.427789 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:32.427790 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:32.427964 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:32.428039 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:32.428684 (+ 645us) server_negotiation.cc:299] Negotiation successful
0808 14:36:32.428793 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 14:36:32.430326 883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:32.416341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.193:60839)
0808 14:36:32.416810 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:32.416858 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:32.418139 (+ 1281us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:32.418686 (+ 547us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:32.418693 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:32.419066 (+ 373us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:32.419585 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:32.419599 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:32.420374 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:32.420376 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:32.421318 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:32.421333 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:32.421937 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:32.421942 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:32.422177 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:32.422912 (+ 735us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:32.422934 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:32.424848 (+ 1914us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:32.426762 (+ 1914us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:32.426772 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:32.426791 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:32.427206 (+ 415us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:32.427478 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:32.427483 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:32.427488 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:32.427690 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:32.428073 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:32.428082 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:32.428426 (+ 344us) client_negotiation.cc:769] Sending connection context
0808 14:36:32.428650 (+ 224us) client_negotiation.cc:240] Negotiation successful
0808 14:36:32.429097 (+ 447us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":123,"threads_started":1}
I20260808 14:36:32.433004 880 heartbeater.cc:347] Connected to a master server at 127.11.131.254:44663
I20260808 14:36:32.433454 880 heartbeater.cc:464] Registering TS with master...
I20260808 14:36:32.434144 880 heartbeater.cc:511] Master 127.11.131.254:44663 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.11.131.194@KRBTEST.COM; defaulting to no policy
I20260808 14:36:32.435873 565 ts_manager.cc:194] Registered new tserver with Master: 68477b24ffc048fea013a7ed5d867784 (127.11.131.193:45657)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.194@KRBTEST.COM" created.
I20260808 14:36:32.437248 565 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.193@KRBTEST.COM'} at 127.11.131.193:60839
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab.
Entry for principal kudu/127.11.131.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab.
I20260808 14:36:32.453980 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.194:0
--local_ip_for_outbound_sockets=127.11.131.194
--webserver_interface=127.11.131.194
--webserver_port=0
--tserver_master_addrs=127.11.131.254:44663
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab
--principal=kudu/127.11.131.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:33213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:36:32.575618 886 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:32.575906 886 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:32.575951 886 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:32.580056 886 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:32.580158 886 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:32.580224 886 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.194
I20260808 14:36:32.586103 886 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:33213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab
--principal=kudu/127.11.131.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.131.194
--webserver_port=0
--tserver_master_addrs=127.11.131.254:44663
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.886
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.194
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:36:32.587277 886 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:32.588279 886 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:32.598312 897 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:32.598307 894 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:32.598536 886 server_base.cc:1034] running on GCE node
W20260808 14:36:32.598333 895 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:32.599023 886 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:32.599613 886 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:32.600766 886 hybrid_clock.cc:648] HybridClock initialized: now 1786199792600742 us; error 40 us; skew 500 ppm
Aug 08 14:36:32 dist-test-slave-twwt krb5kdc[492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199792, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:32.603493 886 init.cc:377] Logged in from keytab as kudu/127.11.131.194@KRBTEST.COM (short username kudu)
I20260808 14:36:32.604339 886 webserver.cc:460] Webserver started at http://127.11.131.194:38529/ using document root <none> and password file <none>
I20260808 14:36:32.604918 886 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:32.604980 886 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:32.605240 886 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:36:32.607369 886 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-1/data/instance:
uuid: "6a1af82c382d4ba8a05012ff00525198"
format_stamp: "Formatted at 2026-08-08 14:36:32 on dist-test-slave-twwt"
server_key: "965caff2947b8c4b290930e70cd1901f"
server_key_iv: "dc19d35a2c2978e6eb4828deac8b3e95"
server_key_version: "encryptionkey@0"
I20260808 14:36:32.607936 886 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-1/wal/instance:
uuid: "6a1af82c382d4ba8a05012ff00525198"
format_stamp: "Formatted at 2026-08-08 14:36:32 on dist-test-slave-twwt"
server_key: "965caff2947b8c4b290930e70cd1901f"
server_key_iv: "dc19d35a2c2978e6eb4828deac8b3e95"
server_key_version: "encryptionkey@0"
I20260808 14:36:32.611578 886 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 14:36:32.613998 910 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:32.615242 886 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 14:36:32.615360 886 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-1/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-1/wal
uuid: "6a1af82c382d4ba8a05012ff00525198"
format_stamp: "Formatted at 2026-08-08 14:36:32 on dist-test-slave-twwt"
server_key: "965caff2947b8c4b290930e70cd1901f"
server_key_iv: "dc19d35a2c2978e6eb4828deac8b3e95"
server_key_version: "encryptionkey@0"
I20260808 14:36:32.615460 886 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:32.627676 886 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:32.630766 886 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:32.630987 886 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:32.631527 886 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:36:32.632496 886 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:36:32.632553 886 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:32.632594 886 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:36:32.632609 886 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:32.642027 886 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.194:44343
I20260808 14:36:32.642061 1086 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.194:44343 every 8 connection(s)
I20260808 14:36:32.643070 886 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
Aug 08 14:36:32 dist-test-slave-twwt krb5kdc[492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199792, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.194@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:36:32.652520 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 886
I20260808 14:36:32.652657 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-1/wal/instance
I20260808 14:36:32.652980 11791 external_mini_cluster.cc:1428] Setting key bc7685d8be51a66103231acd26fbba35
I20260808 14:36:32.657377 637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:32.644919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:55935 (local address 127.11.131.254:44663)
0808 14:36:32.645081 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:32.645086 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:32.646048 (+ 962us) server_negotiation.cc:407] Connection header received
0808 14:36:32.647491 (+ 1443us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:32.647494 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:32.647543 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:32.647620 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:32.648772 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:32.649298 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:32.650400 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:32.650655 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:32.650738 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:32.653253 (+ 2515us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:32.653257 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:32.653260 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:32.653289 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:32.654977 (+ 1688us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:32.655484 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:32.655490 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:32.655494 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:32.655591 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:32.656021 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:32.656027 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:32.656031 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:32.656291 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:32.656399 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:32.657058 (+ 659us) server_negotiation.cc:299] Negotiation successful
0808 14:36:32.657192 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 14:36:32.658217 1092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:32.645404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.194:55935)
0808 14:36:32.645874 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:32.645926 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:32.647276 (+ 1350us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:32.647748 (+ 472us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:32.647755 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:32.648147 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:32.648638 (+ 491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:32.648652 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:32.649414 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:32.649417 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:32.650290 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:32.650299 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:32.650791 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:32.650794 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:32.650940 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:32.651484 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:32.651500 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:32.653080 (+ 1580us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:32.655091 (+ 2011us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:32.655096 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:32.655109 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:32.655380 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:32.655698 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:32.655704 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:32.655708 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:32.655917 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:32.656404 (+ 487us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:32.656412 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:32.656728 (+ 316us) client_negotiation.cc:769] Sending connection context
0808 14:36:32.656998 (+ 270us) client_negotiation.cc:240] Negotiation successful
0808 14:36:32.657340 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":127,"threads_started":1}
I20260808 14:36:32.659540 1089 heartbeater.cc:347] Connected to a master server at 127.11.131.254:44663
I20260808 14:36:32.659821 1089 heartbeater.cc:464] Registering TS with master...
I20260808 14:36:32.660477 1089 heartbeater.cc:511] Master 127.11.131.254:44663 requested a full tablet report, sending...
I20260808 14:36:32.661753 565 ts_manager.cc:194] Registered new tserver with Master: 6a1af82c382d4ba8a05012ff00525198 (127.11.131.194:44343)
I20260808 14:36:32.662376 565 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.194@KRBTEST.COM'} at 127.11.131.194:55935
WARNING: no policy specified for kudu/127.11.131.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab.
Entry for principal kudu/127.11.131.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab.
I20260808 14:36:32.685628 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.195:0
--local_ip_for_outbound_sockets=127.11.131.195
--webserver_interface=127.11.131.195
--webserver_port=0
--tserver_master_addrs=127.11.131.254:44663
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab
--principal=kudu/127.11.131.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:33213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:36:32.804524 1096 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:32.804795 1096 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:32.804837 1096 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:32.808882 1096 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:32.808951 1096 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:32.809013 1096 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.195
I20260808 14:36:32.814217 1096 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:33213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab
--principal=kudu/127.11.131.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.131.195
--webserver_port=0
--tserver_master_addrs=127.11.131.254:44663
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1096
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.195
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:36:32.815336 1096 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:32.816335 1096 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:32.826414 1105 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:32.826387 1106 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:32.826393 1108 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:32.826594 1096 server_base.cc:1034] running on GCE node
I20260808 14:36:32.827150 1096 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:32.827913 1096 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:32.829125 1096 hybrid_clock.cc:648] HybridClock initialized: now 1786199792829104 us; error 30 us; skew 500 ppm
Aug 08 14:36:32 dist-test-slave-twwt krb5kdc[492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199792, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:32.832221 1096 init.cc:377] Logged in from keytab as kudu/127.11.131.195@KRBTEST.COM (short username kudu)
I20260808 14:36:32.833211 1096 webserver.cc:460] Webserver started at http://127.11.131.195:36221/ using document root <none> and password file <none>
I20260808 14:36:32.833804 1096 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:32.833909 1096 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:32.834154 1096 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:36:32.836305 1096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-2/data/instance:
uuid: "8dd6aa65308948d3ae52d50a65ac39e0"
format_stamp: "Formatted at 2026-08-08 14:36:32 on dist-test-slave-twwt"
server_key: "067dcadb316b2c9565e7ec9a8459d2ec"
server_key_iv: "8b07a6eab1bd74e1433abf0a8432c13f"
server_key_version: "encryptionkey@0"
I20260808 14:36:32.836892 1096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-2/wal/instance:
uuid: "8dd6aa65308948d3ae52d50a65ac39e0"
format_stamp: "Formatted at 2026-08-08 14:36:32 on dist-test-slave-twwt"
server_key: "067dcadb316b2c9565e7ec9a8459d2ec"
server_key_iv: "8b07a6eab1bd74e1433abf0a8432c13f"
server_key_version: "encryptionkey@0"
I20260808 14:36:32.840957 1096 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 14:36:32.843681 1117 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:32.844967 1096 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260808 14:36:32.845112 1096 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-2/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-2/wal
uuid: "8dd6aa65308948d3ae52d50a65ac39e0"
format_stamp: "Formatted at 2026-08-08 14:36:32 on dist-test-slave-twwt"
server_key: "067dcadb316b2c9565e7ec9a8459d2ec"
server_key_iv: "8b07a6eab1bd74e1433abf0a8432c13f"
server_key_version: "encryptionkey@0"
I20260808 14:36:32.845238 1096 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:32.867877 1096 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:32.871434 1096 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:32.871654 1096 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:32.872318 1096 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:36:32.873245 1096 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:36:32.873319 1096 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:32.873395 1096 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:36:32.873441 1096 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:32.883029 1096 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.195:45449
I20260808 14:36:32.883055 1293 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.195:45449 every 8 connection(s)
I20260808 14:36:32.883946 1096 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
I20260808 14:36:32.888437 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 1096
I20260808 14:36:32.888581 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-2/wal/instance
I20260808 14:36:32.888938 11791 external_mini_cluster.cc:1428] Setting key 2c57e0f11b4106bf4fcdc6b0ae73f8c6
Aug 08 14:36:32 dist-test-slave-twwt krb5kdc[492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199792, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.195@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:36:32.898192 637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:32.885892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:44801 (local address 127.11.131.254:44663)
0808 14:36:32.886072 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:32.886076 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:32.886978 (+ 902us) server_negotiation.cc:407] Connection header received
0808 14:36:32.888519 (+ 1541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:32.888526 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:32.888590 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:32.888673 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:32.890391 (+ 1718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:32.891160 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:32.892288 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:32.892503 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:32.892579 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:32.895101 (+ 2522us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:32.895104 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:32.895106 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:32.895130 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:32.896383 (+ 1253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:32.896864 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:32.896867 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:32.896868 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:32.896940 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:32.897248 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:32.897250 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:32.897251 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:32.897424 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:32.897498 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:32.897975 (+ 477us) server_negotiation.cc:299] Negotiation successful
0808 14:36:32.898074 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 14:36:32.899196 1298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:32.886300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.195:44801)
0808 14:36:32.886823 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:32.886868 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:32.888221 (+ 1353us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:32.888945 (+ 724us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:32.888957 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:32.889477 (+ 520us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:32.890192 (+ 715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:32.890232 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:32.891300 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:32.891303 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:32.892184 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:32.892193 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:32.892632 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:32.892634 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:32.892797 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:32.893428 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:32.893445 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:32.894955 (+ 1510us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:32.896499 (+ 1544us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:32.896504 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:32.896516 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:32.896773 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:32.897022 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:32.897024 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:32.897025 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:32.897159 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:32.897513 (+ 354us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:32.897518 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:32.897744 (+ 226us) client_negotiation.cc:769] Sending connection context
0808 14:36:32.897924 (+ 180us) client_negotiation.cc:240] Negotiation successful
0808 14:36:32.898177 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":132,"threads_started":1}
I20260808 14:36:32.900328 1295 heartbeater.cc:347] Connected to a master server at 127.11.131.254:44663
I20260808 14:36:32.900586 1295 heartbeater.cc:464] Registering TS with master...
I20260808 14:36:32.901106 1295 heartbeater.cc:511] Master 127.11.131.254:44663 requested a full tablet report, sending...
I20260808 14:36:32.902263 565 ts_manager.cc:194] Registered new tserver with Master: 8dd6aa65308948d3ae52d50a65ac39e0 (127.11.131.195:45449)
I20260808 14:36:32.902908 11791 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:36:32.903041 565 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.195@KRBTEST.COM'} at 127.11.131.195:44801
I20260808 14:36:32.911780 637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:32.905170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45860 (local address 127.11.131.254:44663)
0808 14:36:32.905305 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:32.905310 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:32.905473 (+ 163us) server_negotiation.cc:407] Connection header received
0808 14:36:32.905557 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:32.905559 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:32.905596 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:32.905662 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:32.906322 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:32.906879 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:32.907640 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:32.907852 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:32.907928 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:32.909186 (+ 1258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:32.909189 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:32.909191 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:32.909213 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:32.910405 (+ 1192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:32.910837 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:32.910839 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:32.910841 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:32.910913 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:32.911129 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:32.911131 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:32.911132 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:32.911312 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:32.911412 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:32.911586 (+ 174us) server_negotiation.cc:299] Negotiation successful
0808 14:36:32.911672 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 14:36:32.914376 565 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45860:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:36:32.917452 565 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:36:32.932643 1322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:32.927049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35232 (local address 127.11.131.193:45657)
0808 14:36:32.927401 (+ 352us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:32.927416 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:32.927433 (+ 17us) server_negotiation.cc:407] Connection header received
0808 14:36:32.927499 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:32.927503 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:32.927645 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:32.927832 (+ 187us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:36:32.928389 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:32.929457 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:32.931300 (+ 1843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:32.931856 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:32.931996 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:32.932141 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:32.932388 (+ 247us) server_negotiation.cc:299] Negotiation successful
0808 14:36:32.932487 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":246,"thread_start_us":140,"threads_started":1}
I20260808 14:36:32.932631 1312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:32.925966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.194:44343 (local address 127.0.0.1:38332)
0808 14:36:32.926343 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:32.926394 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:32.926532 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:32.927805 (+ 1273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:32.927811 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:32.927835 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:36:32.927991 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:32.928001 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:32.929524 (+ 1523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:32.929528 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:32.931119 (+ 1591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:32.931134 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:32.932206 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:32.932213 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:32.932304 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:32.932331 (+ 27us) client_negotiation.cc:769] Sending connection context
0808 14:36:32.932382 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 14:36:32.932466 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197,"mutex_wait_us":37,"thread_start_us":79,"threads_started":1}
I20260808 14:36:32.932650 1321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:32.926882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:45657 (local address 127.0.0.1:35232)
0808 14:36:32.927221 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:32.927236 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:32.927321 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:32.928012 (+ 691us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:32.928015 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:32.928047 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:36:32.928254 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:32.928262 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:32.929730 (+ 1468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:32.929734 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:32.931139 (+ 1405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:32.931146 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:32.931986 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:32.931989 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:32.932146 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:32.932202 (+ 56us) client_negotiation.cc:769] Sending connection context
0808 14:36:32.932338 (+ 136us) client_negotiation.cc:240] Negotiation successful
0808 14:36:32.932466 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"mutex_wait_us":212,"spinlock_wait_cycles":5632,"thread_start_us":112,"threads_started":1}
I20260808 14:36:32.933903 1319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:32.925966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.195:45449 (local address 127.0.0.1:36696)
0808 14:36:32.926850 (+ 884us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:32.926865 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:32.926966 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:32.928014 (+ 1048us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:32.928016 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:32.928048 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:36:32.928255 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:32.928262 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:32.930979 (+ 2717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:32.930982 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:32.932150 (+ 1168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:32.932163 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:32.933528 (+ 1365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:32.933532 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:32.933614 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:32.933634 (+ 20us) client_negotiation.cc:769] Sending connection context
0808 14:36:32.933696 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 14:36:32.933760 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":820,"mutex_wait_us":544,"spinlock_wait_cycles":13312,"thread_start_us":137,"threads_started":1}
I20260808 14:36:32.933954 1318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:32.926131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36696 (local address 127.11.131.195:45449)
0808 14:36:32.927574 (+ 1443us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:32.927588 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:32.927611 (+ 23us) server_negotiation.cc:407] Connection header received
0808 14:36:32.927688 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:32.927692 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:32.927881 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:32.928050 (+ 169us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:36:32.929532 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:32.930812 (+ 1280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:32.932280 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:32.933396 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:32.933540 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:32.933668 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:32.933733 (+ 65us) server_negotiation.cc:299] Negotiation successful
0808 14:36:32.933819 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1335,"thread_start_us":191,"threads_started":1}
I20260808 14:36:32.934293 1320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:32.926833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38332 (local address 127.11.131.194:44343)
0808 14:36:32.927289 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:32.927301 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:32.927329 (+ 28us) server_negotiation.cc:407] Connection header received
0808 14:36:32.927414 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:32.927421 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:32.927630 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:32.927812 (+ 182us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:36:32.928129 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:32.929355 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:32.931250 (+ 1895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:32.932063 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:32.933897 (+ 1834us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:32.934016 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:32.934062 (+ 46us) server_negotiation.cc:299] Negotiation successful
0808 14:36:32.934146 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":332,"thread_start_us":113,"threads_started":1}
I20260808 14:36:32.936141 775 tablet_service.cc:1467] Processing CreateTablet for tablet c44a824abe9d40ffaa43fb9fbb64ef7a (DEFAULT_TABLE table=test-table [id=4a49af05c6614ccb83229a39c5cec6f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:36:32.936614 1188 tablet_service.cc:1467] Processing CreateTablet for tablet c44a824abe9d40ffaa43fb9fbb64ef7a (DEFAULT_TABLE table=test-table [id=4a49af05c6614ccb83229a39c5cec6f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:36:32.936640 988 tablet_service.cc:1467] Processing CreateTablet for tablet c44a824abe9d40ffaa43fb9fbb64ef7a (DEFAULT_TABLE table=test-table [id=4a49af05c6614ccb83229a39c5cec6f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:36:32.937342 775 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c44a824abe9d40ffaa43fb9fbb64ef7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:36:32.937669 1188 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c44a824abe9d40ffaa43fb9fbb64ef7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:36:32.937767 988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c44a824abe9d40ffaa43fb9fbb64ef7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:36:32.944131 1324 tablet_bootstrap.cc:492] T c44a824abe9d40ffaa43fb9fbb64ef7a P 6a1af82c382d4ba8a05012ff00525198: Bootstrap starting.
I20260808 14:36:32.945570 1326 tablet_bootstrap.cc:492] T c44a824abe9d40ffaa43fb9fbb64ef7a P 8dd6aa65308948d3ae52d50a65ac39e0: Bootstrap starting.
I20260808 14:36:32.946897 1325 tablet_bootstrap.cc:492] T c44a824abe9d40ffaa43fb9fbb64ef7a P 68477b24ffc048fea013a7ed5d867784: Bootstrap starting.
I20260808 14:36:32.947073 1324 tablet_bootstrap.cc:654] T c44a824abe9d40ffaa43fb9fbb64ef7a P 6a1af82c382d4ba8a05012ff00525198: Neither blocks nor log segments found. Creating new log.
I20260808 14:36:32.947835 1326 tablet_bootstrap.cc:654] T c44a824abe9d40ffaa43fb9fbb64ef7a P 8dd6aa65308948d3ae52d50a65ac39e0: Neither blocks nor log segments found. Creating new log.
I20260808 14:36:32.948038 1324 log.cc:824] T c44a824abe9d40ffaa43fb9fbb64ef7a P 6a1af82c382d4ba8a05012ff00525198: Log is configured to *not* fsync() on all Append() calls
I20260808 14:36:32.949074 1325 tablet_bootstrap.cc:654] T c44a824abe9d40ffaa43fb9fbb64ef7a P 68477b24ffc048fea013a7ed5d867784: Neither blocks nor log segments found. Creating new log.
I20260808 14:36:32.949059 1326 log.cc:824] T c44a824abe9d40ffaa43fb9fbb64ef7a P 8dd6aa65308948d3ae52d50a65ac39e0: Log is configured to *not* fsync() on all Append() calls
I20260808 14:36:32.949899 1325 log.cc:824] T c44a824abe9d40ffaa43fb9fbb64ef7a P 68477b24ffc048fea013a7ed5d867784: Log is configured to *not* fsync() on all Append() calls
I20260808 14:36:32.950456 1324 tablet_bootstrap.cc:492] T c44a824abe9d40ffaa43fb9fbb64ef7a P 6a1af82c382d4ba8a05012ff00525198: No bootstrap required, opened a new log
I20260808 14:36:32.950701 1324 ts_tablet_manager.cc:1397] T c44a824abe9d40ffaa43fb9fbb64ef7a P 6a1af82c382d4ba8a05012ff00525198: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260808 14:36:32.951164 1326 tablet_bootstrap.cc:492] T c44a824abe9d40ffaa43fb9fbb64ef7a P 8dd6aa65308948d3ae52d50a65ac39e0: No bootstrap required, opened a new log
I20260808 14:36:32.951354 1326 ts_tablet_manager.cc:1397] T c44a824abe9d40ffaa43fb9fbb64ef7a P 8dd6aa65308948d3ae52d50a65ac39e0: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 14:36:32.951825 1325 tablet_bootstrap.cc:492] T c44a824abe9d40ffaa43fb9fbb64ef7a P 68477b24ffc048fea013a7ed5d867784: No bootstrap required, opened a new log
I20260808 14:36:32.951995 1325 ts_tablet_manager.cc:1397] T c44a824abe9d40ffaa43fb9fbb64ef7a P 68477b24ffc048fea013a7ed5d867784: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 14:36:32.953795 1324 raft_consensus.cc:348] T c44a824abe9d40ffaa43fb9fbb64ef7a P 6a1af82c382d4ba8a05012ff00525198 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dd6aa65308948d3ae52d50a65ac39e0" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45449 } } peers { permanent_uuid: "6a1af82c382d4ba8a05012ff00525198" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 44343 } } peers { permanent_uuid: "68477b24ffc048fea013a7ed5d867784" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 45657 } }
I20260808 14:36:32.954047 1324 raft_consensus.cc:374] T c44a824abe9d40ffaa43fb9fbb64ef7a P 6a1af82c382d4ba8a05012ff00525198 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:36:32.954101 1324 raft_consensus.cc:729] T c44a824abe9d40ffaa43fb9fbb64ef7a P 6a1af82c382d4ba8a05012ff00525198 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a1af82c382d4ba8a05012ff00525198, State: Initialized, Role: FOLLOWER
I20260808 14:36:32.954656 1324 consensus_queue.cc:260] T c44a824abe9d40ffaa43fb9fbb64ef7a P 6a1af82c382d4ba8a05012ff00525198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dd6aa65308948d3ae52d50a65ac39e0" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45449 } } peers { permanent_uuid: "6a1af82c382d4ba8a05012ff00525198" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 44343 } } peers { permanent_uuid: "68477b24ffc048fea013a7ed5d867784" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 45657 } }
I20260808 14:36:32.955576 1324 ts_tablet_manager.cc:1428] T c44a824abe9d40ffaa43fb9fbb64ef7a P 6a1af82c382d4ba8a05012ff00525198: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260808 14:36:32.955523 1326 raft_consensus.cc:348] T c44a824abe9d40ffaa43fb9fbb64ef7a P 8dd6aa65308948d3ae52d50a65ac39e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dd6aa65308948d3ae52d50a65ac39e0" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45449 } } peers { permanent_uuid: "6a1af82c382d4ba8a05012ff00525198" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 44343 } } peers { permanent_uuid: "68477b24ffc048fea013a7ed5d867784" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 45657 } }
I20260808 14:36:32.955766 1326 raft_consensus.cc:374] T c44a824abe9d40ffaa43fb9fbb64ef7a P 8dd6aa65308948d3ae52d50a65ac39e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:36:32.955827 1326 raft_consensus.cc:729] T c44a824abe9d40ffaa43fb9fbb64ef7a P 8dd6aa65308948d3ae52d50a65ac39e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dd6aa65308948d3ae52d50a65ac39e0, State: Initialized, Role: FOLLOWER
I20260808 14:36:32.956023 1089 heartbeater.cc:503] Master 127.11.131.254:44663 was elected leader, sending a full tablet report...
I20260808 14:36:32.956275 1326 consensus_queue.cc:260] T c44a824abe9d40ffaa43fb9fbb64ef7a P 8dd6aa65308948d3ae52d50a65ac39e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dd6aa65308948d3ae52d50a65ac39e0" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45449 } } peers { permanent_uuid: "6a1af82c382d4ba8a05012ff00525198" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 44343 } } peers { permanent_uuid: "68477b24ffc048fea013a7ed5d867784" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 45657 } }
I20260808 14:36:32.956306 1325 raft_consensus.cc:348] T c44a824abe9d40ffaa43fb9fbb64ef7a P 68477b24ffc048fea013a7ed5d867784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dd6aa65308948d3ae52d50a65ac39e0" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45449 } } peers { permanent_uuid: "6a1af82c382d4ba8a05012ff00525198" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 44343 } } peers { permanent_uuid: "68477b24ffc048fea013a7ed5d867784" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 45657 } }
I20260808 14:36:32.956557 1325 raft_consensus.cc:374] T c44a824abe9d40ffaa43fb9fbb64ef7a P 68477b24ffc048fea013a7ed5d867784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:36:32.956627 1325 raft_consensus.cc:729] T c44a824abe9d40ffaa43fb9fbb64ef7a P 68477b24ffc048fea013a7ed5d867784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68477b24ffc048fea013a7ed5d867784, State: Initialized, Role: FOLLOWER
I20260808 14:36:32.957027 1325 consensus_queue.cc:260] T c44a824abe9d40ffaa43fb9fbb64ef7a P 68477b24ffc048fea013a7ed5d867784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dd6aa65308948d3ae52d50a65ac39e0" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45449 } } peers { permanent_uuid: "6a1af82c382d4ba8a05012ff00525198" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 44343 } } peers { permanent_uuid: "68477b24ffc048fea013a7ed5d867784" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 45657 } }
I20260808 14:36:32.957247 1326 ts_tablet_manager.cc:1428] T c44a824abe9d40ffaa43fb9fbb64ef7a P 8dd6aa65308948d3ae52d50a65ac39e0: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 14:36:32.957548 1295 heartbeater.cc:503] Master 127.11.131.254:44663 was elected leader, sending a full tablet report...
I20260808 14:36:32.957753 880 heartbeater.cc:503] Master 127.11.131.254:44663 was elected leader, sending a full tablet report...
I20260808 14:36:32.958693 1325 ts_tablet_manager.cc:1428] T c44a824abe9d40ffaa43fb9fbb64ef7a P 68477b24ffc048fea013a7ed5d867784: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260808 14:36:32.959786 1335 raft_consensus.cc:482] T c44a824abe9d40ffaa43fb9fbb64ef7a P 8dd6aa65308948d3ae52d50a65ac39e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:36:32.959959 1335 raft_consensus.cc:504] T c44a824abe9d40ffaa43fb9fbb64ef7a P 8dd6aa65308948d3ae52d50a65ac39e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dd6aa65308948d3ae52d50a65ac39e0" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45449 } } peers { permanent_uuid: "6a1af82c382d4ba8a05012ff00525198" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 44343 } } peers { permanent_uuid: "68477b24ffc048fea013a7ed5d867784" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 45657 } }
I20260808 14:36:32.961318 1335 leader_election.cc:288] T c44a824abe9d40ffaa43fb9fbb64ef7a P 8dd6aa65308948d3ae52d50a65ac39e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a1af82c382d4ba8a05012ff00525198 (127.11.131.194:44343), 68477b24ffc048fea013a7ed5d867784 (127.11.131.193:45657)
I20260808 14:36:32.965096 1298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:32.961510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.194:44343 (local address 127.11.131.195:60527)
0808 14:36:32.961784 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:32.961802 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:32.961892 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:32.962135 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:32.962137 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:32.962150 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:36:32.962246 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:32.962251 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:32.963206 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:32.963210 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:32.964011 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:32.964021 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:32.964675 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:32.964678 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:32.964789 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:32.964808 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 14:36:32.964899 (+ 91us) client_negotiation.cc:240] Negotiation successful
0808 14:36:32.964970 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189}
I20260808 14:36:32.965096 1320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:32.961766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:60527 (local address 127.11.131.194:44343)
0808 14:36:32.961963 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:32.961966 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:32.961977 (+ 11us) server_negotiation.cc:407] Connection header received
0808 14:36:32.962014 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:32.962015 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:32.962049 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:32.962110 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:36:32.962374 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:32.963095 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:32.964143 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:32.964547 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:32.964682 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:32.964733 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:32.964917 (+ 184us) server_negotiation.cc:299] Negotiation successful
0808 14:36:32.964987 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126}
I20260808 14:36:32.965560 1322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:32.961694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:38271 (local address 127.11.131.193:45657)
0808 14:36:32.961809 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:32.961814 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:32.962386 (+ 572us) server_negotiation.cc:407] Connection header received
0808 14:36:32.962509 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:32.962512 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:32.962549 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:32.962670 (+ 121us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:36:32.962940 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:32.963574 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:32.964565 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:32.964977 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:32.965104 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:32.965153 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:32.965381 (+ 228us) server_negotiation.cc:299] Negotiation successful
0808 14:36:32.965467 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 14:36:32.965736 1014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c44a824abe9d40ffaa43fb9fbb64ef7a" candidate_uuid: "8dd6aa65308948d3ae52d50a65ac39e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a1af82c382d4ba8a05012ff00525198" is_pre_election: true
I20260808 14:36:32.965945 1337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:32.961548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:45657 (local address 127.11.131.195:38271)
0808 14:36:32.962297 (+ 749us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:32.962308 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:32.962429 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:32.962683 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:32.962685 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:32.962701 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:36:32.962824 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:32.962829 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:32.963682 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:32.963686 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:32.964442 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:32.964451 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:32.965121 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:32.965125 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:32.965236 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:32.965267 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 14:36:32.965712 (+ 445us) client_negotiation.cc:240] Negotiation successful
0808 14:36:32.965792 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":698,"thread_start_us":96,"threads_started":1}
I20260808 14:36:32.966058 1014 raft_consensus.cc:2454] T c44a824abe9d40ffaa43fb9fbb64ef7a P 6a1af82c382d4ba8a05012ff00525198 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dd6aa65308948d3ae52d50a65ac39e0 in term 0.
I20260808 14:36:32.966493 807 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c44a824abe9d40ffaa43fb9fbb64ef7a" candidate_uuid: "8dd6aa65308948d3ae52d50a65ac39e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68477b24ffc048fea013a7ed5d867784" is_pre_election: true
I20260808 14:36:32.966555 1122 leader_election.cc:302] T c44a824abe9d40ffaa43fb9fbb64ef7a P 8dd6aa65308948d3ae52d50a65ac39e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a1af82c382d4ba8a05012ff00525198, 8dd6aa65308948d3ae52d50a65ac39e0; no voters:
I20260808 14:36:32.966794 807 raft_consensus.cc:2454] T c44a824abe9d40ffaa43fb9fbb64ef7a P 68477b24ffc048fea013a7ed5d867784 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dd6aa65308948d3ae52d50a65ac39e0 in term 0.
I20260808 14:36:32.966845 1335 raft_consensus.cc:2781] T c44a824abe9d40ffaa43fb9fbb64ef7a P 8dd6aa65308948d3ae52d50a65ac39e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:36:32.966943 1335 raft_consensus.cc:482] T c44a824abe9d40ffaa43fb9fbb64ef7a P 8dd6aa65308948d3ae52d50a65ac39e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:36:32.967000 1335 raft_consensus.cc:3037] T c44a824abe9d40ffaa43fb9fbb64ef7a P 8dd6aa65308948d3ae52d50a65ac39e0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:36:32.967967 1335 raft_consensus.cc:504] T c44a824abe9d40ffaa43fb9fbb64ef7a P 8dd6aa65308948d3ae52d50a65ac39e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dd6aa65308948d3ae52d50a65ac39e0" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45449 } } peers { permanent_uuid: "6a1af82c382d4ba8a05012ff00525198" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 44343 } } peers { permanent_uuid: "68477b24ffc048fea013a7ed5d867784" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 45657 } }
I20260808 14:36:32.968292 1335 leader_election.cc:288] T c44a824abe9d40ffaa43fb9fbb64ef7a P 8dd6aa65308948d3ae52d50a65ac39e0 [CANDIDATE]: Term 1 election: Requested vote from peers 6a1af82c382d4ba8a05012ff00525198 (127.11.131.194:44343), 68477b24ffc048fea013a7ed5d867784 (127.11.131.193:45657)
I20260808 14:36:32.968653 1014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c44a824abe9d40ffaa43fb9fbb64ef7a" candidate_uuid: "8dd6aa65308948d3ae52d50a65ac39e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a1af82c382d4ba8a05012ff00525198"
I20260808 14:36:32.968684 807 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c44a824abe9d40ffaa43fb9fbb64ef7a" candidate_uuid: "8dd6aa65308948d3ae52d50a65ac39e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68477b24ffc048fea013a7ed5d867784"
I20260808 14:36:32.968779 807 raft_consensus.cc:3037] T c44a824abe9d40ffaa43fb9fbb64ef7a P 68477b24ffc048fea013a7ed5d867784 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:36:32.968779 1014 raft_consensus.cc:3037] T c44a824abe9d40ffaa43fb9fbb64ef7a P 6a1af82c382d4ba8a05012ff00525198 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:36:32.970073 807 raft_consensus.cc:2454] T c44a824abe9d40ffaa43fb9fbb64ef7a P 68477b24ffc048fea013a7ed5d867784 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dd6aa65308948d3ae52d50a65ac39e0 in term 1.
I20260808 14:36:32.970073 1014 raft_consensus.cc:2454] T c44a824abe9d40ffaa43fb9fbb64ef7a P 6a1af82c382d4ba8a05012ff00525198 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dd6aa65308948d3ae52d50a65ac39e0 in term 1.
I20260808 14:36:32.970342 1122 leader_election.cc:302] T c44a824abe9d40ffaa43fb9fbb64ef7a P 8dd6aa65308948d3ae52d50a65ac39e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a1af82c382d4ba8a05012ff00525198, 8dd6aa65308948d3ae52d50a65ac39e0; no voters:
I20260808 14:36:32.970506 1335 raft_consensus.cc:2781] T c44a824abe9d40ffaa43fb9fbb64ef7a P 8dd6aa65308948d3ae52d50a65ac39e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:36:32.970763 1335 raft_consensus.cc:686] T c44a824abe9d40ffaa43fb9fbb64ef7a P 8dd6aa65308948d3ae52d50a65ac39e0 [term 1 LEADER]: Becoming Leader. State: Replica: 8dd6aa65308948d3ae52d50a65ac39e0, State: Running, Role: LEADER
I20260808 14:36:32.971084 1335 consensus_queue.cc:237] T c44a824abe9d40ffaa43fb9fbb64ef7a P 8dd6aa65308948d3ae52d50a65ac39e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dd6aa65308948d3ae52d50a65ac39e0" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45449 } } peers { permanent_uuid: "6a1af82c382d4ba8a05012ff00525198" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 44343 } } peers { permanent_uuid: "68477b24ffc048fea013a7ed5d867784" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 45657 } }
I20260808 14:36:32.974131 563 catalog_manager.cc:5495] T c44a824abe9d40ffaa43fb9fbb64ef7a P 8dd6aa65308948d3ae52d50a65ac39e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dd6aa65308948d3ae52d50a65ac39e0 (127.11.131.195). New cstate: current_term: 1 leader_uuid: "8dd6aa65308948d3ae52d50a65ac39e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dd6aa65308948d3ae52d50a65ac39e0" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a1af82c382d4ba8a05012ff00525198" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 44343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68477b24ffc048fea013a7ed5d867784" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 45657 } health_report { overall_health: UNKNOWN } } }
I20260808 14:36:32.993989 1318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:32.990737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36698 (local address 127.11.131.195:45449)
0808 14:36:32.990894 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:32.990898 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:32.990912 (+ 14us) server_negotiation.cc:407] Connection header received
0808 14:36:32.991015 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:32.991017 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:32.991071 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:32.991161 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:36:32.991388 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:32.991892 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:32.992690 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:32.992911 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:32.992985 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:32.993258 (+ 273us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:36:32.993670 (+ 412us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:36:32.993761 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:32.993828 (+ 67us) server_negotiation.cc:299] Negotiation successful
0808 14:36:32.993878 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 14:36:32.999766 1014 raft_consensus.cc:1261] T c44a824abe9d40ffaa43fb9fbb64ef7a P 6a1af82c382d4ba8a05012ff00525198 [term 1 FOLLOWER]: Refusing update from remote peer 8dd6aa65308948d3ae52d50a65ac39e0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:36:32.999766 807 raft_consensus.cc:1261] T c44a824abe9d40ffaa43fb9fbb64ef7a P 68477b24ffc048fea013a7ed5d867784 [term 1 FOLLOWER]: Refusing update from remote peer 8dd6aa65308948d3ae52d50a65ac39e0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:36:33.000571 1338 consensus_queue.cc:1035] T c44a824abe9d40ffaa43fb9fbb64ef7a P 8dd6aa65308948d3ae52d50a65ac39e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a1af82c382d4ba8a05012ff00525198" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 44343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:36:33.000766 1335 consensus_queue.cc:1035] T c44a824abe9d40ffaa43fb9fbb64ef7a P 8dd6aa65308948d3ae52d50a65ac39e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68477b24ffc048fea013a7ed5d867784" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 45657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:36:33.009001 1342 mvcc.cc:205] Tried to move back new op lower bound from 7316274352119861248 to 7316274352012369920. Current Snapshot: MvccSnapshot[applied={T|T < 7316274352119861248}]
I20260808 14:36:33.009231 1345 mvcc.cc:205] Tried to move back new op lower bound from 7316274352119861248 to 7316274352012369920. Current Snapshot: MvccSnapshot[applied={T|T < 7316274352119861248}]
I20260808 14:36:33.010329 1344 mvcc.cc:205] Tried to move back new op lower bound from 7316274352119861248 to 7316274352012369920. Current Snapshot: MvccSnapshot[applied={T|T < 7316274352119861248}]
I20260808 14:36:33.017987 563 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45860:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:36:33.018191 563 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45860:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:36:33.020998 563 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646: Sending DeleteTablet for 3 replicas of tablet c44a824abe9d40ffaa43fb9fbb64ef7a
I20260808 14:36:33.021836 1188 tablet_service.cc:1514] Processing DeleteTablet for tablet c44a824abe9d40ffaa43fb9fbb64ef7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:36:33 UTC) from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:36696
I20260808 14:36:33.021972 775 tablet_service.cc:1514] Processing DeleteTablet for tablet c44a824abe9d40ffaa43fb9fbb64ef7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:36:33 UTC) from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:35232
I20260808 14:36:33.022325 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 679
I20260808 14:36:33.022375 988 tablet_service.cc:1514] Processing DeleteTablet for tablet c44a824abe9d40ffaa43fb9fbb64ef7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:36:33 UTC) from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:38332
I20260808 14:36:33.023203 1367 tablet_replica.cc:330] T c44a824abe9d40ffaa43fb9fbb64ef7a P 6a1af82c382d4ba8a05012ff00525198: stopping tablet replica
I20260808 14:36:33.023515 1367 raft_consensus.cc:2229] T c44a824abe9d40ffaa43fb9fbb64ef7a P 6a1af82c382d4ba8a05012ff00525198 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:36:33.023821 1367 raft_consensus.cc:2258] T c44a824abe9d40ffaa43fb9fbb64ef7a P 6a1af82c382d4ba8a05012ff00525198 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:36:33.025790 1360 tablet_replica.cc:330] T c44a824abe9d40ffaa43fb9fbb64ef7a P 8dd6aa65308948d3ae52d50a65ac39e0: stopping tablet replica
I20260808 14:36:33.026108 1360 raft_consensus.cc:2229] T c44a824abe9d40ffaa43fb9fbb64ef7a P 8dd6aa65308948d3ae52d50a65ac39e0 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:36:33.026455 1360 raft_consensus.cc:2258] T c44a824abe9d40ffaa43fb9fbb64ef7a P 8dd6aa65308948d3ae52d50a65ac39e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:36:33.027667 1367 ts_tablet_manager.cc:1905] T c44a824abe9d40ffaa43fb9fbb64ef7a P 6a1af82c382d4ba8a05012ff00525198: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:36:33.030481 1367 ts_tablet_manager.cc:1918] T c44a824abe9d40ffaa43fb9fbb64ef7a P 6a1af82c382d4ba8a05012ff00525198: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:36:33.030589 1367 log.cc:1196] T c44a824abe9d40ffaa43fb9fbb64ef7a P 6a1af82c382d4ba8a05012ff00525198: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-1/wal/wals/c44a824abe9d40ffaa43fb9fbb64ef7a
I20260808 14:36:33.030958 1367 ts_tablet_manager.cc:1939] T c44a824abe9d40ffaa43fb9fbb64ef7a P 6a1af82c382d4ba8a05012ff00525198: Deleting consensus metadata
I20260808 14:36:33.032938 542 catalog_manager.cc:4841] TS 6a1af82c382d4ba8a05012ff00525198 (127.11.131.194:44343): tablet c44a824abe9d40ffaa43fb9fbb64ef7a (table test-table [id=4a49af05c6614ccb83229a39c5cec6f1]) successfully deleted
I20260808 14:36:33.039979 1360 ts_tablet_manager.cc:1905] T c44a824abe9d40ffaa43fb9fbb64ef7a P 8dd6aa65308948d3ae52d50a65ac39e0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:36:33.043406 1360 ts_tablet_manager.cc:1918] T c44a824abe9d40ffaa43fb9fbb64ef7a P 8dd6aa65308948d3ae52d50a65ac39e0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:36:33.043557 1360 log.cc:1196] T c44a824abe9d40ffaa43fb9fbb64ef7a P 8dd6aa65308948d3ae52d50a65ac39e0: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-2/wal/wals/c44a824abe9d40ffaa43fb9fbb64ef7a
I20260808 14:36:33.043948 1360 ts_tablet_manager.cc:1939] T c44a824abe9d40ffaa43fb9fbb64ef7a P 8dd6aa65308948d3ae52d50a65ac39e0: Deleting consensus metadata
I20260808 14:36:33.045522 545 catalog_manager.cc:4841] TS 8dd6aa65308948d3ae52d50a65ac39e0 (127.11.131.195:45449): tablet c44a824abe9d40ffaa43fb9fbb64ef7a (table test-table [id=4a49af05c6614ccb83229a39c5cec6f1]) successfully deleted
W20260808 14:36:33.046034 540 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.131.193:45657 (error 108)
I20260808 14:36:33.047004 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 886
I20260808 14:36:33.047320 1321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:33.046951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:45657 (local address 127.0.0.1:35240)
0808 14:36:33.047127 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:33.047210 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.193:45657: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260808 14:36:33.053838 540 catalog_manager.cc:4584] TS 68477b24ffc048fea013a7ed5d867784 (127.11.131.193:45657): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c44a824abe9d40ffaa43fb9fbb64ef7a: Network error: Client connection negotiation failed: client connection to 127.11.131.193:45657: connect: Connection refused (error 111)
I20260808 14:36:33.062074 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 1096
I20260808 14:36:33.076092 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 517
I20260808 14:36:33.088910 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:44663
--webserver_interface=127.11.131.254
--webserver_port=33201
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:33213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:44663
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:36:33.207712 1369 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:33.208015 1369 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:33.208088 1369 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:33.212102 1369 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:36:33.212188 1369 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:33.212229 1369 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:33.212283 1369 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:36:33.212327 1369 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:36:33.217594 1369 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:33213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:44663
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:44663
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.131.254
--webserver_port=33201
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1369
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:36:33.218813 1369 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:33.219923 1369 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:33.234736 1377 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:33.234853 1369 server_base.cc:1034] running on GCE node
W20260808 14:36:33.234781 1380 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:33.234737 1378 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:33.235644 1369 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:33.237342 1369 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:33.238593 1369 hybrid_clock.cc:648] HybridClock initialized: now 1786199793238549 us; error 52 us; skew 500 ppm
Aug 08 14:36:33 dist-test-slave-twwt krb5kdc[492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199793, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:33.241531 1369 init.cc:377] Logged in from keytab as kudu/127.11.131.254@KRBTEST.COM (short username kudu)
I20260808 14:36:33.242558 1369 webserver.cc:460] Webserver started at http://127.11.131.254:33201/ using document root <none> and password file <none>
I20260808 14:36:33.243219 1369 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:33.243347 1369 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:33.247635 1369 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 14:36:33.249909 1390 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:33.251214 1369 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 14:36:33.251366 1369 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "c25cfea087da4be89ca4a19a61663646"
format_stamp: "Formatted at 2026-08-08 14:36:32 on dist-test-slave-twwt"
server_key: "34ad92ccfe1ca2873173d6febc904798"
server_key_iv: "82afe1da871b47d68dfc13a8b42ab91c"
server_key_version: "encryptionkey@0"
I20260808 14:36:33.252027 1369 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:33.271376 1369 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:33.274421 1369 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:33.274708 1369 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:33.282444 1369 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.254:44663
I20260808 14:36:33.282804 1470 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.254:44663 every 8 connection(s)
I20260808 14:36:33.283761 1369 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:36:33.286883 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 1369
I20260808 14:36:33.287411 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.193:45657
--local_ip_for_outbound_sockets=127.11.131.193
--tserver_master_addrs=127.11.131.254:44663
--webserver_port=40425
--webserver_interface=127.11.131.193
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab
--principal=kudu/127.11.131.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:33213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:36:33.288950 1472 sys_catalog.cc:263] Verifying existing consensus state
I20260808 14:36:33.291043 1472 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646: Bootstrap starting.
I20260808 14:36:33.309311 1472 log.cc:824] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646: Log is configured to *not* fsync() on all Append() calls
I20260808 14:36:33.318212 1472 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:36:33.318652 1472 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646: Bootstrap complete.
I20260808 14:36:33.323101 1472 raft_consensus.cc:348] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c25cfea087da4be89ca4a19a61663646" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 44663 } }
I20260808 14:36:33.323500 1472 raft_consensus.cc:729] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c25cfea087da4be89ca4a19a61663646, State: Initialized, Role: FOLLOWER
I20260808 14:36:33.324000 1472 consensus_queue.cc:260] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c25cfea087da4be89ca4a19a61663646" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 44663 } }
I20260808 14:36:33.324112 1472 raft_consensus.cc:388] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:36:33.324206 1472 raft_consensus.cc:482] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:36:33.324321 1472 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646 [term 1 FOLLOWER]: Advancing to term 2
I20260808 14:36:33.326236 1472 raft_consensus.cc:504] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c25cfea087da4be89ca4a19a61663646" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 44663 } }
I20260808 14:36:33.326592 1472 leader_election.cc:302] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c25cfea087da4be89ca4a19a61663646; no voters:
I20260808 14:36:33.327031 1472 leader_election.cc:288] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 14:36:33.327129 1479 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 14:36:33.327314 1479 raft_consensus.cc:686] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646 [term 2 LEADER]: Becoming Leader. State: Replica: c25cfea087da4be89ca4a19a61663646, State: Running, Role: LEADER
I20260808 14:36:33.327621 1479 consensus_queue.cc:237] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c25cfea087da4be89ca4a19a61663646" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 44663 } }
I20260808 14:36:33.328336 1472 sys_catalog.cc:564] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:36:33.328603 1479 sys_catalog.cc:455] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c25cfea087da4be89ca4a19a61663646. Latest consensus state: current_term: 2 leader_uuid: "c25cfea087da4be89ca4a19a61663646" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c25cfea087da4be89ca4a19a61663646" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 44663 } } }
I20260808 14:36:33.328717 1479 sys_catalog.cc:458] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646 [sys.catalog]: This master's current role is: LEADER
I20260808 14:36:33.329092 1485 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:36:33.329188 1480 sys_catalog.cc:455] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "c25cfea087da4be89ca4a19a61663646" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c25cfea087da4be89ca4a19a61663646" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 44663 } } }
I20260808 14:36:33.329381 1480 sys_catalog.cc:458] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646 [sys.catalog]: This master's current role is: LEADER
I20260808 14:36:33.334141 1485 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:36:33.334810 1485 catalog_manager.cc:1259] Loaded cluster ID: aa9b72fb94ad4266bdd488adc338bd5a
I20260808 14:36:33.334873 1485 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:36:33.336300 1485 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260808 14:36:33.341199 1485 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260808 14:36:33.346777 1485 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:36:33.347527 1485 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646: Loaded TSK: 0
I20260808 14:36:33.348724 1485 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 14:36:33.410856 1475 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:33.411154 1475 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:33.411239 1475 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:33.415377 1475 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:33.415469 1475 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:33.415560 1475 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.193
I20260808 14:36:33.420892 1475 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:33213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab
--principal=kudu/127.11.131.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.193:45657
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.131.193
--webserver_port=40425
--tserver_master_addrs=127.11.131.254:44663
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1475
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.193
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:36:33.421942 1475 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:33.423043 1475 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:33.434012 1511 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:33.434490 1509 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:33.434088 1513 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:33.434480 1475 server_base.cc:1034] running on GCE node
I20260808 14:36:33.435778 1475 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:33.436580 1475 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:33.437776 1475 hybrid_clock.cc:648] HybridClock initialized: now 1786199793437656 us; error 131 us; skew 500 ppm
Aug 08 14:36:33 dist-test-slave-twwt krb5kdc[492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199793, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:33.440697 1475 init.cc:377] Logged in from keytab as kudu/127.11.131.193@KRBTEST.COM (short username kudu)
I20260808 14:36:33.441712 1475 webserver.cc:460] Webserver started at http://127.11.131.193:40425/ using document root <none> and password file <none>
I20260808 14:36:33.442296 1475 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:33.442374 1475 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:33.446435 1475 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:36:33.448750 1527 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:33.450121 1475 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 14:36:33.450253 1475 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-0/wal
uuid: "68477b24ffc048fea013a7ed5d867784"
format_stamp: "Formatted at 2026-08-08 14:36:32 on dist-test-slave-twwt"
server_key: "24d668584e86044003bc6395e69d54f8"
server_key_iv: "7e2955c6b9a22650ad394858e95b114f"
server_key_version: "encryptionkey@0"
I20260808 14:36:33.450874 1475 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:33.463589 1475 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:33.467000 1475 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:33.467200 1475 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:33.467877 1475 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:36:33.469019 1536 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 14:36:33.473371 1475 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 14:36:33.473433 1475 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.001s
I20260808 14:36:33.473516 1475 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 14:36:33.475394 1475 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 14:36:33.475453 1475 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.001s sys 0.000s
I20260808 14:36:33.475718 1536 tablet_bootstrap.cc:492] T c44a824abe9d40ffaa43fb9fbb64ef7a P 68477b24ffc048fea013a7ed5d867784: Bootstrap starting.
I20260808 14:36:33.486997 1475 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.193:45657
I20260808 14:36:33.487010 1702 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.193:45657 every 8 connection(s)
I20260808 14:36:33.488319 1475 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
I20260808 14:36:33.496426 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 1475
I20260808 14:36:33.496929 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.194:44343
--local_ip_for_outbound_sockets=127.11.131.194
--tserver_master_addrs=127.11.131.254:44663
--webserver_port=38529
--webserver_interface=127.11.131.194
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab
--principal=kudu/127.11.131.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:33213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:36:33.498847 1536 log.cc:824] T c44a824abe9d40ffaa43fb9fbb64ef7a P 68477b24ffc048fea013a7ed5d867784: Log is configured to *not* fsync() on all Append() calls
Aug 08 14:36:33 dist-test-slave-twwt krb5kdc[492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199793, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.193@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:36:33.507459 1536 tablet_bootstrap.cc:492] T c44a824abe9d40ffaa43fb9fbb64ef7a P 68477b24ffc048fea013a7ed5d867784: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:36:33.507881 1536 tablet_bootstrap.cc:492] T c44a824abe9d40ffaa43fb9fbb64ef7a P 68477b24ffc048fea013a7ed5d867784: Bootstrap complete.
I20260808 14:36:33.508426 1707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:33.490657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.193:34155)
0808 14:36:33.491197 (+ 540us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:33.491240 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:33.492059 (+ 819us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:33.493156 (+ 1097us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:33.493164 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:33.493605 (+ 441us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:33.494138 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:33.494159 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:33.496344 (+ 2185us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:33.496347 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:33.497758 (+ 1411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:33.497774 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:33.499001 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:33.499008 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:33.499258 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:33.500013 (+ 755us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:33.500030 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:33.501780 (+ 1750us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:33.504717 (+ 2937us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:33.504723 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:33.504738 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:33.505125 (+ 387us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:33.505581 (+ 456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:33.505584 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:33.505586 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:33.505750 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:33.506547 (+ 797us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:33.506553 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:33.506862 (+ 309us) client_negotiation.cc:769] Sending connection context
0808 14:36:33.507074 (+ 212us) client_negotiation.cc:240] Negotiation successful
0808 14:36:33.507401 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":181,"threads_started":1}
I20260808 14:36:33.509150 1706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:33.490587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:34155 (local address 127.11.131.254:44663)
0808 14:36:33.491003 (+ 416us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:33.491024 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:33.491357 (+ 333us) server_negotiation.cc:407] Connection header received
0808 14:36:33.492473 (+ 1116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:33.492483 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:33.492776 (+ 293us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:33.493104 (+ 328us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:33.494383 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:33.496124 (+ 1741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:33.497909 (+ 1785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:33.498647 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:33.498840 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:33.502033 (+ 3193us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:33.502045 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:33.502067 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:33.502109 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:33.504538 (+ 2429us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:33.505260 (+ 722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:33.505269 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:33.505277 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:33.505448 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:33.505867 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:33.505872 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:33.505874 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:33.506395 (+ 521us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:33.506543 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:33.507240 (+ 697us) server_negotiation.cc:299] Negotiation successful
0808 14:36:33.507684 (+ 444us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":244,"thread_start_us":148,"threads_started":1}
I20260808 14:36:33.509490 1536 ts_tablet_manager.cc:1397] T c44a824abe9d40ffaa43fb9fbb64ef7a P 68477b24ffc048fea013a7ed5d867784: Time spent bootstrapping tablet: real 0.034s user 0.018s sys 0.012s
I20260808 14:36:33.511744 1703 heartbeater.cc:347] Connected to a master server at 127.11.131.254:44663
I20260808 14:36:33.511989 1703 heartbeater.cc:464] Registering TS with master...
I20260808 14:36:33.512559 1703 heartbeater.cc:511] Master 127.11.131.254:44663 requested a full tablet report, sending...
I20260808 14:36:33.512176 1536 raft_consensus.cc:348] T c44a824abe9d40ffaa43fb9fbb64ef7a P 68477b24ffc048fea013a7ed5d867784 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dd6aa65308948d3ae52d50a65ac39e0" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45449 } } peers { permanent_uuid: "6a1af82c382d4ba8a05012ff00525198" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 44343 } } peers { permanent_uuid: "68477b24ffc048fea013a7ed5d867784" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 45657 } }
I20260808 14:36:33.512712 1536 raft_consensus.cc:729] T c44a824abe9d40ffaa43fb9fbb64ef7a P 68477b24ffc048fea013a7ed5d867784 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68477b24ffc048fea013a7ed5d867784, State: Initialized, Role: FOLLOWER
I20260808 14:36:33.513216 1536 consensus_queue.cc:260] T c44a824abe9d40ffaa43fb9fbb64ef7a P 68477b24ffc048fea013a7ed5d867784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dd6aa65308948d3ae52d50a65ac39e0" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45449 } } peers { permanent_uuid: "6a1af82c382d4ba8a05012ff00525198" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 44343 } } peers { permanent_uuid: "68477b24ffc048fea013a7ed5d867784" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 45657 } }
I20260808 14:36:33.514215 1536 ts_tablet_manager.cc:1428] T c44a824abe9d40ffaa43fb9fbb64ef7a P 68477b24ffc048fea013a7ed5d867784: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260808 14:36:33.515949 1416 ts_manager.cc:194] Registered new tserver with Master: 68477b24ffc048fea013a7ed5d867784 (127.11.131.193:45657)
I20260808 14:36:33.519989 1416 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.193@KRBTEST.COM'} at 127.11.131.193:34155
I20260808 14:36:33.522320 1703 heartbeater.cc:503] Master 127.11.131.254:44663 was elected leader, sending a full tablet report...
Aug 08 14:36:33 dist-test-slave-twwt krb5kdc[492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199793, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for kudu/127.11.131.193@KRBTEST.COM
I20260808 14:36:33.529965 1714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:33.519306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:45657 (local address 127.0.0.1:35250)
0808 14:36:33.520012 (+ 706us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:33.520047 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:33.520206 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:33.520668 (+ 462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:33.520673 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:33.521125 (+ 452us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:33.521254 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:33.521263 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:33.522806 (+ 1543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:33.522813 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:33.523487 (+ 674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:33.523497 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:33.524085 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:33.524089 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:33.524214 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:33.524780 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:33.524792 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:33.526165 (+ 1373us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:33.528247 (+ 2082us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:33.528256 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:33.528260 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:33.528500 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:33.528849 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:33.528853 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:33.528856 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:33.528942 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:33.529462 (+ 520us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:33.529466 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:33.529568 (+ 102us) client_negotiation.cc:769] Sending connection context
0808 14:36:33.529679 (+ 111us) client_negotiation.cc:240] Negotiation successful
0808 14:36:33.529828 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":528,"thread_start_us":141,"threads_started":1}
I20260808 14:36:33.530124 1715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:33.519350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35250 (local address 127.11.131.193:45657)
0808 14:36:33.519751 (+ 401us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:33.519762 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:33.520317 (+ 555us) server_negotiation.cc:407] Connection header received
0808 14:36:33.520375 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:33.520378 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:33.520522 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:33.520664 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:33.521387 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:33.522527 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:33.523616 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:33.523962 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:33.524081 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:33.526318 (+ 2237us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:33.526329 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:33.526342 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:33.526369 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:33.528142 (+ 1773us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:33.528612 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:33.528618 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:33.528620 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:33.528716 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:33.529054 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:33.529057 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:33.529059 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:33.529349 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:33.529478 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:33.529789 (+ 311us) server_negotiation.cc:299] Negotiation successful
0808 14:36:33.529967 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":106,"threads_started":1}
I20260808 14:36:33.531142 1601 tablet_service.cc:1514] Processing DeleteTablet for tablet c44a824abe9d40ffaa43fb9fbb64ef7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:36:33 UTC) from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:35250
I20260808 14:36:33.532019 1719 tablet_replica.cc:330] stopping tablet replica
I20260808 14:36:33.532320 1719 raft_consensus.cc:2229] T c44a824abe9d40ffaa43fb9fbb64ef7a P 68477b24ffc048fea013a7ed5d867784 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:36:33.532583 1719 raft_consensus.cc:2258] T c44a824abe9d40ffaa43fb9fbb64ef7a P 68477b24ffc048fea013a7ed5d867784 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:36:33.533583 1719 ts_tablet_manager.cc:1905] T c44a824abe9d40ffaa43fb9fbb64ef7a P 68477b24ffc048fea013a7ed5d867784: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:36:33.537187 1719 ts_tablet_manager.cc:1918] T c44a824abe9d40ffaa43fb9fbb64ef7a P 68477b24ffc048fea013a7ed5d867784: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:36:33.537312 1719 log.cc:1196] T c44a824abe9d40ffaa43fb9fbb64ef7a P 68477b24ffc048fea013a7ed5d867784: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-0/wal/wals/c44a824abe9d40ffaa43fb9fbb64ef7a
I20260808 14:36:33.537588 1719 ts_tablet_manager.cc:1939] T c44a824abe9d40ffaa43fb9fbb64ef7a P 68477b24ffc048fea013a7ed5d867784: Deleting consensus metadata
I20260808 14:36:33.539455 1391 catalog_manager.cc:4841] TS 68477b24ffc048fea013a7ed5d867784 (127.11.131.193:45657): tablet c44a824abe9d40ffaa43fb9fbb64ef7a (table test-table [id=4a49af05c6614ccb83229a39c5cec6f1]) successfully deleted
W20260808 14:36:33.625340 1708 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:33.625654 1708 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:33.625735 1708 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:33.630034 1708 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:33.630122 1708 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:33.630209 1708 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.194
I20260808 14:36:33.635695 1708 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:33213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab
--principal=kudu/127.11.131.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.194:44343
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.131.194
--webserver_port=38529
--tserver_master_addrs=127.11.131.254:44663
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1708
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.194
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:36:33.636773 1708 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:33.637866 1708 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:33.648168 1730 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:33.648193 1728 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:33.648181 1726 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:33.648350 1708 server_base.cc:1034] running on GCE node
I20260808 14:36:33.648865 1708 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:33.649555 1708 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:33.650746 1708 hybrid_clock.cc:648] HybridClock initialized: now 1786199793650731 us; error 28 us; skew 500 ppm
Aug 08 14:36:33 dist-test-slave-twwt krb5kdc[492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199793, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:33.653453 1708 init.cc:377] Logged in from keytab as kudu/127.11.131.194@KRBTEST.COM (short username kudu)
I20260808 14:36:33.654451 1708 webserver.cc:460] Webserver started at http://127.11.131.194:38529/ using document root <none> and password file <none>
I20260808 14:36:33.655153 1708 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:33.655268 1708 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:33.659510 1708 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 14:36:33.661697 1741 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:33.663254 1708 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 14:36:33.663370 1708 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-1/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-1/wal
uuid: "6a1af82c382d4ba8a05012ff00525198"
format_stamp: "Formatted at 2026-08-08 14:36:32 on dist-test-slave-twwt"
server_key: "965caff2947b8c4b290930e70cd1901f"
server_key_iv: "dc19d35a2c2978e6eb4828deac8b3e95"
server_key_version: "encryptionkey@0"
I20260808 14:36:33.663926 1708 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:33.675624 1708 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:33.678522 1708 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:33.678742 1708 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:33.679292 1708 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:36:33.680080 1708 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:36:33.680127 1708 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:33.680169 1708 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:36:33.680189 1708 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:33.689399 1708 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.194:44343
I20260808 14:36:33.689473 1921 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.194:44343 every 8 connection(s)
I20260808 14:36:33.690439 1708 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
I20260808 14:36:33.695673 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 1708
I20260808 14:36:33.696136 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.195:45449
--local_ip_for_outbound_sockets=127.11.131.195
--tserver_master_addrs=127.11.131.254:44663
--webserver_port=36221
--webserver_interface=127.11.131.195
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab
--principal=kudu/127.11.131.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:33213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 14:36:33 dist-test-slave-twwt krb5kdc[492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199793, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.194@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:36:33.705123 1706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:33.692314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:41605 (local address 127.11.131.254:44663)
0808 14:36:33.692490 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:33.692495 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:33.693364 (+ 869us) server_negotiation.cc:407] Connection header received
0808 14:36:33.694835 (+ 1471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:33.694838 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:33.694902 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:33.694979 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:33.696253 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:33.696790 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:33.698023 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:33.698273 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:33.698368 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:33.701226 (+ 2858us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:33.701230 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:33.701232 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:33.701257 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:33.702879 (+ 1622us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:33.703480 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:33.703484 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:33.703486 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:33.703572 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:33.703952 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:33.703956 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:33.703958 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:33.704152 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:33.704263 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:33.704806 (+ 543us) server_negotiation.cc:299] Negotiation successful
0808 14:36:33.704947 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 14:36:33.705942 1925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:33.692740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.194:41605)
0808 14:36:33.693199 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:33.693246 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:33.694566 (+ 1320us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:33.695151 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:33.695157 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:33.695518 (+ 361us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:33.696095 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:33.696111 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:33.696924 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:33.696930 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:33.697859 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:33.697874 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:33.698441 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:33.698447 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:33.698714 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:33.699352 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:33.699376 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:33.701038 (+ 1662us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:33.703006 (+ 1968us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:33.703012 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:33.703027 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:33.703374 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:33.703673 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:33.703676 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:33.703678 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:33.703829 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:33.704264 (+ 435us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:33.704278 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:33.704561 (+ 283us) client_negotiation.cc:769] Sending connection context
0808 14:36:33.704763 (+ 202us) client_negotiation.cc:240] Negotiation successful
0808 14:36:33.705104 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":123,"threads_started":1}
I20260808 14:36:33.707386 1922 heartbeater.cc:347] Connected to a master server at 127.11.131.254:44663
I20260808 14:36:33.707664 1922 heartbeater.cc:464] Registering TS with master...
I20260808 14:36:33.708184 1922 heartbeater.cc:511] Master 127.11.131.254:44663 requested a full tablet report, sending...
I20260808 14:36:33.709342 1416 ts_manager.cc:194] Registered new tserver with Master: 6a1af82c382d4ba8a05012ff00525198 (127.11.131.194:44343)
I20260808 14:36:33.709936 1416 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.194@KRBTEST.COM'} at 127.11.131.194:41605
W20260808 14:36:33.818445 1929 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:33.818758 1929 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:33.818831 1929 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:33.822818 1929 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:33.822906 1929 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:33.822992 1929 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.195
I20260808 14:36:33.828148 1929 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:33213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab
--principal=kudu/127.11.131.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.195:45449
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.131.195
--webserver_port=36221
--tserver_master_addrs=127.11.131.254:44663
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1929
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.195
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:36:33.829368 1929 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:33.830549 1929 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:33.840236 1938 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:33.840238 1942 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:33.840224 1939 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:33.840478 1929 server_base.cc:1034] running on GCE node
I20260808 14:36:33.840979 1929 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:33.841753 1929 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:33.842989 1929 hybrid_clock.cc:648] HybridClock initialized: now 1786199793842964 us; error 35 us; skew 500 ppm
Aug 08 14:36:33 dist-test-slave-twwt krb5kdc[492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199793, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:33.846102 1929 init.cc:377] Logged in from keytab as kudu/127.11.131.195@KRBTEST.COM (short username kudu)
I20260808 14:36:33.847095 1929 webserver.cc:460] Webserver started at http://127.11.131.195:36221/ using document root <none> and password file <none>
I20260808 14:36:33.847707 1929 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:33.847827 1929 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:33.851826 1929 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 14:36:33.854058 1954 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:33.855638 1929 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:36:33.855773 1929 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-2/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-2/wal
uuid: "8dd6aa65308948d3ae52d50a65ac39e0"
format_stamp: "Formatted at 2026-08-08 14:36:32 on dist-test-slave-twwt"
server_key: "067dcadb316b2c9565e7ec9a8459d2ec"
server_key_iv: "8b07a6eab1bd74e1433abf0a8432c13f"
server_key_version: "encryptionkey@0"
I20260808 14:36:33.856400 1929 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:33.866183 1929 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:33.869521 1929 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:33.869688 1929 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:33.870227 1929 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:36:33.871142 1929 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:36:33.871191 1929 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:33.871232 1929 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:36:33.871254 1929 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:33.880167 1929 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.195:45449
I20260808 14:36:33.880187 2131 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.195:45449 every 8 connection(s)
I20260808 14:36:33.881219 1929 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
I20260808 14:36:33.884550 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 1929
Aug 08 14:36:33 dist-test-slave-twwt krb5kdc[492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199793, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.195@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:36:33.893880 2139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:33.885384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45862 (local address 127.11.131.254:44663)
0808 14:36:33.885615 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:33.885620 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:33.885854 (+ 234us) server_negotiation.cc:407] Connection header received
0808 14:36:33.886027 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:33.886031 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:33.886085 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:33.886185 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:33.887037 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:33.887586 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:33.888443 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:33.888670 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:33.888780 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:33.890373 (+ 1593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:33.890377 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:33.890379 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:33.890409 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:33.892099 (+ 1690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:33.892529 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:33.892534 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:33.892536 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:33.892638 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:33.892946 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:33.892949 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:33.892951 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:33.893136 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:33.893374 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:33.893524 (+ 150us) server_negotiation.cc:299] Negotiation successful
0808 14:36:33.893690 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":78,"threads_started":1}
I20260808 14:36:33.896241 1706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:33.883257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:56597 (local address 127.11.131.254:44663)
0808 14:36:33.883402 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:33.883407 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:33.884332 (+ 925us) server_negotiation.cc:407] Connection header received
0808 14:36:33.886093 (+ 1761us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:33.886097 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:33.886150 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:33.886260 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:33.887528 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:33.888011 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:33.889156 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:33.889362 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:33.889479 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:33.892280 (+ 2801us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:33.892284 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:33.892285 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:33.892307 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:33.893788 (+ 1481us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:33.894698 (+ 910us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:33.894701 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:33.894702 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:33.894795 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:33.895151 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:33.895154 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:33.895155 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:33.895314 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:33.895386 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:33.896043 (+ 657us) server_negotiation.cc:299] Negotiation successful
0808 14:36:33.896137 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 14:36:33.897152 2136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:33.883671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.195:56597)
0808 14:36:33.884149 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:33.884194 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:33.885862 (+ 1668us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:33.886456 (+ 594us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:33.886463 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:33.886885 (+ 422us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:33.887380 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:33.887394 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:33.888145 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:33.888148 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:33.889008 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:33.889017 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:33.889525 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:33.889529 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:33.889695 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:33.890246 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:33.890263 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:33.892100 (+ 1837us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:33.893897 (+ 1797us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:33.893906 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:33.893925 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:33.894560 (+ 635us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:33.894901 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:33.894904 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:33.894905 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:33.895068 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:33.895416 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:33.895423 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:33.895761 (+ 338us) client_negotiation.cc:769] Sending connection context
0808 14:36:33.895978 (+ 217us) client_negotiation.cc:240] Negotiation successful
0808 14:36:33.896278 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":130,"threads_started":1}
I20260808 14:36:33.898343 2132 heartbeater.cc:347] Connected to a master server at 127.11.131.254:44663
I20260808 14:36:33.898653 2132 heartbeater.cc:464] Registering TS with master...
I20260808 14:36:33.899196 2132 heartbeater.cc:511] Master 127.11.131.254:44663 requested a full tablet report, sending...
I20260808 14:36:33.900261 1416 ts_manager.cc:194] Registered new tserver with Master: 8dd6aa65308948d3ae52d50a65ac39e0 (127.11.131.195:45449)
I20260808 14:36:33.900839 1416 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.195@KRBTEST.COM'} at 127.11.131.195:56597
I20260808 14:36:33.907753 11791 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:36:33.911819 1706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:33.908338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45864 (local address 127.11.131.254:44663)
0808 14:36:33.908467 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:33.908470 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:33.908613 (+ 143us) server_negotiation.cc:407] Connection header received
0808 14:36:33.908729 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:33.908731 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:33.908822 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:33.908928 (+ 106us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:36:33.909138 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:33.909622 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:33.910462 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:33.910762 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:33.910844 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:33.911123 (+ 279us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:36:33.911493 (+ 370us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:36:33.911584 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:33.911640 (+ 56us) server_negotiation.cc:299] Negotiation successful
0808 14:36:33.911685 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 14:36:33.912451 1416 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:45864:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:36:33.915728 1416 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:36:33.924239 1601 tablet_service.cc:1467] Processing CreateTablet for tablet 51f011fb45824140adcd95ae08f0dbf5 (DEFAULT_TABLE table=test-table [id=9931faee24874e98a574e1ef9557d8b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:36:33.925004 1601 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51f011fb45824140adcd95ae08f0dbf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:36:33.928340 1536 tablet_bootstrap.cc:492] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784: Bootstrap starting.
I20260808 14:36:33.928529 1714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:33.922952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.195:45449 (local address 127.0.0.1:36710)
0808 14:36:33.923102 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:33.923122 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:33.923212 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:33.924285 (+ 1073us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:33.924288 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:33.924307 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:36:33.924427 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:33.924438 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:33.925812 (+ 1374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:33.925816 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:33.926779 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:33.926789 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:33.928047 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:33.928051 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:33.928162 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:33.928226 (+ 64us) client_negotiation.cc:769] Sending connection context
0808 14:36:33.928293 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 14:36:33.928396 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63}
I20260808 14:36:33.928951 2147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:33.923226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.194:44343 (local address 127.0.0.1:38340)
0808 14:36:33.923553 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:33.923570 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:33.923657 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:33.924765 (+ 1108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:33.924768 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:33.924789 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:36:33.924896 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:33.924903 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:33.926625 (+ 1722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:33.926629 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:33.927447 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:33.927457 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:33.928505 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:33.928508 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:33.928618 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:33.928650 (+ 32us) client_negotiation.cc:769] Sending connection context
0808 14:36:33.928727 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 14:36:33.928810 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":136,"threads_started":1}
I20260808 14:36:33.929378 1536 tablet_bootstrap.cc:654] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784: Neither blocks nor log segments found. Creating new log.
I20260808 14:36:33.929442 2152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:33.923171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36710 (local address 127.11.131.195:45449)
0808 14:36:33.923735 (+ 564us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:33.923748 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:33.923775 (+ 27us) server_negotiation.cc:407] Connection header received
0808 14:36:33.923867 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:33.923876 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:33.924118 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:33.924309 (+ 191us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:36:33.924623 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:33.925625 (+ 1002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:33.926922 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:33.927875 (+ 953us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:33.928791 (+ 916us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:33.928949 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:33.929060 (+ 111us) server_negotiation.cc:299] Negotiation successful
0808 14:36:33.929224 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":454,"thread_start_us":193,"threads_started":1}
I20260808 14:36:33.929744 2154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:33.923711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38340 (local address 127.11.131.194:44343)
0808 14:36:33.924145 (+ 434us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:33.924160 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:33.924186 (+ 26us) server_negotiation.cc:407] Connection header received
0808 14:36:33.924269 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:33.924277 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:33.924572 (+ 295us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:33.925059 (+ 487us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:36:33.925246 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:33.926440 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:33.927579 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:33.928368 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:33.929281 (+ 913us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:33.929412 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:33.929468 (+ 56us) server_negotiation.cc:299] Negotiation successful
0808 14:36:33.929576 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":313,"thread_start_us":159,"threads_started":1}
I20260808 14:36:33.931039 1536 tablet_bootstrap.cc:492] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784: No bootstrap required, opened a new log
I20260808 14:36:33.931143 1536 ts_tablet_manager.cc:1397] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260808 14:36:33.931636 1536 raft_consensus.cc:348] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dd6aa65308948d3ae52d50a65ac39e0" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45449 } } peers { permanent_uuid: "6a1af82c382d4ba8a05012ff00525198" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 44343 } } peers { permanent_uuid: "68477b24ffc048fea013a7ed5d867784" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 45657 } }
I20260808 14:36:33.931767 1536 raft_consensus.cc:374] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:36:33.931810 1536 raft_consensus.cc:729] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68477b24ffc048fea013a7ed5d867784, State: Initialized, Role: FOLLOWER
I20260808 14:36:33.931978 1536 consensus_queue.cc:260] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dd6aa65308948d3ae52d50a65ac39e0" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45449 } } peers { permanent_uuid: "6a1af82c382d4ba8a05012ff00525198" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 44343 } } peers { permanent_uuid: "68477b24ffc048fea013a7ed5d867784" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 45657 } }
I20260808 14:36:33.932278 1536 ts_tablet_manager.cc:1428] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260808 14:36:33.932855 2021 tablet_service.cc:1467] Processing CreateTablet for tablet 51f011fb45824140adcd95ae08f0dbf5 (DEFAULT_TABLE table=test-table [id=9931faee24874e98a574e1ef9557d8b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:36:33.932828 1816 tablet_service.cc:1467] Processing CreateTablet for tablet 51f011fb45824140adcd95ae08f0dbf5 (DEFAULT_TABLE table=test-table [id=9931faee24874e98a574e1ef9557d8b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:36:33.933969 2021 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51f011fb45824140adcd95ae08f0dbf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:36:33.934032 1816 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51f011fb45824140adcd95ae08f0dbf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:36:33.941896 2160 tablet_bootstrap.cc:492] T 51f011fb45824140adcd95ae08f0dbf5 P 6a1af82c382d4ba8a05012ff00525198: Bootstrap starting.
I20260808 14:36:33.942379 2156 tablet_bootstrap.cc:492] T 51f011fb45824140adcd95ae08f0dbf5 P 8dd6aa65308948d3ae52d50a65ac39e0: Bootstrap starting.
I20260808 14:36:33.945096 2156 tablet_bootstrap.cc:654] T 51f011fb45824140adcd95ae08f0dbf5 P 8dd6aa65308948d3ae52d50a65ac39e0: Neither blocks nor log segments found. Creating new log.
I20260808 14:36:33.945667 2160 tablet_bootstrap.cc:654] T 51f011fb45824140adcd95ae08f0dbf5 P 6a1af82c382d4ba8a05012ff00525198: Neither blocks nor log segments found. Creating new log.
I20260808 14:36:33.946683 2160 log.cc:824] T 51f011fb45824140adcd95ae08f0dbf5 P 6a1af82c382d4ba8a05012ff00525198: Log is configured to *not* fsync() on all Append() calls
I20260808 14:36:33.946683 2156 log.cc:824] T 51f011fb45824140adcd95ae08f0dbf5 P 8dd6aa65308948d3ae52d50a65ac39e0: Log is configured to *not* fsync() on all Append() calls
I20260808 14:36:33.948844 2160 tablet_bootstrap.cc:492] T 51f011fb45824140adcd95ae08f0dbf5 P 6a1af82c382d4ba8a05012ff00525198: No bootstrap required, opened a new log
I20260808 14:36:33.948876 2156 tablet_bootstrap.cc:492] T 51f011fb45824140adcd95ae08f0dbf5 P 8dd6aa65308948d3ae52d50a65ac39e0: No bootstrap required, opened a new log
I20260808 14:36:33.949075 2160 ts_tablet_manager.cc:1397] T 51f011fb45824140adcd95ae08f0dbf5 P 6a1af82c382d4ba8a05012ff00525198: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260808 14:36:33.949082 2156 ts_tablet_manager.cc:1397] T 51f011fb45824140adcd95ae08f0dbf5 P 8dd6aa65308948d3ae52d50a65ac39e0: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260808 14:36:33.954056 2156 raft_consensus.cc:348] T 51f011fb45824140adcd95ae08f0dbf5 P 8dd6aa65308948d3ae52d50a65ac39e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dd6aa65308948d3ae52d50a65ac39e0" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45449 } } peers { permanent_uuid: "6a1af82c382d4ba8a05012ff00525198" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 44343 } } peers { permanent_uuid: "68477b24ffc048fea013a7ed5d867784" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 45657 } }
I20260808 14:36:33.954051 2160 raft_consensus.cc:348] T 51f011fb45824140adcd95ae08f0dbf5 P 6a1af82c382d4ba8a05012ff00525198 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dd6aa65308948d3ae52d50a65ac39e0" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45449 } } peers { permanent_uuid: "6a1af82c382d4ba8a05012ff00525198" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 44343 } } peers { permanent_uuid: "68477b24ffc048fea013a7ed5d867784" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 45657 } }
I20260808 14:36:33.954373 2156 raft_consensus.cc:374] T 51f011fb45824140adcd95ae08f0dbf5 P 8dd6aa65308948d3ae52d50a65ac39e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:36:33.954375 2160 raft_consensus.cc:374] T 51f011fb45824140adcd95ae08f0dbf5 P 6a1af82c382d4ba8a05012ff00525198 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:36:33.954428 2156 raft_consensus.cc:729] T 51f011fb45824140adcd95ae08f0dbf5 P 8dd6aa65308948d3ae52d50a65ac39e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dd6aa65308948d3ae52d50a65ac39e0, State: Initialized, Role: FOLLOWER
I20260808 14:36:33.954438 2160 raft_consensus.cc:729] T 51f011fb45824140adcd95ae08f0dbf5 P 6a1af82c382d4ba8a05012ff00525198 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a1af82c382d4ba8a05012ff00525198, State: Initialized, Role: FOLLOWER
I20260808 14:36:33.955034 2160 consensus_queue.cc:260] T 51f011fb45824140adcd95ae08f0dbf5 P 6a1af82c382d4ba8a05012ff00525198 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dd6aa65308948d3ae52d50a65ac39e0" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45449 } } peers { permanent_uuid: "6a1af82c382d4ba8a05012ff00525198" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 44343 } } peers { permanent_uuid: "68477b24ffc048fea013a7ed5d867784" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 45657 } }
I20260808 14:36:33.955120 2156 consensus_queue.cc:260] T 51f011fb45824140adcd95ae08f0dbf5 P 8dd6aa65308948d3ae52d50a65ac39e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dd6aa65308948d3ae52d50a65ac39e0" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45449 } } peers { permanent_uuid: "6a1af82c382d4ba8a05012ff00525198" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 44343 } } peers { permanent_uuid: "68477b24ffc048fea013a7ed5d867784" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 45657 } }
I20260808 14:36:33.955989 2132 heartbeater.cc:503] Master 127.11.131.254:44663 was elected leader, sending a full tablet report...
I20260808 14:36:33.956272 2160 ts_tablet_manager.cc:1428] T 51f011fb45824140adcd95ae08f0dbf5 P 6a1af82c382d4ba8a05012ff00525198: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260808 14:36:33.956369 2156 ts_tablet_manager.cc:1428] T 51f011fb45824140adcd95ae08f0dbf5 P 8dd6aa65308948d3ae52d50a65ac39e0: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260808 14:36:33.956650 1922 heartbeater.cc:503] Master 127.11.131.254:44663 was elected leader, sending a full tablet report...
W20260808 14:36:33.989804 1704 tablet.cc:2369] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:36:34.092228 2174 raft_consensus.cc:482] T 51f011fb45824140adcd95ae08f0dbf5 P 8dd6aa65308948d3ae52d50a65ac39e0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:36:34.092501 2174 raft_consensus.cc:504] T 51f011fb45824140adcd95ae08f0dbf5 P 8dd6aa65308948d3ae52d50a65ac39e0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dd6aa65308948d3ae52d50a65ac39e0" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45449 } } peers { permanent_uuid: "6a1af82c382d4ba8a05012ff00525198" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 44343 } } peers { permanent_uuid: "68477b24ffc048fea013a7ed5d867784" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 45657 } }
I20260808 14:36:34.093837 2174 leader_election.cc:288] T 51f011fb45824140adcd95ae08f0dbf5 P 8dd6aa65308948d3ae52d50a65ac39e0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a1af82c382d4ba8a05012ff00525198 (127.11.131.194:44343), 68477b24ffc048fea013a7ed5d867784 (127.11.131.193:45657)
I20260808 14:36:34.097769 2177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:34.094268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:49031 (local address 127.11.131.193:45657)
0808 14:36:34.094557 (+ 289us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:34.094563 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:34.094580 (+ 17us) server_negotiation.cc:407] Connection header received
0808 14:36:34.094679 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:34.094681 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:34.094741 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:34.094871 (+ 130us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:36:34.095165 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:34.095685 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:34.096767 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:34.097224 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:34.097358 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:34.097529 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:34.097570 (+ 41us) server_negotiation.cc:299] Negotiation successful
0808 14:36:34.097634 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":219,"thread_start_us":96,"threads_started":1}
I20260808 14:36:34.097769 2136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:34.094163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:45657 (local address 127.11.131.195:49031)
0808 14:36:34.094392 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:34.094409 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:34.094510 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:34.094887 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:34.094890 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:34.094908 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:36:34.095044 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:34.095050 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:34.095805 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:34.095808 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:34.096629 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:34.096638 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:34.097354 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:34.097358 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:34.097461 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:34.097483 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 14:36:34.097552 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 14:36:34.097626 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"mutex_wait_us":26}
I20260808 14:36:34.097927 2154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:34.094278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:43469 (local address 127.11.131.194:44343)
0808 14:36:34.094429 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:34.094434 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:34.094750 (+ 316us) server_negotiation.cc:407] Connection header received
0808 14:36:34.094915 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:34.094918 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:34.094966 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:34.095057 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:36:34.095345 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:34.095849 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:34.096939 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:34.097337 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:34.097478 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:34.097534 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:34.097723 (+ 189us) server_negotiation.cc:299] Negotiation successful
0808 14:36:34.097798 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 14:36:34.097951 2176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:34.094165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.194:44343 (local address 127.11.131.195:43469)
0808 14:36:34.094595 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:34.094653 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:34.094791 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:34.095071 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:34.095074 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:34.095091 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:36:34.095220 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:34.095226 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:34.095970 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:34.095974 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:34.096801 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:34.096810 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:34.097475 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:34.097478 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:34.097583 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:34.097606 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 14:36:34.097705 (+ 99us) client_negotiation.cc:240] Negotiation successful
0808 14:36:34.097774 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":353,"mutex_wait_us":21,"thread_start_us":114,"threads_started":1}
I20260808 14:36:34.098469 1634 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51f011fb45824140adcd95ae08f0dbf5" candidate_uuid: "8dd6aa65308948d3ae52d50a65ac39e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68477b24ffc048fea013a7ed5d867784" is_pre_election: true
I20260808 14:36:34.098526 1845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51f011fb45824140adcd95ae08f0dbf5" candidate_uuid: "8dd6aa65308948d3ae52d50a65ac39e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a1af82c382d4ba8a05012ff00525198" is_pre_election: true
I20260808 14:36:34.098837 1634 raft_consensus.cc:2454] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dd6aa65308948d3ae52d50a65ac39e0 in term 0.
I20260808 14:36:34.098836 1845 raft_consensus.cc:2454] T 51f011fb45824140adcd95ae08f0dbf5 P 6a1af82c382d4ba8a05012ff00525198 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dd6aa65308948d3ae52d50a65ac39e0 in term 0.
I20260808 14:36:34.099339 1958 leader_election.cc:302] T 51f011fb45824140adcd95ae08f0dbf5 P 8dd6aa65308948d3ae52d50a65ac39e0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a1af82c382d4ba8a05012ff00525198, 8dd6aa65308948d3ae52d50a65ac39e0; no voters:
I20260808 14:36:34.099609 2174 raft_consensus.cc:2781] T 51f011fb45824140adcd95ae08f0dbf5 P 8dd6aa65308948d3ae52d50a65ac39e0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:36:34.099713 2174 raft_consensus.cc:482] T 51f011fb45824140adcd95ae08f0dbf5 P 8dd6aa65308948d3ae52d50a65ac39e0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:36:34.099774 2174 raft_consensus.cc:3037] T 51f011fb45824140adcd95ae08f0dbf5 P 8dd6aa65308948d3ae52d50a65ac39e0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:36:34.100875 2174 raft_consensus.cc:504] T 51f011fb45824140adcd95ae08f0dbf5 P 8dd6aa65308948d3ae52d50a65ac39e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dd6aa65308948d3ae52d50a65ac39e0" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45449 } } peers { permanent_uuid: "6a1af82c382d4ba8a05012ff00525198" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 44343 } } peers { permanent_uuid: "68477b24ffc048fea013a7ed5d867784" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 45657 } }
I20260808 14:36:34.101248 2174 leader_election.cc:288] T 51f011fb45824140adcd95ae08f0dbf5 P 8dd6aa65308948d3ae52d50a65ac39e0 [CANDIDATE]: Term 1 election: Requested vote from peers 6a1af82c382d4ba8a05012ff00525198 (127.11.131.194:44343), 68477b24ffc048fea013a7ed5d867784 (127.11.131.193:45657)
I20260808 14:36:34.101612 1845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51f011fb45824140adcd95ae08f0dbf5" candidate_uuid: "8dd6aa65308948d3ae52d50a65ac39e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a1af82c382d4ba8a05012ff00525198"
I20260808 14:36:34.101706 1634 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51f011fb45824140adcd95ae08f0dbf5" candidate_uuid: "8dd6aa65308948d3ae52d50a65ac39e0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68477b24ffc048fea013a7ed5d867784"
I20260808 14:36:34.101749 1845 raft_consensus.cc:3037] T 51f011fb45824140adcd95ae08f0dbf5 P 6a1af82c382d4ba8a05012ff00525198 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:36:34.101872 1634 raft_consensus.cc:3037] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:36:34.102962 1845 raft_consensus.cc:2454] T 51f011fb45824140adcd95ae08f0dbf5 P 6a1af82c382d4ba8a05012ff00525198 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dd6aa65308948d3ae52d50a65ac39e0 in term 1.
I20260808 14:36:34.103144 1634 raft_consensus.cc:2454] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dd6aa65308948d3ae52d50a65ac39e0 in term 1.
I20260808 14:36:34.103287 1958 leader_election.cc:302] T 51f011fb45824140adcd95ae08f0dbf5 P 8dd6aa65308948d3ae52d50a65ac39e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a1af82c382d4ba8a05012ff00525198, 8dd6aa65308948d3ae52d50a65ac39e0; no voters:
I20260808 14:36:34.103513 2174 raft_consensus.cc:2781] T 51f011fb45824140adcd95ae08f0dbf5 P 8dd6aa65308948d3ae52d50a65ac39e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:36:34.103740 2174 raft_consensus.cc:686] T 51f011fb45824140adcd95ae08f0dbf5 P 8dd6aa65308948d3ae52d50a65ac39e0 [term 1 LEADER]: Becoming Leader. State: Replica: 8dd6aa65308948d3ae52d50a65ac39e0, State: Running, Role: LEADER
I20260808 14:36:34.104096 2174 consensus_queue.cc:237] T 51f011fb45824140adcd95ae08f0dbf5 P 8dd6aa65308948d3ae52d50a65ac39e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dd6aa65308948d3ae52d50a65ac39e0" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45449 } } peers { permanent_uuid: "6a1af82c382d4ba8a05012ff00525198" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 44343 } } peers { permanent_uuid: "68477b24ffc048fea013a7ed5d867784" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 45657 } }
I20260808 14:36:34.107410 1414 catalog_manager.cc:5495] T 51f011fb45824140adcd95ae08f0dbf5 P 8dd6aa65308948d3ae52d50a65ac39e0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dd6aa65308948d3ae52d50a65ac39e0 (127.11.131.195). New cstate: current_term: 1 leader_uuid: "8dd6aa65308948d3ae52d50a65ac39e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dd6aa65308948d3ae52d50a65ac39e0" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a1af82c382d4ba8a05012ff00525198" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 44343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "68477b24ffc048fea013a7ed5d867784" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 45657 } health_report { overall_health: UNKNOWN } } }
I20260808 14:36:34.121240 2152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:34.117686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36724 (local address 127.11.131.195:45449)
0808 14:36:34.117828 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:34.117839 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:34.117852 (+ 13us) server_negotiation.cc:407] Connection header received
0808 14:36:34.117984 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:34.117987 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:34.118046 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:34.118135 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:36:34.118377 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:34.118998 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:34.119810 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:34.120037 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:34.120116 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:34.120406 (+ 290us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:36:34.120821 (+ 415us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:36:34.120914 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:34.121011 (+ 97us) server_negotiation.cc:299] Negotiation successful
0808 14:36:34.121061 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 14:36:34.127487 1634 raft_consensus.cc:1261] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784 [term 1 FOLLOWER]: Refusing update from remote peer 8dd6aa65308948d3ae52d50a65ac39e0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:36:34.127502 1845 raft_consensus.cc:1261] T 51f011fb45824140adcd95ae08f0dbf5 P 6a1af82c382d4ba8a05012ff00525198 [term 1 FOLLOWER]: Refusing update from remote peer 8dd6aa65308948d3ae52d50a65ac39e0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:36:34.128243 2174 consensus_queue.cc:1035] T 51f011fb45824140adcd95ae08f0dbf5 P 8dd6aa65308948d3ae52d50a65ac39e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a1af82c382d4ba8a05012ff00525198" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 44343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:36:34.128486 2179 consensus_queue.cc:1035] T 51f011fb45824140adcd95ae08f0dbf5 P 8dd6aa65308948d3ae52d50a65ac39e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68477b24ffc048fea013a7ed5d867784" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 45657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 14:36:34.132328 2135 tablet.cc:2369] T 51f011fb45824140adcd95ae08f0dbf5 P 8dd6aa65308948d3ae52d50a65ac39e0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:36:34.145558 1416 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:45864:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:36:34.145718 1416 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:45864:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:36:34.148138 1416 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646: Sending DeleteTablet for 3 replicas of tablet 51f011fb45824140adcd95ae08f0dbf5
I20260808 14:36:34.148891 1816 tablet_service.cc:1514] Processing DeleteTablet for tablet 51f011fb45824140adcd95ae08f0dbf5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:36:34 UTC) from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:38340
I20260808 14:36:34.148890 2021 tablet_service.cc:1514] Processing DeleteTablet for tablet 51f011fb45824140adcd95ae08f0dbf5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:36:34 UTC) from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:36710
I20260808 14:36:34.149034 1601 tablet_service.cc:1514] Processing DeleteTablet for tablet 51f011fb45824140adcd95ae08f0dbf5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:36:34 UTC) from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:35250
I20260808 14:36:34.149544 2201 tablet_replica.cc:330] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784: stopping tablet replica
I20260808 14:36:34.149536 2199 tablet_replica.cc:330] T 51f011fb45824140adcd95ae08f0dbf5 P 8dd6aa65308948d3ae52d50a65ac39e0: stopping tablet replica
I20260808 14:36:34.149685 2201 raft_consensus.cc:2229] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:36:34.149791 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 1475
I20260808 14:36:34.149834 2201 raft_consensus.cc:2258] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:36:34.160248 2199 raft_consensus.cc:2229] T 51f011fb45824140adcd95ae08f0dbf5 P 8dd6aa65308948d3ae52d50a65ac39e0 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:36:34.160710 2199 raft_consensus.cc:2258] T 51f011fb45824140adcd95ae08f0dbf5 P 8dd6aa65308948d3ae52d50a65ac39e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:36:34.161744 2200 tablet_replica.cc:330] T 51f011fb45824140adcd95ae08f0dbf5 P 6a1af82c382d4ba8a05012ff00525198: stopping tablet replica
I20260808 14:36:34.162112 2200 raft_consensus.cc:2229] T 51f011fb45824140adcd95ae08f0dbf5 P 6a1af82c382d4ba8a05012ff00525198 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:36:34.162482 2200 raft_consensus.cc:2258] T 51f011fb45824140adcd95ae08f0dbf5 P 6a1af82c382d4ba8a05012ff00525198 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:36:34.162773 2199 ts_tablet_manager.cc:1905] T 51f011fb45824140adcd95ae08f0dbf5 P 8dd6aa65308948d3ae52d50a65ac39e0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:36:34.164265 2200 ts_tablet_manager.cc:1905] T 51f011fb45824140adcd95ae08f0dbf5 P 6a1af82c382d4ba8a05012ff00525198: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:36:34.165946 2199 ts_tablet_manager.cc:1918] T 51f011fb45824140adcd95ae08f0dbf5 P 8dd6aa65308948d3ae52d50a65ac39e0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:36:34.166153 2199 log.cc:1196] T 51f011fb45824140adcd95ae08f0dbf5 P 8dd6aa65308948d3ae52d50a65ac39e0: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-2/wal/wals/51f011fb45824140adcd95ae08f0dbf5
I20260808 14:36:34.166651 2199 ts_tablet_manager.cc:1939] T 51f011fb45824140adcd95ae08f0dbf5 P 8dd6aa65308948d3ae52d50a65ac39e0: Deleting consensus metadata
I20260808 14:36:34.167232 2200 ts_tablet_manager.cc:1918] T 51f011fb45824140adcd95ae08f0dbf5 P 6a1af82c382d4ba8a05012ff00525198: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:36:34.167341 2200 log.cc:1196] T 51f011fb45824140adcd95ae08f0dbf5 P 6a1af82c382d4ba8a05012ff00525198: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-1/wal/wals/51f011fb45824140adcd95ae08f0dbf5
I20260808 14:36:34.167730 2200 ts_tablet_manager.cc:1939] T 51f011fb45824140adcd95ae08f0dbf5 P 6a1af82c382d4ba8a05012ff00525198: Deleting consensus metadata
W20260808 14:36:34.168499 1391 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.131.193:45657 (error 108)
I20260808 14:36:34.168601 1395 catalog_manager.cc:4841] TS 8dd6aa65308948d3ae52d50a65ac39e0 (127.11.131.195:45449): tablet 51f011fb45824140adcd95ae08f0dbf5 (table test-table [id=9931faee24874e98a574e1ef9557d8b9]) successfully deleted
I20260808 14:36:34.168931 1394 catalog_manager.cc:4841] TS 6a1af82c382d4ba8a05012ff00525198 (127.11.131.194:44343): tablet 51f011fb45824140adcd95ae08f0dbf5 (table test-table [id=9931faee24874e98a574e1ef9557d8b9]) successfully deleted
I20260808 14:36:34.169523 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 1708
I20260808 14:36:34.174719 2147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:34.174296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:45657 (local address 127.0.0.1:35252)
0808 14:36:34.174515 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:34.174597 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.193:45657: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137}
W20260808 14:36:34.175009 1391 catalog_manager.cc:4584] TS 68477b24ffc048fea013a7ed5d867784 (127.11.131.193:45657): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 51f011fb45824140adcd95ae08f0dbf5: Network error: Client connection negotiation failed: client connection to 127.11.131.193:45657: connect: Connection refused (error 111)
I20260808 14:36:34.182046 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 1929
I20260808 14:36:34.196604 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 1369
I20260808 14:36:34.213649 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:44663
--webserver_interface=127.11.131.254
--webserver_port=33201
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:33213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:44663
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:36:34.334546 2203 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:34.334911 2203 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:34.334955 2203 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:34.338999 2203 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:36:34.339066 2203 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:34.339085 2203 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:34.339103 2203 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:36:34.339118 2203 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:36:34.344767 2203 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:33213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:44663
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:44663
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.131.254
--webserver_port=33201
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2203
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:36:34.345880 2203 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:34.346983 2203 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:34.356086 2214 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:34.356163 2220 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:34.356127 2213 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:34.356150 2203 server_base.cc:1034] running on GCE node
I20260808 14:36:34.356952 2203 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:34.358115 2203 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:34.359335 2203 hybrid_clock.cc:648] HybridClock initialized: now 1786199794359314 us; error 32 us; skew 500 ppm
Aug 08 14:36:34 dist-test-slave-twwt krb5kdc[492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199794, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:34.362452 2203 init.cc:377] Logged in from keytab as kudu/127.11.131.254@KRBTEST.COM (short username kudu)
I20260808 14:36:34.363493 2203 webserver.cc:460] Webserver started at http://127.11.131.254:33201/ using document root <none> and password file <none>
I20260808 14:36:34.364154 2203 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:34.364253 2203 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:34.368315 2203 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 14:36:34.370898 2231 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:34.372406 2203 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:36:34.372593 2203 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "c25cfea087da4be89ca4a19a61663646"
format_stamp: "Formatted at 2026-08-08 14:36:32 on dist-test-slave-twwt"
server_key: "34ad92ccfe1ca2873173d6febc904798"
server_key_iv: "82afe1da871b47d68dfc13a8b42ab91c"
server_key_version: "encryptionkey@0"
I20260808 14:36:34.373272 2203 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:34.391528 2203 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:34.395349 2203 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:34.395586 2203 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:34.403429 2203 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.254:44663
I20260808 14:36:34.403841 2319 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.254:44663 every 8 connection(s)
I20260808 14:36:34.404798 2203 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:36:34.409298 2320 sys_catalog.cc:263] Verifying existing consensus state
I20260808 14:36:34.411139 2320 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646: Bootstrap starting.
I20260808 14:36:34.411557 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 2203
I20260808 14:36:34.412058 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.193:45657
--local_ip_for_outbound_sockets=127.11.131.193
--tserver_master_addrs=127.11.131.254:44663
--webserver_port=40425
--webserver_interface=127.11.131.193
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab
--principal=kudu/127.11.131.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:33213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:36:34.431069 2320 log.cc:824] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646: Log is configured to *not* fsync() on all Append() calls
I20260808 14:36:34.444240 2320 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:36:34.444672 2320 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646: Bootstrap complete.
I20260808 14:36:34.449123 2320 raft_consensus.cc:348] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c25cfea087da4be89ca4a19a61663646" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 44663 } }
I20260808 14:36:34.449524 2320 raft_consensus.cc:729] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: c25cfea087da4be89ca4a19a61663646, State: Initialized, Role: FOLLOWER
I20260808 14:36:34.450111 2320 consensus_queue.cc:260] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c25cfea087da4be89ca4a19a61663646" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 44663 } }
I20260808 14:36:34.450241 2320 raft_consensus.cc:388] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:36:34.450332 2320 raft_consensus.cc:482] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:36:34.450457 2320 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646 [term 2 FOLLOWER]: Advancing to term 3
I20260808 14:36:34.452500 2320 raft_consensus.cc:504] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c25cfea087da4be89ca4a19a61663646" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 44663 } }
I20260808 14:36:34.452884 2320 leader_election.cc:302] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c25cfea087da4be89ca4a19a61663646; no voters:
I20260808 14:36:34.453250 2320 leader_election.cc:288] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 14:36:34.453356 2325 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 14:36:34.453581 2325 raft_consensus.cc:686] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646 [term 3 LEADER]: Becoming Leader. State: Replica: c25cfea087da4be89ca4a19a61663646, State: Running, Role: LEADER
I20260808 14:36:34.453897 2325 consensus_queue.cc:237] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c25cfea087da4be89ca4a19a61663646" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 44663 } }
I20260808 14:36:34.454574 2320 sys_catalog.cc:564] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:36:34.455348 2326 sys_catalog.cc:455] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "c25cfea087da4be89ca4a19a61663646" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c25cfea087da4be89ca4a19a61663646" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 44663 } } }
I20260808 14:36:34.455487 2326 sys_catalog.cc:458] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646 [sys.catalog]: This master's current role is: LEADER
I20260808 14:36:34.455832 2330 sys_catalog.cc:455] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c25cfea087da4be89ca4a19a61663646. Latest consensus state: current_term: 3 leader_uuid: "c25cfea087da4be89ca4a19a61663646" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c25cfea087da4be89ca4a19a61663646" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 44663 } } }
I20260808 14:36:34.455924 2330 sys_catalog.cc:458] T 00000000000000000000000000000000 P c25cfea087da4be89ca4a19a61663646 [sys.catalog]: This master's current role is: LEADER
I20260808 14:36:34.456441 2335 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:36:34.461779 2335 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:36:34.462545 2335 catalog_manager.cc:1259] Loaded cluster ID: aa9b72fb94ad4266bdd488adc338bd5a
I20260808 14:36:34.462636 2335 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260808 14:36:34.463853 2335 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f55f4e7f9ad google::LogMessage::Fail() at ??:0
@ 0x7f55f4e8288a google::LogMessage::SendToLog() at ??:0
@ 0x7f55f4e7f4de google::LogMessage::Flush() at ??:0
@ 0x7f55f4e80a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f55ff7befdd _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f55ff7bfd2f kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f55ff7bc579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f55ff800640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f55f70d13d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f55f70d1c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f55f70d33f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f55f70c2512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f55f87066db start_thread at ??:0
@ 0x7f55f397d61f clone at ??:0
W20260808 14:36:34.564121 2323 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:34.564504 2323 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:34.564582 2323 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:34.571142 2323 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:34.571236 2323 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:34.571326 2323 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.193
I20260808 14:36:34.579582 2323 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:33213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab
--principal=kudu/127.11.131.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.193:45657
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.131.193
--webserver_port=40425
--tserver_master_addrs=127.11.131.254:44663
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2323
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.193
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:36:34.581246 2323 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:34.582712 2323 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:34.594076 2379 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:34.594141 2323 server_base.cc:1034] running on GCE node
W20260808 14:36:34.594089 2378 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:34.594321 2381 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:34.594882 2323 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:34.595677 2323 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:34.596897 2323 hybrid_clock.cc:648] HybridClock initialized: now 1786199794596871 us; error 35 us; skew 500 ppm
Aug 08 14:36:34 dist-test-slave-twwt krb5kdc[492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199794, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:34.600562 2323 init.cc:377] Logged in from keytab as kudu/127.11.131.193@KRBTEST.COM (short username kudu)
I20260808 14:36:34.601800 2323 webserver.cc:460] Webserver started at http://127.11.131.193:40425/ using document root <none> and password file <none>
I20260808 14:36:34.602560 2323 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:34.602694 2323 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:34.608261 2323 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 14:36:34.611310 2392 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:34.612982 2323 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 14:36:34.613121 2323 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-0/wal
uuid: "68477b24ffc048fea013a7ed5d867784"
format_stamp: "Formatted at 2026-08-08 14:36:32 on dist-test-slave-twwt"
server_key: "24d668584e86044003bc6395e69d54f8"
server_key_iv: "7e2955c6b9a22650ad394858e95b114f"
server_key_version: "encryptionkey@0"
I20260808 14:36:34.613919 2323 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:34.639905 2323 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:34.644232 2323 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:34.644464 2323 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:34.645280 2323 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:36:34.646733 2404 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 14:36:34.651242 2323 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 14:36:34.651333 2323 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.001s sys 0.000s
I20260808 14:36:34.651410 2323 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 14:36:34.653868 2323 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 14:36:34.653934 2323 ts_tablet_manager.cc:589] Time spent register tablets: real 0.003s user 0.000s sys 0.000s
I20260808 14:36:34.654273 2404 tablet_bootstrap.cc:492] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784: Bootstrap starting.
I20260808 14:36:34.665589 2323 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.193:45657
I20260808 14:36:34.665650 2572 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.193:45657 every 8 connection(s)
I20260808 14:36:34.667021 2323 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
I20260808 14:36:34.671624 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 2323
I20260808 14:36:34.672132 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.194:44343
--local_ip_for_outbound_sockets=127.11.131.194
--tserver_master_addrs=127.11.131.254:44663
--webserver_port=38529
--webserver_interface=127.11.131.194
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab
--principal=kudu/127.11.131.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:33213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:36:34.676817 2404 log.cc:824] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784: Log is configured to *not* fsync() on all Append() calls
I20260808 14:36:34.687825 2404 tablet_bootstrap.cc:492] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:36:34.688320 2404 tablet_bootstrap.cc:492] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784: Bootstrap complete.
I20260808 14:36:34.690047 2404 ts_tablet_manager.cc:1397] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784: Time spent bootstrapping tablet: real 0.036s user 0.020s sys 0.012s
I20260808 14:36:34.693578 2404 raft_consensus.cc:348] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dd6aa65308948d3ae52d50a65ac39e0" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45449 } } peers { permanent_uuid: "6a1af82c382d4ba8a05012ff00525198" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 44343 } } peers { permanent_uuid: "68477b24ffc048fea013a7ed5d867784" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 45657 } }
I20260808 14:36:34.694159 2404 raft_consensus.cc:729] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68477b24ffc048fea013a7ed5d867784, State: Initialized, Role: FOLLOWER
I20260808 14:36:34.694748 2404 consensus_queue.cc:260] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dd6aa65308948d3ae52d50a65ac39e0" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45449 } } peers { permanent_uuid: "6a1af82c382d4ba8a05012ff00525198" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 44343 } } peers { permanent_uuid: "68477b24ffc048fea013a7ed5d867784" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 45657 } }
I20260808 14:36:34.695973 2404 ts_tablet_manager.cc:1428] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
W20260808 14:36:34.721148 2576 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:36:34.669608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.193:53023)
0808 14:36:34.670248 (+ 640us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:34.670312 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:34.675007 (+ 4695us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:34.720315 (+ 45308us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:44663: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":189,"threads_started":1}
W20260808 14:36:34.721727 2573 heartbeater.cc:644] Failed to heartbeat to 127.11.131.254:44663 (0 consecutive failures): Network error: Failed to ping master at 127.11.131.254:44663: Client connection negotiation failed: client connection to 127.11.131.254:44663: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 14:36:34.722508 2576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:34.722247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.193:54863)
0808 14:36:34.722379 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:34.722452 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260808 14:36:34.723270 2576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:34.723068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.193:55453)
0808 14:36:34.723178 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:34.723221 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260808 14:36:34.723533 2573 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 14:36:34.803761 2577 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:34.804030 2577 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:34.804118 2577 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:34.808229 2577 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:34.808287 2577 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:34.808390 2577 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.194
I20260808 14:36:34.813771 2577 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:33213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab
--principal=kudu/127.11.131.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.194:44343
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.131.194
--webserver_port=38529
--tserver_master_addrs=127.11.131.254:44663
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2577
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.194
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:36:34.814919 2577 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:34.816004 2577 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:34.826493 2593 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:34.826488 2597 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:34.826494 2591 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:34.826800 2577 server_base.cc:1034] running on GCE node
I20260808 14:36:34.827337 2577 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:34.828037 2577 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:34.829233 2577 hybrid_clock.cc:648] HybridClock initialized: now 1786199794829213 us; error 30 us; skew 500 ppm
Aug 08 14:36:34 dist-test-slave-twwt krb5kdc[492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199794, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:34.832182 2577 init.cc:377] Logged in from keytab as kudu/127.11.131.194@KRBTEST.COM (short username kudu)
I20260808 14:36:34.833140 2577 webserver.cc:460] Webserver started at http://127.11.131.194:38529/ using document root <none> and password file <none>
I20260808 14:36:34.833782 2577 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:34.833887 2577 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:34.837941 2577 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260808 14:36:34.840149 2611 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:34.841430 2577 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260808 14:36:34.841591 2577 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-1/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-1/wal
uuid: "6a1af82c382d4ba8a05012ff00525198"
format_stamp: "Formatted at 2026-08-08 14:36:32 on dist-test-slave-twwt"
server_key: "965caff2947b8c4b290930e70cd1901f"
server_key_iv: "dc19d35a2c2978e6eb4828deac8b3e95"
server_key_version: "encryptionkey@0"
I20260808 14:36:34.842223 2577 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:34.857023 2577 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:34.860003 2577 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:34.860219 2577 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:34.860842 2577 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:36:34.861708 2577 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:36:34.861785 2577 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:34.861902 2577 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:36:34.861958 2577 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:34.871359 2577 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.194:44343
I20260808 14:36:34.871393 2793 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.194:44343 every 8 connection(s)
I20260808 14:36:34.872400 2577 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
I20260808 14:36:34.874364 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 2577
I20260808 14:36:34.874876 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.195:45449
--local_ip_for_outbound_sockets=127.11.131.195
--tserver_master_addrs=127.11.131.254:44663
--webserver_port=36221
--webserver_interface=127.11.131.195
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab
--principal=kudu/127.11.131.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:33213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:36:34.877157 2798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:34.874651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.194:60795)
0808 14:36:34.875235 (+ 584us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:34.875411 (+ 176us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":132,"threads_started":1}
W20260808 14:36:34.877684 2795 heartbeater.cc:644] Failed to heartbeat to 127.11.131.254:44663 (0 consecutive failures): Network error: Failed to ping master at 127.11.131.254:44663: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
I20260808 14:36:34.878398 2798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:34.878157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.194:45455)
0808 14:36:34.878281 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:34.878341 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260808 14:36:34.879182 2798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:34.878960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.194:34361)
0808 14:36:34.879079 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:34.879131 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260808 14:36:34.879384 2795 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 14:36:34.995260 2800 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:34.995536 2800 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:34.995579 2800 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:34.999641 2800 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:34.999701 2800 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:34.999784 2800 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.195
I20260808 14:36:35.005380 2800 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:33213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab
--principal=kudu/127.11.131.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.195:45449
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.131.195
--webserver_port=36221
--tserver_master_addrs=127.11.131.254:44663
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2800
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.195
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:36:35.006531 2800 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:35.007684 2800 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:35.017961 2812 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:35.018033 2810 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:35.018011 2800 server_base.cc:1034] running on GCE node
W20260808 14:36:35.018281 2814 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:35.018769 2800 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:35.019520 2800 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:35.020710 2800 hybrid_clock.cc:648] HybridClock initialized: now 1786199795020689 us; error 32 us; skew 500 ppm
Aug 08 14:36:35 dist-test-slave-twwt krb5kdc[492](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199795, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:35.023540 2800 init.cc:377] Logged in from keytab as kudu/127.11.131.195@KRBTEST.COM (short username kudu)
I20260808 14:36:35.024434 2800 webserver.cc:460] Webserver started at http://127.11.131.195:36221/ using document root <none> and password file <none>
I20260808 14:36:35.025028 2800 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:35.025125 2800 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:35.029132 2800 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 14:36:35.031279 2825 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:35.032531 2800 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 14:36:35.032693 2800 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-2/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-2/wal
uuid: "8dd6aa65308948d3ae52d50a65ac39e0"
format_stamp: "Formatted at 2026-08-08 14:36:32 on dist-test-slave-twwt"
server_key: "067dcadb316b2c9565e7ec9a8459d2ec"
server_key_iv: "8b07a6eab1bd74e1433abf0a8432c13f"
server_key_version: "encryptionkey@0"
I20260808 14:36:35.033357 2800 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:35.052404 2800 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:35.055814 2800 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:35.056042 2800 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:35.056701 2800 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:36:35.057595 2800 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:36:35.057668 2800 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:35.057737 2800 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:36:35.057780 2800 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:35.067488 2800 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.195:45449
I20260808 14:36:35.067525 3017 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.195:45449 every 8 connection(s)
I20260808 14:36:35.068528 2800 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
I20260808 14:36:35.072610 3028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:35.070834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.195:48601)
0808 14:36:35.071320 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:35.071441 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":116,"threads_started":1}
W20260808 14:36:35.073156 3020 heartbeater.cc:644] Failed to heartbeat to 127.11.131.254:44663 (0 consecutive failures): Network error: Failed to ping master at 127.11.131.254:44663: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
I20260808 14:36:35.073823 3028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:35.073568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.195:53317)
0808 14:36:35.073672 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:35.073740 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260808 14:36:35.074040 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 2800
I20260808 14:36:35.074499 3028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:35.074261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.195:48347)
0808 14:36:35.074376 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:35.074430 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260808 14:36:35.074736 3020 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 14:36:35.724807 3034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:35.724323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.193:45023)
0808 14:36:35.724618 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:35.724683 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":99,"threads_started":1}
I20260808 14:36:35.880587 3035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:35.880039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.194:59889)
0808 14:36:35.880363 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:35.880442 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":73,"threads_started":1}
I20260808 14:36:36.075734 3036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:36.075311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.195:38483)
0808 14:36:36.075570 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:36.075626 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":81,"threads_started":1}
I20260808 14:36:36.173717 3037 raft_consensus.cc:482] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:36:36.173923 3037 raft_consensus.cc:504] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dd6aa65308948d3ae52d50a65ac39e0" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45449 } } peers { permanent_uuid: "6a1af82c382d4ba8a05012ff00525198" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 44343 } } peers { permanent_uuid: "68477b24ffc048fea013a7ed5d867784" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 45657 } }
I20260808 14:36:36.175100 3037 leader_election.cc:288] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dd6aa65308948d3ae52d50a65ac39e0 (127.11.131.195:45449), 6a1af82c382d4ba8a05012ff00525198 (127.11.131.194:44343)
Aug 08 14:36:36 dist-test-slave-twwt krb5kdc[492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199794, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.193@KRBTEST.COM for kudu/127.11.131.194@KRBTEST.COM
Aug 08 14:36:36 dist-test-slave-twwt krb5kdc[492](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199794, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.193@KRBTEST.COM for kudu/127.11.131.195@KRBTEST.COM
I20260808 14:36:36.190002 3040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:36.175357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.195:45449 (local address 127.11.131.193:50457)
0808 14:36:36.175809 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:36.175826 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:36.175939 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:36.178424 (+ 2485us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:36.178427 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:36.178596 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:36.178952 (+ 356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:36.178968 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:36.180286 (+ 1318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:36.180290 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:36.181231 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:36.181241 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:36.182293 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:36.182296 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:36.182357 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:36.182962 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:36.182980 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:36.185268 (+ 2288us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:36.187464 (+ 2196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:36.187467 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:36.187469 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:36.187760 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:36.188126 (+ 366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:36.188130 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:36.188132 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:36.188273 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:36.188932 (+ 659us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:36.188938 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:36.189208 (+ 270us) client_negotiation.cc:769] Sending connection context
0808 14:36:36.189409 (+ 201us) client_negotiation.cc:240] Negotiation successful
0808 14:36:36.189774 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":383,"mutex_wait_us":184,"spinlock_wait_cycles":2304,"thread_start_us":67,"threads_started":1}
I20260808 14:36:36.190016 3042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:36.175736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:50457 (local address 127.11.131.195:45449)
0808 14:36:36.176159 (+ 423us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:36.176180 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:36.176211 (+ 31us) server_negotiation.cc:407] Connection header received
0808 14:36:36.177046 (+ 835us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:36.177057 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:36.177538 (+ 481us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:36.177901 (+ 363us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:36.179147 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:36.180131 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:36.181368 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:36.181951 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:36.182111 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:36.185478 (+ 3367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:36.185483 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:36.185493 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:36.185522 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:36.187303 (+ 1781us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:36.187896 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:36.187901 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:36.187906 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:36.188020 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:36.188375 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:36.188379 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:36.188381 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:36.188799 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:36.188953 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:36.189535 (+ 582us) server_negotiation.cc:299] Negotiation successful
0808 14:36:36.189822 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":99,"threads_started":1}
I20260808 14:36:36.190049 3041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:36.175627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:38975 (local address 127.11.131.194:44343)
0808 14:36:36.176015 (+ 388us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:36.176044 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:36.176092 (+ 48us) server_negotiation.cc:407] Connection header received
0808 14:36:36.177051 (+ 959us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:36.177058 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:36.177538 (+ 480us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:36.177901 (+ 363us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:36.179148 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:36.180150 (+ 1002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:36.181362 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:36.181869 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:36.182057 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:36.185193 (+ 3136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:36.185198 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:36.185210 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:36.185238 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:36.187256 (+ 2018us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:36.187891 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:36.187900 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:36.187909 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:36.188023 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:36.188390 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:36.188395 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:36.188397 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:36.188799 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:36.188963 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:36.189542 (+ 579us) server_negotiation.cc:299] Negotiation successful
0808 14:36:36.189842 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":267,"thread_start_us":184,"threads_started":1}
I20260808 14:36:36.190034 3034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:36.175357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.194:44343 (local address 127.11.131.193:38975)
0808 14:36:36.175497 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:36.175515 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:36.175634 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:36.177966 (+ 2332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:36.177972 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:36.178357 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:36.178952 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:36.178968 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:36.180317 (+ 1349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:36.180320 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:36.181229 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:36.181239 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:36.182007 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:36.182010 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:36.182171 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:36.182879 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:36.182905 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:36.184910 (+ 2005us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:36.187396 (+ 2486us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:36.187402 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:36.187415 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:36.187758 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:36.188130 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:36.188134 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:36.188136 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:36.188279 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:36.188942 (+ 663us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:36.188945 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:36.189209 (+ 264us) client_negotiation.cc:769] Sending connection context
0808 14:36:36.189410 (+ 201us) client_negotiation.cc:240] Negotiation successful
0808 14:36:36.189868 (+ 458us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55,"mutex_wait_us":338,"spinlock_wait_cycles":30848}
W20260808 14:36:36.192896 2401 leader_election.cc:341] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8dd6aa65308948d3ae52d50a65ac39e0 (127.11.131.195:45449): Not found: Tablet not found: 51f011fb45824140adcd95ae08f0dbf5
W20260808 14:36:36.193113 2395 leader_election.cc:341] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6a1af82c382d4ba8a05012ff00525198 (127.11.131.194:44343): Not found: Tablet not found: 51f011fb45824140adcd95ae08f0dbf5
I20260808 14:36:36.193270 2395 leader_election.cc:302] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68477b24ffc048fea013a7ed5d867784; no voters: 6a1af82c382d4ba8a05012ff00525198, 8dd6aa65308948d3ae52d50a65ac39e0
I20260808 14:36:36.193589 3037 raft_consensus.cc:2726] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 14:36:36.726069 3044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:36.725612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.193:37963)
0808 14:36:36.725906 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:36.725969 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":81,"threads_started":1}
I20260808 14:36:36.881880 3046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:36.881457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.194:59697)
0808 14:36:36.881728 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:36.881786 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":104,"threads_started":1}
I20260808 14:36:37.076906 3047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:37.076491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.195:39405)
0808 14:36:37.076758 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:37.076818 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":73,"threads_started":1}
I20260808 14:36:37.727339 3048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:37.726903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.193:56759)
0808 14:36:37.727167 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:37.727226 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":75,"threads_started":1}
I20260808 14:36:37.821355 3049 raft_consensus.cc:482] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:36:37.821488 3049 raft_consensus.cc:504] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dd6aa65308948d3ae52d50a65ac39e0" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45449 } } peers { permanent_uuid: "6a1af82c382d4ba8a05012ff00525198" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 44343 } } peers { permanent_uuid: "68477b24ffc048fea013a7ed5d867784" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 45657 } }
I20260808 14:36:37.821883 3049 leader_election.cc:288] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dd6aa65308948d3ae52d50a65ac39e0 (127.11.131.195:45449), 6a1af82c382d4ba8a05012ff00525198 (127.11.131.194:44343)
W20260808 14:36:37.822842 2401 leader_election.cc:341] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8dd6aa65308948d3ae52d50a65ac39e0 (127.11.131.195:45449): Not found: Tablet not found: 51f011fb45824140adcd95ae08f0dbf5
W20260808 14:36:37.822991 2395 leader_election.cc:341] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6a1af82c382d4ba8a05012ff00525198 (127.11.131.194:44343): Not found: Tablet not found: 51f011fb45824140adcd95ae08f0dbf5
I20260808 14:36:37.823071 2395 leader_election.cc:302] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68477b24ffc048fea013a7ed5d867784; no voters: 6a1af82c382d4ba8a05012ff00525198, 8dd6aa65308948d3ae52d50a65ac39e0
I20260808 14:36:37.823225 3049 raft_consensus.cc:2726] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 14:36:37.883383 3050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:37.882905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.194:36621)
0808 14:36:37.883221 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:37.883284 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":81,"threads_started":1}
I20260808 14:36:38.078068 3053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:38.077665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.195:37691)
0808 14:36:38.077916 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:38.077971 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":75,"threads_started":1}
I20260808 14:36:38.728650 3054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:38.728192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.193:47435)
0808 14:36:38.728483 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:38.728544 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":100,"threads_started":1}
I20260808 14:36:38.884637 3055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:38.884204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.194:58941)
0808 14:36:38.884482 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:38.884542 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":78,"threads_started":1}
I20260808 14:36:39.079355 3058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:39.078896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.195:38849)
0808 14:36:39.079168 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:39.079228 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":94,"threads_started":1}
I20260808 14:36:39.402014 3059 raft_consensus.cc:482] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:36:39.402149 3059 raft_consensus.cc:504] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dd6aa65308948d3ae52d50a65ac39e0" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45449 } } peers { permanent_uuid: "6a1af82c382d4ba8a05012ff00525198" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 44343 } } peers { permanent_uuid: "68477b24ffc048fea013a7ed5d867784" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 45657 } }
I20260808 14:36:39.402681 3059 leader_election.cc:288] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dd6aa65308948d3ae52d50a65ac39e0 (127.11.131.195:45449), 6a1af82c382d4ba8a05012ff00525198 (127.11.131.194:44343)
W20260808 14:36:39.403546 2401 leader_election.cc:341] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8dd6aa65308948d3ae52d50a65ac39e0 (127.11.131.195:45449): Not found: Tablet not found: 51f011fb45824140adcd95ae08f0dbf5
W20260808 14:36:39.403656 2395 leader_election.cc:341] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6a1af82c382d4ba8a05012ff00525198 (127.11.131.194:44343): Not found: Tablet not found: 51f011fb45824140adcd95ae08f0dbf5
I20260808 14:36:39.403700 2401 leader_election.cc:302] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68477b24ffc048fea013a7ed5d867784; no voters: 6a1af82c382d4ba8a05012ff00525198, 8dd6aa65308948d3ae52d50a65ac39e0
I20260808 14:36:39.403916 3059 raft_consensus.cc:2726] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 14:36:39.730114 3060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:39.729639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.193:38675)
0808 14:36:39.729954 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:39.730012 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":91,"threads_started":1}
I20260808 14:36:39.885807 3061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:39.885413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.194:49509)
0808 14:36:39.885660 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:39.885714 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":80,"threads_started":1}
I20260808 14:36:40.080662 3063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:40.080187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.195:39809)
0808 14:36:40.080501 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:40.080557 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":124,"threads_started":1}
I20260808 14:36:40.731499 3065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:40.731040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.193:56397)
0808 14:36:40.731334 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:40.731397 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":85,"threads_started":1}
I20260808 14:36:40.887192 3066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:40.886737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.194:54631)
0808 14:36:40.887021 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:40.887091 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":82,"threads_started":1}
I20260808 14:36:41.082091 3068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:41.081465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.195:58215)
0808 14:36:41.081931 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:41.081993 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":387,"thread_start_us":278,"threads_started":1}
I20260808 14:36:41.732676 3070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:41.732264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.193:49013)
0808 14:36:41.732517 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:41.732574 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":78,"threads_started":1}
I20260808 14:36:41.888473 3072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:41.888012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.194:34891)
0808 14:36:41.888316 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:41.888374 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":76,"threads_started":1}
I20260808 14:36:42.083515 3074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:42.083051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.195:43057)
0808 14:36:42.083350 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:42.083419 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":73,"threads_started":1}
I20260808 14:36:42.494710 3075 raft_consensus.cc:482] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:36:42.494879 3075 raft_consensus.cc:504] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dd6aa65308948d3ae52d50a65ac39e0" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45449 } } peers { permanent_uuid: "6a1af82c382d4ba8a05012ff00525198" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 44343 } } peers { permanent_uuid: "68477b24ffc048fea013a7ed5d867784" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 45657 } }
I20260808 14:36:42.495393 3075 leader_election.cc:288] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dd6aa65308948d3ae52d50a65ac39e0 (127.11.131.195:45449), 6a1af82c382d4ba8a05012ff00525198 (127.11.131.194:44343)
W20260808 14:36:42.496265 2401 leader_election.cc:341] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8dd6aa65308948d3ae52d50a65ac39e0 (127.11.131.195:45449): Not found: Tablet not found: 51f011fb45824140adcd95ae08f0dbf5
W20260808 14:36:42.496381 2395 leader_election.cc:341] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6a1af82c382d4ba8a05012ff00525198 (127.11.131.194:44343): Not found: Tablet not found: 51f011fb45824140adcd95ae08f0dbf5
I20260808 14:36:42.496497 2395 leader_election.cc:302] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68477b24ffc048fea013a7ed5d867784; no voters: 6a1af82c382d4ba8a05012ff00525198, 8dd6aa65308948d3ae52d50a65ac39e0
I20260808 14:36:42.496672 3075 raft_consensus.cc:2726] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 14:36:42.733954 3076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:42.733532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.193:45579)
0808 14:36:42.733790 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:42.733849 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":77,"threads_started":1}
I20260808 14:36:42.889657 3077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:42.889218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.194:53715)
0808 14:36:42.889499 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:42.889559 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":80,"threads_started":1}
I20260808 14:36:43.084857 3078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:43.084353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.195:45587)
0808 14:36:43.084652 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:43.084714 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":116,"threads_started":1}
I20260808 14:36:43.735188 3080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:43.734777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.193:56187)
0808 14:36:43.735030 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:43.735084 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":81,"threads_started":1}
I20260808 14:36:43.891098 3082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:43.890573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.194:41903)
0808 14:36:43.890934 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:43.890998 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":94,"threads_started":1}
I20260808 14:36:44.086123 3085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:44.085639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.195:56063)
0808 14:36:44.085959 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:44.086023 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":103,"threads_started":1}
I20260808 14:36:44.736469 3086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:44.736037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.193:51939)
0808 14:36:44.736294 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:44.736351 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":73,"threads_started":1}
I20260808 14:36:44.892392 3089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:44.891954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.194:53949)
0808 14:36:44.892227 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:44.892294 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":98,"threads_started":1}
I20260808 14:36:45.087534 3090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:45.087097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.195:36141)
0808 14:36:45.087371 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:45.087432 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":74,"threads_started":1}
I20260808 14:36:45.737773 3091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:45.737341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.193:45429)
0808 14:36:45.737609 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:45.737670 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":79,"threads_started":1}
I20260808 14:36:45.893849 3093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:45.893344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.194:58319)
0808 14:36:45.893678 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:45.893746 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":105,"threads_started":1}
I20260808 14:36:46.088855 3095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:46.088317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.195:34803)
0808 14:36:46.088622 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:46.088704 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":95,"threads_started":1}
I20260808 14:36:46.738979 3096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:46.738525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.193:32929)
0808 14:36:46.738815 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:46.738869 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":130,"threads_started":1}
I20260808 14:36:46.895195 3098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:46.894733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.194:42493)
0808 14:36:46.895037 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:46.895095 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":84,"threads_started":1}
I20260808 14:36:47.090164 3099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:47.089683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.195:34691)
0808 14:36:47.089986 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:47.090051 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":94,"threads_started":1}
I20260808 14:36:47.740206 3101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:47.739741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.193:34883)
0808 14:36:47.740041 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:47.740102 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":89,"threads_started":1}
I20260808 14:36:47.896615 3103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:47.896102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.194:60689)
0808 14:36:47.896445 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:47.896512 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":79,"threads_started":1}
I20260808 14:36:48.091576 3106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:48.091108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.195:47373)
0808 14:36:48.091411 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:48.091472 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":106,"threads_started":1}
I20260808 14:36:48.741457 3108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:48.741025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.193:46321)
0808 14:36:48.741296 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:48.741353 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":99,"threads_started":1}
I20260808 14:36:48.898267 3109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:48.897762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.194:50793)
0808 14:36:48.898084 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:48.898156 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":92,"threads_started":1}
I20260808 14:36:49.093107 3111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:49.092585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.195:53503)
0808 14:36:49.092929 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:49.093000 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":124,"threads_started":1}
I20260808 14:36:49.508011 3112 raft_consensus.cc:482] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:36:49.508158 3112 raft_consensus.cc:504] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dd6aa65308948d3ae52d50a65ac39e0" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45449 } } peers { permanent_uuid: "6a1af82c382d4ba8a05012ff00525198" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 44343 } } peers { permanent_uuid: "68477b24ffc048fea013a7ed5d867784" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 45657 } }
I20260808 14:36:49.508632 3112 leader_election.cc:288] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dd6aa65308948d3ae52d50a65ac39e0 (127.11.131.195:45449), 6a1af82c382d4ba8a05012ff00525198 (127.11.131.194:44343)
W20260808 14:36:49.509500 2395 leader_election.cc:341] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6a1af82c382d4ba8a05012ff00525198 (127.11.131.194:44343): Not found: Tablet not found: 51f011fb45824140adcd95ae08f0dbf5
W20260808 14:36:49.509653 2401 leader_election.cc:341] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8dd6aa65308948d3ae52d50a65ac39e0 (127.11.131.195:45449): Not found: Tablet not found: 51f011fb45824140adcd95ae08f0dbf5
I20260808 14:36:49.509750 2401 leader_election.cc:302] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 68477b24ffc048fea013a7ed5d867784; no voters: 6a1af82c382d4ba8a05012ff00525198, 8dd6aa65308948d3ae52d50a65ac39e0
I20260808 14:36:49.509958 3112 raft_consensus.cc:2726] T 51f011fb45824140adcd95ae08f0dbf5 P 68477b24ffc048fea013a7ed5d867784 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 14:36:49.743167 3113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:49.742583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.193:60537)
0808 14:36:49.742980 (+ 397us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:49.743063 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":133,"threads_started":1}
I20260808 14:36:49.899698 3114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:49.899244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.194:55571)
0808 14:36:49.899536 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:49.899599 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":94,"threads_started":1}
I20260808 14:36:50.077035 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 2323
I20260808 14:36:50.096067 3115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:50.095162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:44663 (local address 127.11.131.195:40905)
0808 14:36:50.095843 (+ 681us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:50.095922 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:44663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":570,"thread_start_us":368,"threads_started":1}
I20260808 14:36:50.107918 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 2577
I20260808 14:36:50.123955 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 2800
2026-08-08T14:36:50Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (19696 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:36:50 dist-test-slave-twwt krb5kdc[3119](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:36:50 dist-test-slave-twwt krb5kdc[3119](info): set up 2 sockets
Aug 08 14:36:50 dist-test-slave-twwt krb5kdc[3119](info): commencing operation
krb5kdc: starting...
W20260808 14:36:51.386118 11791 mini_kdc.cc:121] Time spent starting KDC: real 1.234s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Aug 08 14:36:51 dist-test-slave-twwt krb5kdc[3119](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199811, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:36:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:36:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.131.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
I20260808 14:36:51.520018 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:45813
--webserver_interface=127.11.131.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:36449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:45813
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:36:51.638021 3143 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:51.638271 3143 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:51.638310 3143 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:51.642163 3143 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 14:36:51.642217 3143 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 14:36:51.642234 3143 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 14:36:51.642251 3143 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:36:51.642268 3143 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:51.642287 3143 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:51.642302 3143 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:36:51.642316 3143 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:36:51.647394 3143 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:36449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:45813
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:45813
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.131.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3143
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:36:51.648379 3143 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:51.649353 3143 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:51.658541 3153 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:51.658558 3157 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:51.658563 3154 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:51.658643 3143 server_base.cc:1034] running on GCE node
I20260808 14:36:51.659464 3143 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:51.660594 3143 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:51.661764 3143 hybrid_clock.cc:648] HybridClock initialized: now 1786199811661733 us; error 41 us; skew 500 ppm
Aug 08 14:36:51 dist-test-slave-twwt krb5kdc[3119](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199811, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:51.664740 3143 init.cc:377] Logged in from keytab as kudu/127.11.131.254@KRBTEST.COM (short username kudu)
I20260808 14:36:51.665657 3143 webserver.cc:460] Webserver started at http://127.11.131.254:35871/ using document root <none> and password file <none>
I20260808 14:36:51.666244 3143 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:51.666338 3143 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:51.666584 3143 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:36:51.668766 3143 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/master-0/data/instance:
uuid: "75264d2b77954d589e6d554de0d2df66"
format_stamp: "Formatted at 2026-08-08 14:36:51 on dist-test-slave-twwt"
server_key: "7208582c9e4533aef55d091b3edeb6e3"
server_key_iv: "98ce3ec04f312870b047ba8a5a7201d9"
server_key_version: "encryptionkey@0"
I20260808 14:36:51.669361 3143 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/master-0/wal/instance:
uuid: "75264d2b77954d589e6d554de0d2df66"
format_stamp: "Formatted at 2026-08-08 14:36:51 on dist-test-slave-twwt"
server_key: "7208582c9e4533aef55d091b3edeb6e3"
server_key_iv: "98ce3ec04f312870b047ba8a5a7201d9"
server_key_version: "encryptionkey@0"
I20260808 14:36:51.673229 3143 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 14:36:51.675678 3167 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:51.676939 3143 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 14:36:51.677086 3143 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "75264d2b77954d589e6d554de0d2df66"
format_stamp: "Formatted at 2026-08-08 14:36:51 on dist-test-slave-twwt"
server_key: "7208582c9e4533aef55d091b3edeb6e3"
server_key_iv: "98ce3ec04f312870b047ba8a5a7201d9"
server_key_version: "encryptionkey@0"
I20260808 14:36:51.677201 3143 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:51.695495 3143 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:51.698953 3143 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:51.699163 3143 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:51.706432 3143 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.254:45813
I20260808 14:36:51.706898 3246 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.254:45813 every 8 connection(s)
I20260808 14:36:51.707640 3143 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:36:51.708218 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 3143
I20260808 14:36:51.708361 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/master-0/wal/instance
I20260808 14:36:51.708724 11791 external_mini_cluster.cc:1428] Setting key 58227206b46f1984df77233114f49cc9
I20260808 14:36:51.711079 3247 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:36:51.718005 3247 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66: Bootstrap starting.
Aug 08 14:36:51 dist-test-slave-twwt krb5kdc[3119](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199811, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:36:51.720690 3247 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66: Neither blocks nor log segments found. Creating new log.
I20260808 14:36:51.721493 3247 log.cc:824] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66: Log is configured to *not* fsync() on all Append() calls
I20260808 14:36:51.723691 3247 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66: No bootstrap required, opened a new log
I20260808 14:36:51.724131 3252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:51.710164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52450 (local address 127.11.131.254:45813)
0808 14:36:51.710595 (+ 431us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:51.710642 (+ 47us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:51.710689 (+ 47us) server_negotiation.cc:407] Connection header received
0808 14:36:51.711462 (+ 773us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:51.711482 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:51.711814 (+ 332us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:51.712100 (+ 286us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:51.713041 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:51.714061 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:51.715259 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:51.715741 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:51.715862 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:51.718951 (+ 3089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:51.718958 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:51.718974 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:51.719007 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:51.721024 (+ 2017us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:51.721538 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:51.721544 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:51.721549 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:51.721706 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:51.722041 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:51.722045 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:51.722047 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:51.722482 (+ 435us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:51.722711 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:51.723034 (+ 323us) server_negotiation.cc:299] Negotiation successful
0808 14:36:51.723336 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":283,"thread_start_us":144,"threads_started":1}
I20260808 14:36:51.727587 3247 raft_consensus.cc:348] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75264d2b77954d589e6d554de0d2df66" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 45813 } }
I20260808 14:36:51.727833 3247 raft_consensus.cc:374] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:36:51.727895 3247 raft_consensus.cc:729] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75264d2b77954d589e6d554de0d2df66, State: Initialized, Role: FOLLOWER
I20260808 14:36:51.728320 3247 consensus_queue.cc:260] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75264d2b77954d589e6d554de0d2df66" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 45813 } }
I20260808 14:36:51.728451 3247 raft_consensus.cc:388] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:36:51.728535 3247 raft_consensus.cc:482] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:36:51.728644 3247 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:36:51.729790 3247 raft_consensus.cc:504] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75264d2b77954d589e6d554de0d2df66" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 45813 } }
I20260808 14:36:51.730140 3247 leader_election.cc:302] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 75264d2b77954d589e6d554de0d2df66; no voters:
I20260808 14:36:51.730504 3247 leader_election.cc:288] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:36:51.730700 3257 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:36:51.731002 3257 raft_consensus.cc:686] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66 [term 1 LEADER]: Becoming Leader. State: Replica: 75264d2b77954d589e6d554de0d2df66, State: Running, Role: LEADER
I20260808 14:36:51.731374 3257 consensus_queue.cc:237] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75264d2b77954d589e6d554de0d2df66" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 45813 } }
I20260808 14:36:51.731875 3247 sys_catalog.cc:564] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:36:51.733201 3259 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "75264d2b77954d589e6d554de0d2df66" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75264d2b77954d589e6d554de0d2df66" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 45813 } } }
I20260808 14:36:51.733352 3259 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66 [sys.catalog]: This master's current role is: LEADER
I20260808 14:36:51.733794 3260 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 75264d2b77954d589e6d554de0d2df66. Latest consensus state: current_term: 1 leader_uuid: "75264d2b77954d589e6d554de0d2df66" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75264d2b77954d589e6d554de0d2df66" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 45813 } } }
I20260808 14:36:51.733906 3260 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66 [sys.catalog]: This master's current role is: LEADER
W20260808 14:36:51.737030 3280 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:36:51.737094 3280 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:36:51.737190 3273 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:36:51.738193 3273 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:36:51.744335 3273 catalog_manager.cc:1347] Generated new cluster ID: a3785d2427904f05b2d93c0469db6c96
I20260808 14:36:51.744423 3273 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:36:51.765211 3273 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:36:51.766734 3273 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:36:51.778424 3273 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66: Generated new TSK 0
I20260808 14:36:51.779398 3273 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.131.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab.
Entry for principal kudu/127.11.131.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab.
I20260808 14:36:51.822129 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.193:0
--local_ip_for_outbound_sockets=127.11.131.193
--webserver_interface=127.11.131.193
--webserver_port=0
--tserver_master_addrs=127.11.131.254:45813
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab
--principal=kudu/127.11.131.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:36449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:36:51.941210 3289 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:51.941516 3289 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:51.941612 3289 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:51.945665 3289 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:51.945752 3289 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:51.945848 3289 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.193
I20260808 14:36:51.952721 3289 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:36449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab
--principal=kudu/127.11.131.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.131.193
--webserver_port=0
--tserver_master_addrs=127.11.131.254:45813
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3289
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.193
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:36:51.954172 3289 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:51.955605 3289 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:51.966584 3307 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:51.966567 3301 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:51.966594 3296 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:51.966926 3289 server_base.cc:1034] running on GCE node
I20260808 14:36:51.967378 3289 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:51.967989 3289 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:51.969151 3289 hybrid_clock.cc:648] HybridClock initialized: now 1786199811969135 us; error 46 us; skew 500 ppm
Aug 08 14:36:51 dist-test-slave-twwt krb5kdc[3119](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199811, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:51.972208 3289 init.cc:377] Logged in from keytab as kudu/127.11.131.193@KRBTEST.COM (short username kudu)
I20260808 14:36:51.973181 3289 webserver.cc:460] Webserver started at http://127.11.131.193:41379/ using document root <none> and password file <none>
I20260808 14:36:51.973762 3289 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:51.973825 3289 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:51.974071 3289 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:36:51.976213 3289 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-0/data/instance:
uuid: "16bb053aea7c4ab6b077a408aa7652dd"
format_stamp: "Formatted at 2026-08-08 14:36:51 on dist-test-slave-twwt"
server_key: "1e4210c444e60328885b7a573f9e9d76"
server_key_iv: "acd9120a82b3891d9061714a865f6be6"
server_key_version: "encryptionkey@0"
I20260808 14:36:51.976806 3289 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-0/wal/instance:
uuid: "16bb053aea7c4ab6b077a408aa7652dd"
format_stamp: "Formatted at 2026-08-08 14:36:51 on dist-test-slave-twwt"
server_key: "1e4210c444e60328885b7a573f9e9d76"
server_key_iv: "acd9120a82b3891d9061714a865f6be6"
server_key_version: "encryptionkey@0"
I20260808 14:36:51.980726 3289 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 14:36:51.983557 3318 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:51.984827 3289 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 14:36:51.984952 3289 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-0/wal
uuid: "16bb053aea7c4ab6b077a408aa7652dd"
format_stamp: "Formatted at 2026-08-08 14:36:51 on dist-test-slave-twwt"
server_key: "1e4210c444e60328885b7a573f9e9d76"
server_key_iv: "acd9120a82b3891d9061714a865f6be6"
server_key_version: "encryptionkey@0"
I20260808 14:36:51.985066 3289 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:52.023725 3289 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:52.027118 3289 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:52.027369 3289 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:52.028045 3289 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:36:52.028964 3289 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:36:52.029040 3289 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:52.029119 3289 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:36:52.029163 3289 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:52.039373 3289 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.193:37453
I20260808 14:36:52.039446 3499 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.193:37453 every 8 connection(s)
I20260808 14:36:52.040428 3289 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
I20260808 14:36:52.050659 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 3289
I20260808 14:36:52.050817 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-0/wal/instance
Aug 08 14:36:52 dist-test-slave-twwt krb5kdc[3119](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199811, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.193@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:36:52.051177 11791 external_mini_cluster.cc:1428] Setting key 34683aee6ecc2902a271507d15b4b75c
I20260808 14:36:52.055966 3252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:52.042518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:35945 (local address 127.11.131.254:45813)
0808 14:36:52.042761 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:52.042766 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:52.043656 (+ 890us) server_negotiation.cc:407] Connection header received
0808 14:36:52.045015 (+ 1359us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:52.045018 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:52.045065 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:52.045142 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:52.046491 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:52.047103 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:52.048341 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:52.048564 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:52.048639 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:52.051668 (+ 3029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:52.051672 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:52.051675 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:52.051706 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:52.053668 (+ 1962us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:52.054189 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:52.054203 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:52.054208 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:52.054308 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:52.054747 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:52.054752 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:52.054757 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:52.055030 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:52.055142 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:52.055662 (+ 520us) server_negotiation.cc:299] Negotiation successful
0808 14:36:52.055795 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 14:36:52.056818 3505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:52.042955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.193:35945)
0808 14:36:52.043480 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:52.043527 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:52.044815 (+ 1288us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:52.045378 (+ 563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:52.045386 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:52.045822 (+ 436us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:52.046350 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:52.046366 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:52.047245 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:52.047249 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:52.048224 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:52.048235 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:52.048701 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:52.048704 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:52.048883 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:52.049442 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:52.049460 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:52.051431 (+ 1971us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:52.053791 (+ 2360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:52.053796 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:52.053809 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:52.054085 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:52.054407 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:52.054409 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:52.054410 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:52.054642 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:52.055143 (+ 501us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:52.055149 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:52.055404 (+ 255us) client_negotiation.cc:769] Sending connection context
0808 14:36:52.055604 (+ 200us) client_negotiation.cc:240] Negotiation successful
0808 14:36:52.055958 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":320,"thread_start_us":126,"threads_started":1}
I20260808 14:36:52.058225 3500 heartbeater.cc:347] Connected to a master server at 127.11.131.254:45813
I20260808 14:36:52.058494 3500 heartbeater.cc:464] Registering TS with master...
I20260808 14:36:52.059131 3500 heartbeater.cc:511] Master 127.11.131.254:45813 requested a full tablet report, sending...
I20260808 14:36:52.060706 3192 ts_manager.cc:194] Registered new tserver with Master: 16bb053aea7c4ab6b077a408aa7652dd (127.11.131.193:37453)
I20260808 14:36:52.061852 3192 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.193@KRBTEST.COM'} at 127.11.131.193:35945
WARNING: no policy specified for kudu/127.11.131.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab.
Entry for principal kudu/127.11.131.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab.
I20260808 14:36:52.082327 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.194:0
--local_ip_for_outbound_sockets=127.11.131.194
--webserver_interface=127.11.131.194
--webserver_port=0
--tserver_master_addrs=127.11.131.254:45813
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab
--principal=kudu/127.11.131.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:36449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:36:52.202909 3514 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:52.203207 3514 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:52.203284 3514 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:52.207261 3514 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:52.207348 3514 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:52.207436 3514 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.194
I20260808 14:36:52.212779 3514 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:36449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab
--principal=kudu/127.11.131.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.131.194
--webserver_port=0
--tserver_master_addrs=127.11.131.254:45813
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3514
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.194
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:36:52.213848 3514 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:52.214933 3514 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:52.224907 3531 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:52.224924 3527 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:52.224924 3523 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:52.225085 3514 server_base.cc:1034] running on GCE node
I20260808 14:36:52.225587 3514 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:52.226284 3514 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:52.227481 3514 hybrid_clock.cc:648] HybridClock initialized: now 1786199812227467 us; error 25 us; skew 500 ppm
Aug 08 14:36:52 dist-test-slave-twwt krb5kdc[3119](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199812, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:52.230350 3514 init.cc:377] Logged in from keytab as kudu/127.11.131.194@KRBTEST.COM (short username kudu)
I20260808 14:36:52.231256 3514 webserver.cc:460] Webserver started at http://127.11.131.194:33439/ using document root <none> and password file <none>
I20260808 14:36:52.231889 3514 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:52.231982 3514 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:52.232158 3514 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:36:52.234503 3514 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-1/data/instance:
uuid: "299eed87e3fb4bbb9c07f298376f5b84"
format_stamp: "Formatted at 2026-08-08 14:36:52 on dist-test-slave-twwt"
server_key: "963a03d113a4f8c2a74ec1c7109c15b8"
server_key_iv: "62c68b88f904168ca405998501b11e5f"
server_key_version: "encryptionkey@0"
I20260808 14:36:52.235137 3514 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-1/wal/instance:
uuid: "299eed87e3fb4bbb9c07f298376f5b84"
format_stamp: "Formatted at 2026-08-08 14:36:52 on dist-test-slave-twwt"
server_key: "963a03d113a4f8c2a74ec1c7109c15b8"
server_key_iv: "62c68b88f904168ca405998501b11e5f"
server_key_version: "encryptionkey@0"
I20260808 14:36:52.238844 3514 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 14:36:52.241159 3543 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:52.242367 3514 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 14:36:52.242465 3514 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-1/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-1/wal
uuid: "299eed87e3fb4bbb9c07f298376f5b84"
format_stamp: "Formatted at 2026-08-08 14:36:52 on dist-test-slave-twwt"
server_key: "963a03d113a4f8c2a74ec1c7109c15b8"
server_key_iv: "62c68b88f904168ca405998501b11e5f"
server_key_version: "encryptionkey@0"
I20260808 14:36:52.242552 3514 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:52.260591 3514 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:52.263545 3514 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:52.263702 3514 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:52.264262 3514 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:36:52.265079 3514 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:36:52.265128 3514 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:52.265169 3514 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:36:52.265188 3514 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:52.274333 3514 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.194:34113
I20260808 14:36:52.274376 3714 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.194:34113 every 8 connection(s)
I20260808 14:36:52.275328 3514 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
I20260808 14:36:52.280323 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 3514
I20260808 14:36:52.280474 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-1/wal/instance
I20260808 14:36:52.280819 11791 external_mini_cluster.cc:1428] Setting key bc1029fb398ed2e88d64ebed3ab63f92
Aug 08 14:36:52 dist-test-slave-twwt krb5kdc[3119](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199812, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.194@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:36:52.291639 3252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:52.277203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:33495 (local address 127.11.131.254:45813)
0808 14:36:52.277356 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:52.277360 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:52.278262 (+ 902us) server_negotiation.cc:407] Connection header received
0808 14:36:52.279703 (+ 1441us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:52.279706 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:52.279755 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:52.279834 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:52.281540 (+ 1706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:52.282248 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:52.283722 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:52.284124 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:52.284254 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:52.287202 (+ 2948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:52.287210 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:52.287216 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:52.287253 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:52.289194 (+ 1941us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:52.289839 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:52.289846 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:52.289849 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:52.289963 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:52.290333 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:52.290338 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:52.290342 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:52.290597 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:52.290722 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:52.291267 (+ 545us) server_negotiation.cc:299] Negotiation successful
0808 14:36:52.291438 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 14:36:52.292490 3720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:52.277579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.194:33495)
0808 14:36:52.278054 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:52.278133 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:52.279496 (+ 1363us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:52.280043 (+ 547us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:52.280053 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:52.280634 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:52.281393 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:52.281413 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:52.282413 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:52.282417 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:52.283568 (+ 1151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:52.283581 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:52.284304 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:52.284307 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:52.284471 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:52.285239 (+ 768us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:52.285259 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:52.287010 (+ 1751us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:52.289346 (+ 2336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:52.289352 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:52.289367 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:52.289706 (+ 339us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:52.290070 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:52.290073 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:52.290074 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:52.290216 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:52.290730 (+ 514us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:52.290736 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:52.290987 (+ 251us) client_negotiation.cc:769] Sending connection context
0808 14:36:52.291151 (+ 164us) client_negotiation.cc:240] Negotiation successful
0808 14:36:52.291497 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":107,"threads_started":1}
WARNING: no policy specified for kudu/127.11.131.195@KRBTEST.COM; defaulting to no policy
I20260808 14:36:52.293792 3716 heartbeater.cc:347] Connected to a master server at 127.11.131.254:45813
I20260808 14:36:52.294113 3716 heartbeater.cc:464] Registering TS with master...
I20260808 14:36:52.294724 3716 heartbeater.cc:511] Master 127.11.131.254:45813 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.195@KRBTEST.COM" created.
I20260808 14:36:52.296154 3192 ts_manager.cc:194] Registered new tserver with Master: 299eed87e3fb4bbb9c07f298376f5b84 (127.11.131.194:34113)
I20260808 14:36:52.296811 3192 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.194@KRBTEST.COM'} at 127.11.131.194:33495
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab.
Entry for principal kudu/127.11.131.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab.
I20260808 14:36:52.314255 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.195:0
--local_ip_for_outbound_sockets=127.11.131.195
--webserver_interface=127.11.131.195
--webserver_port=0
--tserver_master_addrs=127.11.131.254:45813
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab
--principal=kudu/127.11.131.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:36449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:36:52.434216 3723 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:36:52.434501 3723 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:36:52.434588 3723 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:36:52.438529 3723 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:36:52.438625 3723 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:36:52.438779 3723 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.195
I20260808 14:36:52.443955 3723 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:36449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab
--principal=kudu/127.11.131.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.131.195
--webserver_port=0
--tserver_master_addrs=127.11.131.254:45813
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3723
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.195
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:36:52.444963 3723 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:36:52.446025 3723 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:36:52.455838 3731 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:36:52.455864 3728 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:52.455922 3723 server_base.cc:1034] running on GCE node
W20260808 14:36:52.455847 3729 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:36:52.456494 3723 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:36:52.457105 3723 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:36:52.458287 3723 hybrid_clock.cc:648] HybridClock initialized: now 1786199812458254 us; error 44 us; skew 500 ppm
Aug 08 14:36:52 dist-test-slave-twwt krb5kdc[3119](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199812, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:36:52.461618 3723 init.cc:377] Logged in from keytab as kudu/127.11.131.195@KRBTEST.COM (short username kudu)
I20260808 14:36:52.462538 3723 webserver.cc:460] Webserver started at http://127.11.131.195:44673/ using document root <none> and password file <none>
I20260808 14:36:52.463228 3723 fs_manager.cc:359] Metadata directory not provided
I20260808 14:36:52.463299 3723 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:36:52.463486 3723 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:36:52.465677 3723 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-2/data/instance:
uuid: "4caa5f5b9ece4d528143a7f95f85fd6c"
format_stamp: "Formatted at 2026-08-08 14:36:52 on dist-test-slave-twwt"
server_key: "986d4cde850005d5f2fd43887ef845e7"
server_key_iv: "8c8938bdd7f55337686264bf61409113"
server_key_version: "encryptionkey@0"
I20260808 14:36:52.466279 3723 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-2/wal/instance:
uuid: "4caa5f5b9ece4d528143a7f95f85fd6c"
format_stamp: "Formatted at 2026-08-08 14:36:52 on dist-test-slave-twwt"
server_key: "986d4cde850005d5f2fd43887ef845e7"
server_key_iv: "8c8938bdd7f55337686264bf61409113"
server_key_version: "encryptionkey@0"
I20260808 14:36:52.470510 3723 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.001s
I20260808 14:36:52.473356 3743 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:52.475211 3723 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:36:52.475373 3723 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-2/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-2/wal
uuid: "4caa5f5b9ece4d528143a7f95f85fd6c"
format_stamp: "Formatted at 2026-08-08 14:36:52 on dist-test-slave-twwt"
server_key: "986d4cde850005d5f2fd43887ef845e7"
server_key_iv: "8c8938bdd7f55337686264bf61409113"
server_key_version: "encryptionkey@0"
I20260808 14:36:52.475510 3723 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:36:52.487708 3723 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:36:52.491568 3723 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:36:52.491806 3723 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:36:52.492476 3723 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:36:52.493417 3723 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:36:52.493500 3723 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:52.493602 3723 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:36:52.493661 3723 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:36:52.504285 3723 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.195:45767
I20260808 14:36:52.504403 3926 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.195:45767 every 8 connection(s)
I20260808 14:36:52.505498 3723 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
I20260808 14:36:52.511981 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 3723
I20260808 14:36:52.512125 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-2/wal/instance
I20260808 14:36:52.512516 11791 external_mini_cluster.cc:1428] Setting key b24766f4af2a2fffd8d769a254d26fcd
Aug 08 14:36:52 dist-test-slave-twwt krb5kdc[3119](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199812, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.195@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:36:52.520373 3252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:52.507552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:46359 (local address 127.11.131.254:45813)
0808 14:36:52.507715 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:52.507720 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:52.508773 (+ 1053us) server_negotiation.cc:407] Connection header received
0808 14:36:52.510124 (+ 1351us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:52.510127 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:52.510179 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:52.510264 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:52.511501 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:52.512256 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:52.513755 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:52.514042 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:52.514124 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:52.516802 (+ 2678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:52.516805 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:52.516807 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:52.516834 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:52.518459 (+ 1625us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:52.518987 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:52.518990 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:52.518991 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:52.519073 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:52.519390 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:52.519392 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:52.519393 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:52.519574 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:52.519656 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:52.520129 (+ 473us) server_negotiation.cc:299] Negotiation successful
0808 14:36:52.520245 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 14:36:52.521194 3933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:52.508059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.195:46359)
0808 14:36:52.508618 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:52.508665 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:52.509917 (+ 1252us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:52.510447 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:52.510454 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:52.510851 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:36:52.511335 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:52.511348 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:52.512412 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:52.512416 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:52.513606 (+ 1190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:52.513618 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:52.514176 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:52.514180 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:52.514369 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:52.515066 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:36:52.515082 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:36:52.516633 (+ 1551us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:36:52.518562 (+ 1929us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:52.518566 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:52.518577 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:52.518874 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:52.519163 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:36:52.519165 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:36:52.519167 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:36:52.519296 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:36:52.519666 (+ 370us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:36:52.519671 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:36:52.519892 (+ 221us) client_negotiation.cc:769] Sending connection context
0808 14:36:52.520051 (+ 159us) client_negotiation.cc:240] Negotiation successful
0808 14:36:52.520292 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":131,"threads_started":1}
I20260808 14:36:52.522322 3927 heartbeater.cc:347] Connected to a master server at 127.11.131.254:45813
I20260808 14:36:52.522580 3927 heartbeater.cc:464] Registering TS with master...
I20260808 14:36:52.523139 3927 heartbeater.cc:511] Master 127.11.131.254:45813 requested a full tablet report, sending...
I20260808 14:36:52.524195 3192 ts_manager.cc:194] Registered new tserver with Master: 4caa5f5b9ece4d528143a7f95f85fd6c (127.11.131.195:45767)
I20260808 14:36:52.524763 3192 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.195@KRBTEST.COM'} at 127.11.131.195:46359
I20260808 14:36:52.526594 11791 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:36:52.536309 3252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:52.528751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56270 (local address 127.11.131.254:45813)
0808 14:36:52.528872 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:52.528876 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:52.529038 (+ 162us) server_negotiation.cc:407] Connection header received
0808 14:36:52.529125 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:52.529127 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:52.529165 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:52.529244 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:36:52.529920 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:52.530432 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:52.531347 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:52.531605 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:52.531747 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:52.533237 (+ 1490us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:36:52.533240 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:36:52.533242 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:36:52.533265 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:36:52.534871 (+ 1606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:52.535249 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:52.535252 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:52.535253 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:52.535330 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:36:52.535566 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:36:52.535568 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:36:52.535569 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:36:52.535779 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:36:52.535907 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:52.536083 (+ 176us) server_negotiation.cc:299] Negotiation successful
0808 14:36:52.536185 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 14:36:52.539294 3192 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56270:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:36:52.542420 3192 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:36:52.557897 3947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:52.551389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:37453 (local address 127.0.0.1:33052)
0808 14:36:52.551988 (+ 599us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:52.552043 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:52.552182 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:52.553343 (+ 1161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:52.553350 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:52.553379 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:36:52.553564 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:52.553571 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:52.555116 (+ 1545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:52.555119 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:52.556266 (+ 1147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:52.556276 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:52.557212 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:52.557215 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:52.557379 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:52.557447 (+ 68us) client_negotiation.cc:769] Sending connection context
0808 14:36:52.557575 (+ 128us) client_negotiation.cc:240] Negotiation successful
0808 14:36:52.557707 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":472,"mutex_wait_us":115,"spinlock_wait_cycles":8064,"thread_start_us":98,"threads_started":1}
I20260808 14:36:52.557904 3949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:52.552053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33052 (local address 127.11.131.193:37453)
0808 14:36:52.552796 (+ 743us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:52.552815 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:52.552842 (+ 27us) server_negotiation.cc:407] Connection header received
0808 14:36:52.552928 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:52.552936 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:52.553166 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:52.553335 (+ 169us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:36:52.553706 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:52.554965 (+ 1259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:52.556404 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:52.557088 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:52.557219 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:52.557359 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:52.557615 (+ 256us) server_negotiation.cc:299] Negotiation successful
0808 14:36:52.557716 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":585,"thread_start_us":99,"threads_started":1}
I20260808 14:36:52.558840 3945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:52.551138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.195:45767 (local address 127.0.0.1:34600)
0808 14:36:52.551988 (+ 850us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:52.552043 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:52.552182 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:52.553772 (+ 1590us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:52.553775 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:52.553792 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:36:52.553874 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:52.553878 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:52.555146 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:52.555152 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:52.556745 (+ 1593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:52.556753 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:52.558391 (+ 1638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:52.558395 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:52.558492 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:52.558519 (+ 27us) client_negotiation.cc:769] Sending connection context
0808 14:36:52.558569 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 14:36:52.558680 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":658,"mutex_wait_us":129,"spinlock_wait_cycles":2688,"thread_start_us":83,"threads_started":1}
I20260808 14:36:52.559316 3948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:52.551596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.194:34113 (local address 127.0.0.1:33080)
0808 14:36:52.552914 (+ 1318us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:52.552928 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:52.553022 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:52.553477 (+ 455us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:52.553480 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:52.553494 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:36:52.553669 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:52.553681 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:52.555116 (+ 1435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:52.555119 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:52.556741 (+ 1622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:52.556753 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:52.558791 (+ 2038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:52.558797 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:52.558901 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:52.559046 (+ 145us) client_negotiation.cc:769] Sending connection context
0808 14:36:52.559112 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 14:36:52.559185 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1242,"mutex_wait_us":232,"thread_start_us":90,"threads_started":1}
I20260808 14:36:52.559509 3950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:52.552434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33080 (local address 127.11.131.194:34113)
0808 14:36:52.552785 (+ 351us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:52.552796 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:52.553012 (+ 216us) server_negotiation.cc:407] Connection header received
0808 14:36:52.553121 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:52.553125 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:52.553300 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:52.553588 (+ 288us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:36:52.553765 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:52.554952 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:52.556884 (+ 1932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:52.557740 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:52.558802 (+ 1062us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:52.559071 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:52.559143 (+ 72us) server_negotiation.cc:299] Negotiation successful
0808 14:36:52.559238 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":225,"thread_start_us":128,"threads_started":1}
I20260808 14:36:52.559563 3946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:52.551265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34600 (local address 127.11.131.195:45767)
0808 14:36:52.553298 (+ 2033us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:52.553310 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:52.553331 (+ 21us) server_negotiation.cc:407] Connection header received
0808 14:36:52.553407 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:52.553412 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:52.553612 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:52.553995 (+ 383us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:36:52.554113 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:52.554992 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:52.557441 (+ 2449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:52.558257 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:52.559161 (+ 904us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:52.559277 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:52.559325 (+ 48us) server_negotiation.cc:299] Negotiation successful
0808 14:36:52.559416 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1908,"thread_start_us":182,"threads_started":1}
I20260808 14:36:52.561359 3403 tablet_service.cc:1467] Processing CreateTablet for tablet b1399e7d6bf349ea9ccbee679f32f07d (DEFAULT_TABLE table=test-table [id=422f9188c3cf493eb73f0903d0329000]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:36:52.562644 3403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1399e7d6bf349ea9ccbee679f32f07d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:36:52.562363 3812 tablet_service.cc:1467] Processing CreateTablet for tablet b1399e7d6bf349ea9ccbee679f32f07d (DEFAULT_TABLE table=test-table [id=422f9188c3cf493eb73f0903d0329000]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:36:52.562433 3612 tablet_service.cc:1467] Processing CreateTablet for tablet b1399e7d6bf349ea9ccbee679f32f07d (DEFAULT_TABLE table=test-table [id=422f9188c3cf493eb73f0903d0329000]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:36:52.563448 3612 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1399e7d6bf349ea9ccbee679f32f07d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:36:52.563491 3812 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1399e7d6bf349ea9ccbee679f32f07d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:36:52.571573 3955 tablet_bootstrap.cc:492] T b1399e7d6bf349ea9ccbee679f32f07d P 4caa5f5b9ece4d528143a7f95f85fd6c: Bootstrap starting.
I20260808 14:36:52.572203 3952 tablet_bootstrap.cc:492] T b1399e7d6bf349ea9ccbee679f32f07d P 16bb053aea7c4ab6b077a408aa7652dd: Bootstrap starting.
I20260808 14:36:52.572944 3951 tablet_bootstrap.cc:492] T b1399e7d6bf349ea9ccbee679f32f07d P 299eed87e3fb4bbb9c07f298376f5b84: Bootstrap starting.
I20260808 14:36:52.574162 3955 tablet_bootstrap.cc:654] T b1399e7d6bf349ea9ccbee679f32f07d P 4caa5f5b9ece4d528143a7f95f85fd6c: Neither blocks nor log segments found. Creating new log.
I20260808 14:36:52.574713 3952 tablet_bootstrap.cc:654] T b1399e7d6bf349ea9ccbee679f32f07d P 16bb053aea7c4ab6b077a408aa7652dd: Neither blocks nor log segments found. Creating new log.
I20260808 14:36:52.575685 3952 log.cc:824] T b1399e7d6bf349ea9ccbee679f32f07d P 16bb053aea7c4ab6b077a408aa7652dd: Log is configured to *not* fsync() on all Append() calls
I20260808 14:36:52.575685 3955 log.cc:824] T b1399e7d6bf349ea9ccbee679f32f07d P 4caa5f5b9ece4d528143a7f95f85fd6c: Log is configured to *not* fsync() on all Append() calls
I20260808 14:36:52.576347 3951 tablet_bootstrap.cc:654] T b1399e7d6bf349ea9ccbee679f32f07d P 299eed87e3fb4bbb9c07f298376f5b84: Neither blocks nor log segments found. Creating new log.
I20260808 14:36:52.578042 3951 log.cc:824] T b1399e7d6bf349ea9ccbee679f32f07d P 299eed87e3fb4bbb9c07f298376f5b84: Log is configured to *not* fsync() on all Append() calls
I20260808 14:36:52.579370 3952 tablet_bootstrap.cc:492] T b1399e7d6bf349ea9ccbee679f32f07d P 16bb053aea7c4ab6b077a408aa7652dd: No bootstrap required, opened a new log
I20260808 14:36:52.579385 3955 tablet_bootstrap.cc:492] T b1399e7d6bf349ea9ccbee679f32f07d P 4caa5f5b9ece4d528143a7f95f85fd6c: No bootstrap required, opened a new log
I20260808 14:36:52.579596 3952 ts_tablet_manager.cc:1397] T b1399e7d6bf349ea9ccbee679f32f07d P 16bb053aea7c4ab6b077a408aa7652dd: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260808 14:36:52.580077 3955 ts_tablet_manager.cc:1397] T b1399e7d6bf349ea9ccbee679f32f07d P 4caa5f5b9ece4d528143a7f95f85fd6c: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260808 14:36:52.581072 3951 tablet_bootstrap.cc:492] T b1399e7d6bf349ea9ccbee679f32f07d P 299eed87e3fb4bbb9c07f298376f5b84: No bootstrap required, opened a new log
I20260808 14:36:52.581279 3951 ts_tablet_manager.cc:1397] T b1399e7d6bf349ea9ccbee679f32f07d P 299eed87e3fb4bbb9c07f298376f5b84: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260808 14:36:52.584218 3955 raft_consensus.cc:348] T b1399e7d6bf349ea9ccbee679f32f07d P 4caa5f5b9ece4d528143a7f95f85fd6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4caa5f5b9ece4d528143a7f95f85fd6c" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45767 } } peers { permanent_uuid: "16bb053aea7c4ab6b077a408aa7652dd" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 37453 } } peers { permanent_uuid: "299eed87e3fb4bbb9c07f298376f5b84" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 34113 } }
I20260808 14:36:52.584256 3951 raft_consensus.cc:348] T b1399e7d6bf349ea9ccbee679f32f07d P 299eed87e3fb4bbb9c07f298376f5b84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4caa5f5b9ece4d528143a7f95f85fd6c" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45767 } } peers { permanent_uuid: "16bb053aea7c4ab6b077a408aa7652dd" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 37453 } } peers { permanent_uuid: "299eed87e3fb4bbb9c07f298376f5b84" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 34113 } }
I20260808 14:36:52.584546 3951 raft_consensus.cc:374] T b1399e7d6bf349ea9ccbee679f32f07d P 299eed87e3fb4bbb9c07f298376f5b84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:36:52.584546 3955 raft_consensus.cc:374] T b1399e7d6bf349ea9ccbee679f32f07d P 4caa5f5b9ece4d528143a7f95f85fd6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:36:52.584599 3951 raft_consensus.cc:729] T b1399e7d6bf349ea9ccbee679f32f07d P 299eed87e3fb4bbb9c07f298376f5b84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 299eed87e3fb4bbb9c07f298376f5b84, State: Initialized, Role: FOLLOWER
I20260808 14:36:52.584604 3955 raft_consensus.cc:729] T b1399e7d6bf349ea9ccbee679f32f07d P 4caa5f5b9ece4d528143a7f95f85fd6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4caa5f5b9ece4d528143a7f95f85fd6c, State: Initialized, Role: FOLLOWER
I20260808 14:36:52.584887 3952 raft_consensus.cc:348] T b1399e7d6bf349ea9ccbee679f32f07d P 16bb053aea7c4ab6b077a408aa7652dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4caa5f5b9ece4d528143a7f95f85fd6c" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45767 } } peers { permanent_uuid: "16bb053aea7c4ab6b077a408aa7652dd" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 37453 } } peers { permanent_uuid: "299eed87e3fb4bbb9c07f298376f5b84" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 34113 } }
I20260808 14:36:52.585134 3952 raft_consensus.cc:374] T b1399e7d6bf349ea9ccbee679f32f07d P 16bb053aea7c4ab6b077a408aa7652dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:36:52.585091 3955 consensus_queue.cc:260] T b1399e7d6bf349ea9ccbee679f32f07d P 4caa5f5b9ece4d528143a7f95f85fd6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4caa5f5b9ece4d528143a7f95f85fd6c" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45767 } } peers { permanent_uuid: "16bb053aea7c4ab6b077a408aa7652dd" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 37453 } } peers { permanent_uuid: "299eed87e3fb4bbb9c07f298376f5b84" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 34113 } }
I20260808 14:36:52.585183 3952 raft_consensus.cc:729] T b1399e7d6bf349ea9ccbee679f32f07d P 16bb053aea7c4ab6b077a408aa7652dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16bb053aea7c4ab6b077a408aa7652dd, State: Initialized, Role: FOLLOWER
I20260808 14:36:52.585093 3951 consensus_queue.cc:260] T b1399e7d6bf349ea9ccbee679f32f07d P 299eed87e3fb4bbb9c07f298376f5b84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4caa5f5b9ece4d528143a7f95f85fd6c" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45767 } } peers { permanent_uuid: "16bb053aea7c4ab6b077a408aa7652dd" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 37453 } } peers { permanent_uuid: "299eed87e3fb4bbb9c07f298376f5b84" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 34113 } }
I20260808 14:36:52.585580 3952 consensus_queue.cc:260] T b1399e7d6bf349ea9ccbee679f32f07d P 16bb053aea7c4ab6b077a408aa7652dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4caa5f5b9ece4d528143a7f95f85fd6c" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45767 } } peers { permanent_uuid: "16bb053aea7c4ab6b077a408aa7652dd" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 37453 } } peers { permanent_uuid: "299eed87e3fb4bbb9c07f298376f5b84" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 34113 } }
I20260808 14:36:52.586123 3955 ts_tablet_manager.cc:1428] T b1399e7d6bf349ea9ccbee679f32f07d P 4caa5f5b9ece4d528143a7f95f85fd6c: Time spent starting tablet: real 0.006s user 0.001s sys 0.004s
I20260808 14:36:52.586294 3500 heartbeater.cc:503] Master 127.11.131.254:45813 was elected leader, sending a full tablet report...
I20260808 14:36:52.586437 3952 ts_tablet_manager.cc:1428] T b1399e7d6bf349ea9ccbee679f32f07d P 16bb053aea7c4ab6b077a408aa7652dd: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260808 14:36:52.586488 3927 heartbeater.cc:503] Master 127.11.131.254:45813 was elected leader, sending a full tablet report...
I20260808 14:36:52.586125 3951 ts_tablet_manager.cc:1428] T b1399e7d6bf349ea9ccbee679f32f07d P 299eed87e3fb4bbb9c07f298376f5b84: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260808 14:36:52.587005 3716 heartbeater.cc:503] Master 127.11.131.254:45813 was elected leader, sending a full tablet report...
I20260808 14:36:52.682183 3964 raft_consensus.cc:482] T b1399e7d6bf349ea9ccbee679f32f07d P 16bb053aea7c4ab6b077a408aa7652dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:36:52.682474 3964 raft_consensus.cc:504] T b1399e7d6bf349ea9ccbee679f32f07d P 16bb053aea7c4ab6b077a408aa7652dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4caa5f5b9ece4d528143a7f95f85fd6c" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45767 } } peers { permanent_uuid: "16bb053aea7c4ab6b077a408aa7652dd" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 37453 } } peers { permanent_uuid: "299eed87e3fb4bbb9c07f298376f5b84" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 34113 } }
I20260808 14:36:52.683753 3964 leader_election.cc:288] T b1399e7d6bf349ea9ccbee679f32f07d P 16bb053aea7c4ab6b077a408aa7652dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4caa5f5b9ece4d528143a7f95f85fd6c (127.11.131.195:45767), 299eed87e3fb4bbb9c07f298376f5b84 (127.11.131.194:34113)
I20260808 14:36:52.687945 3946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:52.684333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:44313 (local address 127.11.131.195:45767)
0808 14:36:52.684462 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:52.684467 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:52.684529 (+ 62us) server_negotiation.cc:407] Connection header received
0808 14:36:52.684726 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:52.684729 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:52.684774 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:52.684872 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:36:52.685170 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:52.685693 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:52.686892 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:52.687305 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:52.687451 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:52.687510 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:52.687734 (+ 224us) server_negotiation.cc:299] Negotiation successful
0808 14:36:52.687811 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 14:36:52.687960 3950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:52.684161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:49983 (local address 127.11.131.194:34113)
0808 14:36:52.684305 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:52.684310 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:52.684628 (+ 318us) server_negotiation.cc:407] Connection header received
0808 14:36:52.684793 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:52.684797 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:52.684853 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:52.684943 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:36:52.685240 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:52.685735 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:52.686909 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:52.687322 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:52.687466 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:52.687526 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:52.687758 (+ 232us) server_negotiation.cc:299] Negotiation successful
0808 14:36:52.687837 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 14:36:52.687973 3965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:52.684041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.195:45767 (local address 127.11.131.193:44313)
0808 14:36:52.684451 (+ 410us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:52.684464 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:52.684572 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:52.684897 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:52.684900 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:52.684917 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:36:52.685051 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:52.685057 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:52.685807 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:52.685813 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:52.686752 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:52.686763 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:52.687446 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:52.687449 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:52.687604 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:52.687626 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 14:36:52.687715 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 14:36:52.687789 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":336,"mutex_wait_us":65,"thread_start_us":131,"threads_started":1}
I20260808 14:36:52.687979 3966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:52.684040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.194:34113 (local address 127.11.131.193:49983)
0808 14:36:52.684527 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:52.684543 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:36:52.684666 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:36:52.684958 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:36:52.684961 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:36:52.684977 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:36:52.685115 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:52.685120 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:52.685851 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:52.685855 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:52.686779 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:36:52.686789 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:36:52.687459 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:36:52.687462 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:36:52.687629 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:52.687648 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 14:36:52.687737 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 14:36:52.687806 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":415,"mutex_wait_us":55,"thread_start_us":120,"threads_started":1}
I20260808 14:36:52.688760 3852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1399e7d6bf349ea9ccbee679f32f07d" candidate_uuid: "16bb053aea7c4ab6b077a408aa7652dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4caa5f5b9ece4d528143a7f95f85fd6c" is_pre_election: true
I20260808 14:36:52.689143 3852 raft_consensus.cc:2454] T b1399e7d6bf349ea9ccbee679f32f07d P 4caa5f5b9ece4d528143a7f95f85fd6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16bb053aea7c4ab6b077a408aa7652dd in term 0.
I20260808 14:36:52.689159 3642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1399e7d6bf349ea9ccbee679f32f07d" candidate_uuid: "16bb053aea7c4ab6b077a408aa7652dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "299eed87e3fb4bbb9c07f298376f5b84" is_pre_election: true
I20260808 14:36:52.689522 3642 raft_consensus.cc:2454] T b1399e7d6bf349ea9ccbee679f32f07d P 299eed87e3fb4bbb9c07f298376f5b84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16bb053aea7c4ab6b077a408aa7652dd in term 0.
I20260808 14:36:52.690063 3324 leader_election.cc:302] T b1399e7d6bf349ea9ccbee679f32f07d P 16bb053aea7c4ab6b077a408aa7652dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 16bb053aea7c4ab6b077a408aa7652dd, 299eed87e3fb4bbb9c07f298376f5b84, 4caa5f5b9ece4d528143a7f95f85fd6c; no voters:
I20260808 14:36:52.690371 3964 raft_consensus.cc:2781] T b1399e7d6bf349ea9ccbee679f32f07d P 16bb053aea7c4ab6b077a408aa7652dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:36:52.690459 3964 raft_consensus.cc:482] T b1399e7d6bf349ea9ccbee679f32f07d P 16bb053aea7c4ab6b077a408aa7652dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:36:52.690510 3964 raft_consensus.cc:3037] T b1399e7d6bf349ea9ccbee679f32f07d P 16bb053aea7c4ab6b077a408aa7652dd [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:36:52.691645 3964 raft_consensus.cc:504] T b1399e7d6bf349ea9ccbee679f32f07d P 16bb053aea7c4ab6b077a408aa7652dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4caa5f5b9ece4d528143a7f95f85fd6c" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45767 } } peers { permanent_uuid: "16bb053aea7c4ab6b077a408aa7652dd" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 37453 } } peers { permanent_uuid: "299eed87e3fb4bbb9c07f298376f5b84" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 34113 } }
I20260808 14:36:52.692008 3964 leader_election.cc:288] T b1399e7d6bf349ea9ccbee679f32f07d P 16bb053aea7c4ab6b077a408aa7652dd [CANDIDATE]: Term 1 election: Requested vote from peers 4caa5f5b9ece4d528143a7f95f85fd6c (127.11.131.195:45767), 299eed87e3fb4bbb9c07f298376f5b84 (127.11.131.194:34113)
I20260808 14:36:52.692377 3642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1399e7d6bf349ea9ccbee679f32f07d" candidate_uuid: "16bb053aea7c4ab6b077a408aa7652dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "299eed87e3fb4bbb9c07f298376f5b84"
I20260808 14:36:52.692514 3642 raft_consensus.cc:3037] T b1399e7d6bf349ea9ccbee679f32f07d P 299eed87e3fb4bbb9c07f298376f5b84 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:36:52.692564 3852 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1399e7d6bf349ea9ccbee679f32f07d" candidate_uuid: "16bb053aea7c4ab6b077a408aa7652dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4caa5f5b9ece4d528143a7f95f85fd6c"
I20260808 14:36:52.692692 3852 raft_consensus.cc:3037] T b1399e7d6bf349ea9ccbee679f32f07d P 4caa5f5b9ece4d528143a7f95f85fd6c [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:36:52.693990 3852 raft_consensus.cc:2454] T b1399e7d6bf349ea9ccbee679f32f07d P 4caa5f5b9ece4d528143a7f95f85fd6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16bb053aea7c4ab6b077a408aa7652dd in term 1.
I20260808 14:36:52.693990 3642 raft_consensus.cc:2454] T b1399e7d6bf349ea9ccbee679f32f07d P 299eed87e3fb4bbb9c07f298376f5b84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16bb053aea7c4ab6b077a408aa7652dd in term 1.
I20260808 14:36:52.694331 3322 leader_election.cc:302] T b1399e7d6bf349ea9ccbee679f32f07d P 16bb053aea7c4ab6b077a408aa7652dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16bb053aea7c4ab6b077a408aa7652dd, 299eed87e3fb4bbb9c07f298376f5b84; no voters:
I20260808 14:36:52.694545 3964 raft_consensus.cc:2781] T b1399e7d6bf349ea9ccbee679f32f07d P 16bb053aea7c4ab6b077a408aa7652dd [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:36:52.694821 3964 raft_consensus.cc:686] T b1399e7d6bf349ea9ccbee679f32f07d P 16bb053aea7c4ab6b077a408aa7652dd [term 1 LEADER]: Becoming Leader. State: Replica: 16bb053aea7c4ab6b077a408aa7652dd, State: Running, Role: LEADER
I20260808 14:36:52.695173 3964 consensus_queue.cc:237] T b1399e7d6bf349ea9ccbee679f32f07d P 16bb053aea7c4ab6b077a408aa7652dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4caa5f5b9ece4d528143a7f95f85fd6c" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45767 } } peers { permanent_uuid: "16bb053aea7c4ab6b077a408aa7652dd" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 37453 } } peers { permanent_uuid: "299eed87e3fb4bbb9c07f298376f5b84" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 34113 } }
I20260808 14:36:52.698513 3191 catalog_manager.cc:5495] T b1399e7d6bf349ea9ccbee679f32f07d P 16bb053aea7c4ab6b077a408aa7652dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 16bb053aea7c4ab6b077a408aa7652dd (127.11.131.193). New cstate: current_term: 1 leader_uuid: "16bb053aea7c4ab6b077a408aa7652dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4caa5f5b9ece4d528143a7f95f85fd6c" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16bb053aea7c4ab6b077a408aa7652dd" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 37453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "299eed87e3fb4bbb9c07f298376f5b84" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 34113 } health_report { overall_health: UNKNOWN } } }
I20260808 14:36:52.714866 3949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:52.710709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33064 (local address 127.11.131.193:37453)
0808 14:36:52.710834 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0808 14:36:52.710839 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:36:52.710852 (+ 13us) server_negotiation.cc:407] Connection header received
0808 14:36:52.710996 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:36:52.710999 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:36:52.711056 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:36:52.711141 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:36:52.711413 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:52.711959 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:52.713186 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:36:52.713423 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:36:52.713514 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:36:52.713868 (+ 354us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:36:52.714320 (+ 452us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:36:52.714426 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 14:36:52.714562 (+ 136us) server_negotiation.cc:299] Negotiation successful
0808 14:36:52.714694 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 14:36:52.721412 3642 raft_consensus.cc:1261] T b1399e7d6bf349ea9ccbee679f32f07d P 299eed87e3fb4bbb9c07f298376f5b84 [term 1 FOLLOWER]: Refusing update from remote peer 16bb053aea7c4ab6b077a408aa7652dd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:36:52.721443 3852 raft_consensus.cc:1261] T b1399e7d6bf349ea9ccbee679f32f07d P 4caa5f5b9ece4d528143a7f95f85fd6c [term 1 FOLLOWER]: Refusing update from remote peer 16bb053aea7c4ab6b077a408aa7652dd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:36:52.722224 3968 consensus_queue.cc:1035] T b1399e7d6bf349ea9ccbee679f32f07d P 16bb053aea7c4ab6b077a408aa7652dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "4caa5f5b9ece4d528143a7f95f85fd6c" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:36:52.722429 3964 consensus_queue.cc:1035] T b1399e7d6bf349ea9ccbee679f32f07d P 16bb053aea7c4ab6b077a408aa7652dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "299eed87e3fb4bbb9c07f298376f5b84" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 34113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:36:52.731338 3977 mvcc.cc:205] Tried to move back new op lower bound from 7316274432898994176 to 7316274432802222080. Current Snapshot: MvccSnapshot[applied={T|T < 7316274432898994176}]
I20260808 14:36:52.739730 3192 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56270:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:36:52.739902 3192 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56270:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:36:52.742460 3192 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66: Sending DeleteTablet for 3 replicas of tablet b1399e7d6bf349ea9ccbee679f32f07d
I20260808 14:36:52.743383 3403 tablet_service.cc:1514] Processing DeleteTablet for tablet b1399e7d6bf349ea9ccbee679f32f07d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:36:52 UTC) from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:33052
I20260808 14:36:52.743427 3812 tablet_service.cc:1514] Processing DeleteTablet for tablet b1399e7d6bf349ea9ccbee679f32f07d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:36:52 UTC) from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:34600
I20260808 14:36:52.743582 3612 tablet_service.cc:1514] Processing DeleteTablet for tablet b1399e7d6bf349ea9ccbee679f32f07d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:36:52 UTC) from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:33080
I20260808 14:36:52.743959 3990 tablet_replica.cc:330] T b1399e7d6bf349ea9ccbee679f32f07d P 4caa5f5b9ece4d528143a7f95f85fd6c: stopping tablet replica
I20260808 14:36:52.744036 3994 tablet_replica.cc:330] T b1399e7d6bf349ea9ccbee679f32f07d P 299eed87e3fb4bbb9c07f298376f5b84: stopping tablet replica
I20260808 14:36:52.744302 3990 raft_consensus.cc:2229] T b1399e7d6bf349ea9ccbee679f32f07d P 4caa5f5b9ece4d528143a7f95f85fd6c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:36:52.744302 3994 raft_consensus.cc:2229] T b1399e7d6bf349ea9ccbee679f32f07d P 299eed87e3fb4bbb9c07f298376f5b84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:36:52.744472 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 3289
I20260808 14:36:52.744621 3994 raft_consensus.cc:2258] T b1399e7d6bf349ea9ccbee679f32f07d P 299eed87e3fb4bbb9c07f298376f5b84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:36:52.744621 3990 raft_consensus.cc:2258] T b1399e7d6bf349ea9ccbee679f32f07d P 4caa5f5b9ece4d528143a7f95f85fd6c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:36:52.749596 3994 ts_tablet_manager.cc:1905] T b1399e7d6bf349ea9ccbee679f32f07d P 299eed87e3fb4bbb9c07f298376f5b84: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:36:52.752954 3994 ts_tablet_manager.cc:1918] T b1399e7d6bf349ea9ccbee679f32f07d P 299eed87e3fb4bbb9c07f298376f5b84: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:36:52.753058 3994 log.cc:1196] T b1399e7d6bf349ea9ccbee679f32f07d P 299eed87e3fb4bbb9c07f298376f5b84: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-1/wal/wals/b1399e7d6bf349ea9ccbee679f32f07d
I20260808 14:36:52.753355 3994 ts_tablet_manager.cc:1939] T b1399e7d6bf349ea9ccbee679f32f07d P 299eed87e3fb4bbb9c07f298376f5b84: Deleting consensus metadata
I20260808 14:36:52.756781 3173 catalog_manager.cc:4841] TS 299eed87e3fb4bbb9c07f298376f5b84 (127.11.131.194:34113): tablet b1399e7d6bf349ea9ccbee679f32f07d (table test-table [id=422f9188c3cf493eb73f0903d0329000]) successfully deleted
I20260808 14:36:52.757938 3990 ts_tablet_manager.cc:1905] T b1399e7d6bf349ea9ccbee679f32f07d P 4caa5f5b9ece4d528143a7f95f85fd6c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:36:52.761904 3990 ts_tablet_manager.cc:1918] T b1399e7d6bf349ea9ccbee679f32f07d P 4caa5f5b9ece4d528143a7f95f85fd6c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:36:52.762048 3990 log.cc:1196] T b1399e7d6bf349ea9ccbee679f32f07d P 4caa5f5b9ece4d528143a7f95f85fd6c: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-2/wal/wals/b1399e7d6bf349ea9ccbee679f32f07d
I20260808 14:36:52.762467 3990 ts_tablet_manager.cc:1939] T b1399e7d6bf349ea9ccbee679f32f07d P 4caa5f5b9ece4d528143a7f95f85fd6c: Deleting consensus metadata
I20260808 14:36:52.764150 3176 catalog_manager.cc:4841] TS 4caa5f5b9ece4d528143a7f95f85fd6c (127.11.131.195:45767): tablet b1399e7d6bf349ea9ccbee679f32f07d (table test-table [id=422f9188c3cf493eb73f0903d0329000]) successfully deleted
W20260808 14:36:52.765808 3174 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.131.193:37453 (error 108)
I20260808 14:36:52.766115 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 3514
I20260808 14:36:52.769395 3948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:36:52.769041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:37453 (local address 127.0.0.1:33076)
0808 14:36:52.769196 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0808 14:36:52.769285 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.193:37453: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260808 14:36:52.769688 3174 catalog_manager.cc:4584] TS 16bb053aea7c4ab6b077a408aa7652dd (127.11.131.193:37453): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b1399e7d6bf349ea9ccbee679f32f07d: Network error: Client connection negotiation failed: client connection to 127.11.131.193:37453: connect: Connection refused (error 111)
I20260808 14:36:52.779737 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 3723
I20260808 14:36:52.795776 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 3143
I20260808 14:37:12.808580 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:45813
--webserver_interface=127.11.131.254
--webserver_port=35871
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:36449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:45813
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:37:12.926651 3998 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:37:12.926937 3998 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:37:12.927030 3998 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:37:12.931167 3998 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 14:37:12.931216 3998 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 14:37:12.931232 3998 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 14:37:12.931248 3998 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:37:12.931288 3998 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:37:12.931321 3998 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:37:12.931353 3998 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:37:12.931392 3998 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:37:12.936676 3998 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:36449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:45813
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:45813
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.131.254
--webserver_port=35871
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3998
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:37:12.937713 3998 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:37:12.938824 3998 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:37:12.953137 4006 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:37:12.953145 4005 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:37:12.953145 4009 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:37:12.953437 3998 server_base.cc:1034] running on GCE node
I20260808 14:37:12.954125 3998 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:37:12.955389 3998 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:37:12.956586 3998 hybrid_clock.cc:648] HybridClock initialized: now 1786199832956574 us; error 31 us; skew 500 ppm
Aug 08 14:37:12 dist-test-slave-twwt krb5kdc[3119](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199832, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:37:12.963713 3998 init.cc:377] Logged in from keytab as kudu/127.11.131.254@KRBTEST.COM (short username kudu)
I20260808 14:37:12.964713 3998 webserver.cc:460] Webserver started at http://127.11.131.254:35871/ using document root <none> and password file <none>
I20260808 14:37:12.965286 3998 fs_manager.cc:359] Metadata directory not provided
I20260808 14:37:12.965363 3998 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:37:12.969511 3998 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260808 14:37:12.971836 4024 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:12.973137 3998 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 14:37:12.973263 3998 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "75264d2b77954d589e6d554de0d2df66"
format_stamp: "Formatted at 2026-08-08 14:36:51 on dist-test-slave-twwt"
server_key: "7208582c9e4533aef55d091b3edeb6e3"
server_key_iv: "98ce3ec04f312870b047ba8a5a7201d9"
server_key_version: "encryptionkey@0"
I20260808 14:37:12.973860 3998 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:37:12.998263 3998 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:37:13.001767 3998 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:37:13.001938 3998 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:37:13.009881 3998 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.254:45813
I20260808 14:37:13.010200 4107 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.254:45813 every 8 connection(s)
I20260808 14:37:13.011138 3998 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:37:13.015940 4108 sys_catalog.cc:263] Verifying existing consensus state
I20260808 14:37:13.017163 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 3998
I20260808 14:37:13.017696 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.193:37453
--local_ip_for_outbound_sockets=127.11.131.193
--tserver_master_addrs=127.11.131.254:45813
--webserver_port=41379
--webserver_interface=127.11.131.193
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab
--principal=kudu/127.11.131.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:36449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:37:13.018033 4108 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66: Bootstrap starting.
I20260808 14:37:13.037438 4108 log.cc:824] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66: Log is configured to *not* fsync() on all Append() calls
I20260808 14:37:13.046891 4108 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:37:13.047294 4108 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66: Bootstrap complete.
I20260808 14:37:13.051730 4108 raft_consensus.cc:348] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75264d2b77954d589e6d554de0d2df66" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 45813 } }
I20260808 14:37:13.052143 4108 raft_consensus.cc:729] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75264d2b77954d589e6d554de0d2df66, State: Initialized, Role: FOLLOWER
I20260808 14:37:13.052654 4108 consensus_queue.cc:260] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75264d2b77954d589e6d554de0d2df66" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 45813 } }
I20260808 14:37:13.052831 4108 raft_consensus.cc:388] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:37:13.052927 4108 raft_consensus.cc:482] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:37:13.053045 4108 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66 [term 1 FOLLOWER]: Advancing to term 2
I20260808 14:37:13.055042 4108 raft_consensus.cc:504] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75264d2b77954d589e6d554de0d2df66" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 45813 } }
I20260808 14:37:13.055425 4108 leader_election.cc:302] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 75264d2b77954d589e6d554de0d2df66; no voters:
I20260808 14:37:13.055802 4108 leader_election.cc:288] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 14:37:13.055931 4114 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 14:37:13.056159 4114 raft_consensus.cc:686] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66 [term 2 LEADER]: Becoming Leader. State: Replica: 75264d2b77954d589e6d554de0d2df66, State: Running, Role: LEADER
I20260808 14:37:13.056476 4114 consensus_queue.cc:237] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75264d2b77954d589e6d554de0d2df66" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 45813 } }
I20260808 14:37:13.057150 4108 sys_catalog.cc:564] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:37:13.057507 4114 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 75264d2b77954d589e6d554de0d2df66. Latest consensus state: current_term: 2 leader_uuid: "75264d2b77954d589e6d554de0d2df66" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75264d2b77954d589e6d554de0d2df66" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 45813 } } }
I20260808 14:37:13.057634 4114 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66 [sys.catalog]: This master's current role is: LEADER
I20260808 14:37:13.058043 4115 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "75264d2b77954d589e6d554de0d2df66" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75264d2b77954d589e6d554de0d2df66" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 45813 } } }
I20260808 14:37:13.058173 4115 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66 [sys.catalog]: This master's current role is: LEADER
I20260808 14:37:13.058028 4118 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:37:13.063503 4118 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:37:13.064335 4118 catalog_manager.cc:1259] Loaded cluster ID: a3785d2427904f05b2d93c0469db6c96
I20260808 14:37:13.064400 4118 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:37:13.067026 4118 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:37:13.067765 4118 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66: Loaded TSK: 0
I20260808 14:37:13.082748 4118 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66: Generated new TSK 1
I20260808 14:37:13.083033 4118 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 14:37:13.143885 4111 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:37:13.144182 4111 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:37:13.144269 4111 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:37:13.148427 4111 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:37:13.148517 4111 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:37:13.148603 4111 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.193
I20260808 14:37:13.153885 4111 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:36449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab
--principal=kudu/127.11.131.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.193:37453
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.131.193
--webserver_port=41379
--tserver_master_addrs=127.11.131.254:45813
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4111
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.193
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:37:13.155052 4111 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:37:13.156085 4111 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:37:13.166251 4146 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:37:13.166265 4147 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:37:13.166770 4150 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:37:13.167281 4111 server_base.cc:1034] running on GCE node
I20260808 14:37:13.167753 4111 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:37:13.168428 4111 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:37:13.169636 4111 hybrid_clock.cc:648] HybridClock initialized: now 1786199833169619 us; error 35 us; skew 500 ppm
Aug 08 14:37:13 dist-test-slave-twwt krb5kdc[3119](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199833, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:37:13.172813 4111 init.cc:377] Logged in from keytab as kudu/127.11.131.193@KRBTEST.COM (short username kudu)
I20260808 14:37:13.173866 4111 webserver.cc:460] Webserver started at http://127.11.131.193:41379/ using document root <none> and password file <none>
I20260808 14:37:13.174485 4111 fs_manager.cc:359] Metadata directory not provided
I20260808 14:37:13.174598 4111 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:37:13.179157 4111 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20260808 14:37:13.181483 4167 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:13.182917 4111 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:37:13.183039 4111 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-0/wal
uuid: "16bb053aea7c4ab6b077a408aa7652dd"
format_stamp: "Formatted at 2026-08-08 14:36:51 on dist-test-slave-twwt"
server_key: "1e4210c444e60328885b7a573f9e9d76"
server_key_iv: "acd9120a82b3891d9061714a865f6be6"
server_key_version: "encryptionkey@0"
I20260808 14:37:13.183681 4111 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:37:13.203615 4111 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:37:13.207017 4111 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:37:13.207230 4111 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:37:13.207871 4111 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:37:13.209004 4176 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 14:37:13.213205 4111 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 14:37:13.213275 4111 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.000s sys 0.000s
I20260808 14:37:13.213351 4111 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 14:37:13.215196 4111 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 14:37:13.215245 4111 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.001s sys 0.000s
I20260808 14:37:13.215585 4176 tablet_bootstrap.cc:492] T b1399e7d6bf349ea9ccbee679f32f07d P 16bb053aea7c4ab6b077a408aa7652dd: Bootstrap starting.
I20260808 14:37:13.227327 4111 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.193:37453
I20260808 14:37:13.227434 4332 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.193:37453 every 8 connection(s)
I20260808 14:37:13.228420 4111 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
I20260808 14:37:13.236160 4176 log.cc:824] T b1399e7d6bf349ea9ccbee679f32f07d P 16bb053aea7c4ab6b077a408aa7652dd: Log is configured to *not* fsync() on all Append() calls
I20260808 14:37:13.236605 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 4111
I20260808 14:37:13.237071 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.194:34113
--local_ip_for_outbound_sockets=127.11.131.194
--tserver_master_addrs=127.11.131.254:45813
--webserver_port=33439
--webserver_interface=127.11.131.194
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab
--principal=kudu/127.11.131.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:36449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 14:37:13 dist-test-slave-twwt krb5kdc[3119](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199833, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.193@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:37:13.245955 4176 tablet_bootstrap.cc:492] T b1399e7d6bf349ea9ccbee679f32f07d P 16bb053aea7c4ab6b077a408aa7652dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:37:13.246522 4176 tablet_bootstrap.cc:492] T b1399e7d6bf349ea9ccbee679f32f07d P 16bb053aea7c4ab6b077a408aa7652dd: Bootstrap complete.
I20260808 14:37:13.246790 4339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:13.230759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.193:34647)
0808 14:37:13.231423 (+ 664us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:13.231480 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 14:37:13.232782 (+ 1302us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:37:13.233915 (+ 1133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:37:13.233928 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:37:13.234440 (+ 512us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:37:13.235113 (+ 673us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:13.235133 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:13.236486 (+ 1353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:13.236489 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:13.237744 (+ 1255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:13.237756 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:13.238507 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:13.238514 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:13.238756 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:13.239389 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:37:13.239411 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:37:13.241267 (+ 1856us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:37:13.243547 (+ 2280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:37:13.243553 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:37:13.243565 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:37:13.243846 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:37:13.244216 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:37:13.244219 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:37:13.244221 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:37:13.244362 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:37:13.244950 (+ 588us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:37:13.244956 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:37:13.245194 (+ 238us) client_negotiation.cc:769] Sending connection context
0808 14:37:13.245366 (+ 172us) client_negotiation.cc:240] Negotiation successful
0808 14:37:13.245708 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":423,"thread_start_us":149,"threads_started":1}
I20260808 14:37:13.246780 4337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:13.230769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:34647 (local address 127.11.131.254:45813)
0808 14:37:13.231218 (+ 449us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:13.231238 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:13.231611 (+ 373us) server_negotiation.cc:407] Connection header received
0808 14:37:13.233188 (+ 1577us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:13.233199 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:13.233489 (+ 290us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:13.233757 (+ 268us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:37:13.235296 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:13.236303 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:13.237877 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:13.238353 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:13.238551 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:13.241480 (+ 2929us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:37:13.241485 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:37:13.241497 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:37:13.241526 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:37:13.243424 (+ 1898us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:37:13.243982 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:37:13.243987 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:37:13.243991 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:37:13.244107 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:37:13.244478 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:37:13.244481 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:37:13.244482 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:37:13.244823 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:37:13.244977 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:13.245502 (+ 525us) server_negotiation.cc:299] Negotiation successful
0808 14:37:13.245764 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295,"thread_start_us":161,"threads_started":1}
I20260808 14:37:13.248320 4176 ts_tablet_manager.cc:1397] T b1399e7d6bf349ea9ccbee679f32f07d P 16bb053aea7c4ab6b077a408aa7652dd: Time spent bootstrapping tablet: real 0.033s user 0.018s sys 0.013s
I20260808 14:37:13.249212 4334 heartbeater.cc:347] Connected to a master server at 127.11.131.254:45813
I20260808 14:37:13.249467 4334 heartbeater.cc:464] Registering TS with master...
I20260808 14:37:13.249972 4334 heartbeater.cc:511] Master 127.11.131.254:45813 requested a full tablet report, sending...
I20260808 14:37:13.252492 4050 ts_manager.cc:194] Registered new tserver with Master: 16bb053aea7c4ab6b077a408aa7652dd (127.11.131.193:37453)
I20260808 14:37:13.252261 4176 raft_consensus.cc:348] T b1399e7d6bf349ea9ccbee679f32f07d P 16bb053aea7c4ab6b077a408aa7652dd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4caa5f5b9ece4d528143a7f95f85fd6c" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45767 } } peers { permanent_uuid: "16bb053aea7c4ab6b077a408aa7652dd" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 37453 } } peers { permanent_uuid: "299eed87e3fb4bbb9c07f298376f5b84" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 34113 } }
I20260808 14:37:13.252812 4176 raft_consensus.cc:729] T b1399e7d6bf349ea9ccbee679f32f07d P 16bb053aea7c4ab6b077a408aa7652dd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16bb053aea7c4ab6b077a408aa7652dd, State: Initialized, Role: FOLLOWER
I20260808 14:37:13.253345 4176 consensus_queue.cc:260] T b1399e7d6bf349ea9ccbee679f32f07d P 16bb053aea7c4ab6b077a408aa7652dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4caa5f5b9ece4d528143a7f95f85fd6c" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45767 } } peers { permanent_uuid: "16bb053aea7c4ab6b077a408aa7652dd" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 37453 } } peers { permanent_uuid: "299eed87e3fb4bbb9c07f298376f5b84" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 34113 } }
I20260808 14:37:13.254360 4176 ts_tablet_manager.cc:1428] T b1399e7d6bf349ea9ccbee679f32f07d P 16bb053aea7c4ab6b077a408aa7652dd: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260808 14:37:13.256461 4050 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.193@KRBTEST.COM'} at 127.11.131.193:34647
I20260808 14:37:13.259265 4334 heartbeater.cc:503] Master 127.11.131.254:45813 was elected leader, sending a full tablet report...
Aug 08 14:37:13 dist-test-slave-twwt krb5kdc[3119](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199832, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for kudu/127.11.131.193@KRBTEST.COM
I20260808 14:37:13.267402 4345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:13.255814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:37453 (local address 127.0.0.1:36982)
0808 14:37:13.256273 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:13.256323 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 14:37:13.256454 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:37:13.257378 (+ 924us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:37:13.257385 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:37:13.257901 (+ 516us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:37:13.258035 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:13.258044 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:13.259649 (+ 1605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:13.259652 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:13.260670 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:13.260682 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:13.261475 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:13.261478 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:13.261559 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:13.262137 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:37:13.262149 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:37:13.263591 (+ 1442us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:37:13.265659 (+ 2068us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:37:13.265667 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:37:13.265672 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:37:13.265902 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:37:13.266209 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:37:13.266211 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:37:13.266212 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:37:13.266287 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:37:13.266816 (+ 529us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:37:13.266822 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:37:13.266991 (+ 169us) client_negotiation.cc:769] Sending connection context
0808 14:37:13.267127 (+ 136us) client_negotiation.cc:240] Negotiation successful
0808 14:37:13.267274 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":138,"threads_started":1}
I20260808 14:37:13.267794 4347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:13.256574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36982 (local address 127.11.131.193:37453)
0808 14:37:13.256894 (+ 320us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:13.256906 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:13.256952 (+ 46us) server_negotiation.cc:407] Connection header received
0808 14:37:13.257020 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:13.257025 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:13.257221 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:13.257368 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:37:13.258195 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:13.259511 (+ 1316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:13.260810 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:13.261345 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:13.261450 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:13.263728 (+ 2278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:37:13.263740 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:37:13.263755 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:37:13.263784 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:37:13.265546 (+ 1762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:37:13.266014 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:37:13.266020 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:37:13.266022 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:37:13.266118 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:37:13.266372 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:37:13.266375 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:37:13.266377 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:37:13.266676 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:37:13.266807 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:13.267236 (+ 429us) server_negotiation.cc:299] Negotiation successful
0808 14:37:13.267400 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":216,"thread_start_us":118,"threads_started":1}
I20260808 14:37:13.268725 4240 tablet_service.cc:1514] Processing DeleteTablet for tablet b1399e7d6bf349ea9ccbee679f32f07d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:36:52 UTC) from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:36982
I20260808 14:37:13.269543 4348 tablet_replica.cc:330] stopping tablet replica
I20260808 14:37:13.269835 4348 raft_consensus.cc:2229] T b1399e7d6bf349ea9ccbee679f32f07d P 16bb053aea7c4ab6b077a408aa7652dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:37:13.270088 4348 raft_consensus.cc:2258] T b1399e7d6bf349ea9ccbee679f32f07d P 16bb053aea7c4ab6b077a408aa7652dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:37:13.271113 4348 ts_tablet_manager.cc:1905] T b1399e7d6bf349ea9ccbee679f32f07d P 16bb053aea7c4ab6b077a408aa7652dd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:37:13.274833 4348 ts_tablet_manager.cc:1918] T b1399e7d6bf349ea9ccbee679f32f07d P 16bb053aea7c4ab6b077a408aa7652dd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:37:13.274946 4348 log.cc:1196] T b1399e7d6bf349ea9ccbee679f32f07d P 16bb053aea7c4ab6b077a408aa7652dd: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-0/wal/wals/b1399e7d6bf349ea9ccbee679f32f07d
I20260808 14:37:13.275238 4348 ts_tablet_manager.cc:1939] T b1399e7d6bf349ea9ccbee679f32f07d P 16bb053aea7c4ab6b077a408aa7652dd: Deleting consensus metadata
I20260808 14:37:13.276897 4027 catalog_manager.cc:4841] TS 16bb053aea7c4ab6b077a408aa7652dd (127.11.131.193:37453): tablet b1399e7d6bf349ea9ccbee679f32f07d (table test-table [id=422f9188c3cf493eb73f0903d0329000]) successfully deleted
W20260808 14:37:13.362217 4341 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:37:13.362511 4341 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:37:13.362635 4341 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:37:13.366758 4341 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:37:13.366829 4341 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:37:13.366951 4341 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.194
I20260808 14:37:13.372161 4341 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:36449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab
--principal=kudu/127.11.131.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.194:34113
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.131.194
--webserver_port=33439
--tserver_master_addrs=127.11.131.254:45813
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4341
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.194
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:37:13.373217 4341 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:37:13.374223 4341 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:37:13.384114 4357 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:37:13.384114 4355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:37:13.384348 4341 server_base.cc:1034] running on GCE node
W20260808 14:37:13.384438 4359 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:37:13.384780 4341 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:37:13.385459 4341 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:37:13.386669 4341 hybrid_clock.cc:648] HybridClock initialized: now 1786199833386647 us; error 26 us; skew 500 ppm
Aug 08 14:37:13 dist-test-slave-twwt krb5kdc[3119](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199833, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:37:13.389505 4341 init.cc:377] Logged in from keytab as kudu/127.11.131.194@KRBTEST.COM (short username kudu)
I20260808 14:37:13.390429 4341 webserver.cc:460] Webserver started at http://127.11.131.194:33439/ using document root <none> and password file <none>
I20260808 14:37:13.391072 4341 fs_manager.cc:359] Metadata directory not provided
I20260808 14:37:13.391170 4341 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:37:13.394982 4341 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260808 14:37:13.397271 4370 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:13.398532 4341 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 14:37:13.398694 4341 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-1/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-1/wal
uuid: "299eed87e3fb4bbb9c07f298376f5b84"
format_stamp: "Formatted at 2026-08-08 14:36:52 on dist-test-slave-twwt"
server_key: "963a03d113a4f8c2a74ec1c7109c15b8"
server_key_iv: "62c68b88f904168ca405998501b11e5f"
server_key_version: "encryptionkey@0"
I20260808 14:37:13.399236 4341 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:37:13.412827 4341 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:37:13.415928 4341 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:37:13.416124 4341 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:37:13.416697 4341 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:37:13.417521 4341 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:37:13.417593 4341 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:13.417665 4341 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:37:13.417706 4341 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:13.427456 4341 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.194:34113
I20260808 14:37:13.427505 4558 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.194:34113 every 8 connection(s)
I20260808 14:37:13.428556 4341 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
I20260808 14:37:13.436187 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 4341
I20260808 14:37:13.436713 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.195:45767
--local_ip_for_outbound_sockets=127.11.131.195
--tserver_master_addrs=127.11.131.254:45813
--webserver_port=44673
--webserver_interface=127.11.131.195
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab
--principal=kudu/127.11.131.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:36449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 14:37:13 dist-test-slave-twwt krb5kdc[3119](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199833, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.194@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:37:13.444046 4337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:13.430480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:46397 (local address 127.11.131.254:45813)
0808 14:37:13.430703 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:13.430708 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:13.431664 (+ 956us) server_negotiation.cc:407] Connection header received
0808 14:37:13.433087 (+ 1423us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:13.433091 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:13.433143 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:13.433227 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:37:13.434422 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:13.434994 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:13.436349 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:13.436602 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:13.436687 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:13.439972 (+ 3285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:37:13.439976 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:37:13.439978 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:37:13.440005 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:37:13.441585 (+ 1580us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:37:13.442169 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:37:13.442174 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:37:13.442176 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:37:13.442285 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:37:13.442819 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:37:13.442821 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:37:13.442822 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:37:13.443008 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:37:13.443089 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:13.443804 (+ 715us) server_negotiation.cc:299] Negotiation successful
0808 14:37:13.443922 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 14:37:13.445452 4565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:13.431014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.194:46397)
0808 14:37:13.431500 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:13.431545 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 14:37:13.432840 (+ 1295us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:37:13.433422 (+ 582us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:37:13.433429 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:37:13.433792 (+ 363us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:37:13.434273 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:13.434285 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:13.435110 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:13.435113 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:13.436173 (+ 1060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:13.436186 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:13.436771 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:13.436777 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:13.437020 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:13.437653 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:37:13.437680 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:37:13.439733 (+ 2053us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:37:13.441760 (+ 2027us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:37:13.441766 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:37:13.441778 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:37:13.442045 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:37:13.442448 (+ 403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:37:13.442455 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:37:13.442461 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:37:13.442712 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:37:13.443127 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:37:13.443137 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:37:13.443520 (+ 383us) client_negotiation.cc:769] Sending connection context
0808 14:37:13.443758 (+ 238us) client_negotiation.cc:240] Negotiation successful
0808 14:37:13.444192 (+ 434us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":130,"threads_started":1}
I20260808 14:37:13.446830 4559 heartbeater.cc:347] Connected to a master server at 127.11.131.254:45813
I20260808 14:37:13.447113 4559 heartbeater.cc:464] Registering TS with master...
I20260808 14:37:13.447619 4559 heartbeater.cc:511] Master 127.11.131.254:45813 requested a full tablet report, sending...
I20260808 14:37:13.448732 4050 ts_manager.cc:194] Registered new tserver with Master: 299eed87e3fb4bbb9c07f298376f5b84 (127.11.131.194:34113)
I20260808 14:37:13.449316 4050 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.194@KRBTEST.COM'} at 127.11.131.194:46397
W20260808 14:37:13.558066 4567 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:37:13.558419 4567 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:37:13.558506 4567 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:37:13.562975 4567 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:37:13.563046 4567 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:37:13.563143 4567 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.195
I20260808 14:37:13.568744 4567 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:36449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab
--principal=kudu/127.11.131.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.195:45767
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.131.195
--webserver_port=44673
--tserver_master_addrs=127.11.131.254:45813
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4567
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.195
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:37:13.569831 4567 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:37:13.570957 4567 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:37:13.581379 4577 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:37:13.581571 4574 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:37:13.581584 4575 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:37:13.582059 4567 server_base.cc:1034] running on GCE node
I20260808 14:37:13.582564 4567 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:37:13.583299 4567 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:37:13.584470 4567 hybrid_clock.cc:648] HybridClock initialized: now 1786199833584451 us; error 31 us; skew 500 ppm
Aug 08 14:37:13 dist-test-slave-twwt krb5kdc[3119](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199833, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:37:13.587438 4567 init.cc:377] Logged in from keytab as kudu/127.11.131.195@KRBTEST.COM (short username kudu)
I20260808 14:37:13.588443 4567 webserver.cc:460] Webserver started at http://127.11.131.195:44673/ using document root <none> and password file <none>
I20260808 14:37:13.589027 4567 fs_manager.cc:359] Metadata directory not provided
I20260808 14:37:13.589144 4567 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:37:13.593906 4567 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 14:37:13.596221 4586 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:13.597548 4567 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 14:37:13.597697 4567 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-2/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-2/wal
uuid: "4caa5f5b9ece4d528143a7f95f85fd6c"
format_stamp: "Formatted at 2026-08-08 14:36:52 on dist-test-slave-twwt"
server_key: "986d4cde850005d5f2fd43887ef845e7"
server_key_iv: "8c8938bdd7f55337686264bf61409113"
server_key_version: "encryptionkey@0"
I20260808 14:37:13.598282 4567 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:37:13.622846 4567 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:37:13.626008 4567 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:37:13.626219 4567 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:37:13.626931 4567 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:37:13.627806 4567 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:37:13.627856 4567 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:13.627935 4567 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:37:13.627967 4567 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:13.637185 4567 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.195:45767
I20260808 14:37:13.637229 4753 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.195:45767 every 8 connection(s)
I20260808 14:37:13.638249 4567 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
I20260808 14:37:13.645665 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 4567
Aug 08 14:37:13 dist-test-slave-twwt krb5kdc[3119](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199833, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.195@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:37:13.653155 4337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:13.640220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:37175 (local address 127.11.131.254:45813)
0808 14:37:13.640374 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:13.640378 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:13.641337 (+ 959us) server_negotiation.cc:407] Connection header received
0808 14:37:13.642778 (+ 1441us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:13.642782 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:13.642831 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:13.642914 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:37:13.644120 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:13.644669 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:13.646097 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:13.646366 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:13.646487 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:13.649144 (+ 2657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:37:13.649148 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:37:13.649150 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:37:13.649174 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:37:13.650787 (+ 1613us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:37:13.651327 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:37:13.651331 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:37:13.651333 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:37:13.651417 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:37:13.651774 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:37:13.651780 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:37:13.651782 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:37:13.652048 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:37:13.652164 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:13.652854 (+ 690us) server_negotiation.cc:299] Negotiation successful
0808 14:37:13.652979 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 14:37:13.654207 4757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:13.640613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.195:37175)
0808 14:37:13.641115 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:13.641190 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0808 14:37:13.642500 (+ 1310us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:37:13.643087 (+ 587us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:37:13.643094 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:37:13.643467 (+ 373us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:37:13.643951 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:13.643965 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:13.644793 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:13.644795 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:13.645901 (+ 1106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:13.645915 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:13.646549 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:13.646556 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:13.646787 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:13.647404 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:37:13.647421 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:37:13.648970 (+ 1549us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:37:13.650918 (+ 1948us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:37:13.650924 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:37:13.650940 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:37:13.651214 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:37:13.651514 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:37:13.651518 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:37:13.651520 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:37:13.651672 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:37:13.652173 (+ 501us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:37:13.652183 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:37:13.652521 (+ 338us) client_negotiation.cc:769] Sending connection context
0808 14:37:13.652787 (+ 266us) client_negotiation.cc:240] Negotiation successful
0808 14:37:13.653132 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":129,"threads_started":1}
I20260808 14:37:13.655211 4758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:13.646428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56932 (local address 127.11.131.254:45813)
0808 14:37:13.646713 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:13.646717 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:13.646924 (+ 207us) server_negotiation.cc:407] Connection header received
0808 14:37:13.647082 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:13.647110 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:13.647153 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:13.647257 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:37:13.648039 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:13.648592 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:13.649475 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:13.649713 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:13.649827 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:13.651452 (+ 1625us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:37:13.651459 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:37:13.651464 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:37:13.651497 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:37:13.653297 (+ 1800us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:37:13.653734 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:37:13.653738 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:37:13.653739 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:37:13.653829 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:37:13.654114 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:37:13.654117 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:37:13.654119 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:37:13.654337 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:37:13.654546 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:13.654899 (+ 353us) server_negotiation.cc:299] Negotiation successful
0808 14:37:13.655029 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":211,"thread_start_us":69,"threads_started":1}
I20260808 14:37:13.655597 4754 heartbeater.cc:347] Connected to a master server at 127.11.131.254:45813
I20260808 14:37:13.655835 4754 heartbeater.cc:464] Registering TS with master...
I20260808 14:37:13.656323 4754 heartbeater.cc:511] Master 127.11.131.254:45813 requested a full tablet report, sending...
I20260808 14:37:13.657459 4050 ts_manager.cc:194] Registered new tserver with Master: 4caa5f5b9ece4d528143a7f95f85fd6c (127.11.131.195:45767)
I20260808 14:37:13.658041 4050 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.195@KRBTEST.COM'} at 127.11.131.195:37175
I20260808 14:37:13.658447 11791 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:37:13.662249 4758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:13.659111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56944 (local address 127.11.131.254:45813)
0808 14:37:13.659232 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:13.659235 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:13.659410 (+ 175us) server_negotiation.cc:407] Connection header received
0808 14:37:13.659552 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:13.659554 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:13.659636 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:13.659714 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:37:13.659970 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:13.660438 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:13.661263 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:13.661474 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:13.661550 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:13.661814 (+ 264us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:37:13.661928 (+ 114us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0808 14:37:13.662116 (+ 188us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:56944: token expired
Metrics: {"server-negotiator.queue_time_us":50}
W20260808 14:37:13.662317 4758 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:56944: token expired
W20260808 14:37:13.662724 3939 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.11.131.254:45813)
I20260808 14:37:13.669095 4758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:13.663035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56958 (local address 127.11.131.254:45813)
0808 14:37:13.663147 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:13.663151 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:13.663171 (+ 20us) server_negotiation.cc:407] Connection header received
0808 14:37:13.663258 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:13.663260 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:13.663292 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:13.663349 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:37:13.663881 (+ 532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:13.664322 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:13.665031 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:13.665221 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:13.665290 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:13.666460 (+ 1170us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:37:13.666464 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:37:13.666465 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:37:13.666487 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:37:13.667808 (+ 1321us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:37:13.668186 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:37:13.668188 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:37:13.668189 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:37:13.668261 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:37:13.668485 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:37:13.668487 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:37:13.668488 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:37:13.668635 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:37:13.668730 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:13.668906 (+ 176us) server_negotiation.cc:299] Negotiation successful
0808 14:37:13.668993 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 14:37:13.671451 4050 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56958:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:37:13.674789 4050 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:37:13.683631 4240 tablet_service.cc:1467] Processing CreateTablet for tablet bd817157c5784b689aee352895507975 (DEFAULT_TABLE table=test-table [id=53035c9d420b42a68ba6bb7bf94ee0d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:37:13.684406 4240 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd817157c5784b689aee352895507975. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:37:13.687549 4176 tablet_bootstrap.cc:492] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd: Bootstrap starting.
I20260808 14:37:13.688054 4769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:13.682139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.195:45767 (local address 127.0.0.1:41584)
0808 14:37:13.682533 (+ 394us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:13.682543 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:37:13.682639 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:37:13.683512 (+ 873us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:37:13.683515 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:37:13.683533 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:37:13.683640 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:13.683648 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:13.685226 (+ 1578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:13.685230 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:13.686133 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:13.686143 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:13.687552 (+ 1409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:13.687556 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:13.687665 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:13.687722 (+ 57us) client_negotiation.cc:769] Sending connection context
0808 14:37:13.687797 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 14:37:13.687880 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":345,"mutex_wait_us":50,"thread_start_us":97,"threads_started":1}
I20260808 14:37:13.688185 4345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:13.681944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.194:34113 (local address 127.0.0.1:42200)
0808 14:37:13.682261 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:13.682277 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:37:13.682371 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:37:13.683257 (+ 886us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:37:13.683260 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:37:13.683280 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:37:13.683433 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:13.683441 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:13.685184 (+ 1743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:13.685187 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:13.686408 (+ 1221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:13.686420 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:13.687811 (+ 1391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:13.687814 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:13.687930 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:13.687952 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 14:37:13.687999 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 14:37:13.688070 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":231,"mutex_wait_us":39}
I20260808 14:37:13.688588 4176 tablet_bootstrap.cc:654] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd: Neither blocks nor log segments found. Creating new log.
I20260808 14:37:13.688809 4772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:13.682390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41584 (local address 127.11.131.195:45767)
0808 14:37:13.682825 (+ 435us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:13.682837 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:13.682871 (+ 34us) server_negotiation.cc:407] Connection header received
0808 14:37:13.682963 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:13.682968 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:13.683157 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:13.683313 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:37:13.683922 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:13.685126 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:13.686263 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:13.687122 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:13.687329 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:13.687491 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:13.688432 (+ 941us) server_negotiation.cc:299] Negotiation successful
0808 14:37:13.688567 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323,"thread_start_us":182,"threads_started":1}
I20260808 14:37:13.688868 4770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:13.682153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42200 (local address 127.11.131.194:34113)
0808 14:37:13.682678 (+ 525us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:13.682691 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:13.682716 (+ 25us) server_negotiation.cc:407] Connection header received
0808 14:37:13.682812 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:13.682817 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:13.683067 (+ 250us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:13.683270 (+ 203us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:37:13.683564 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:13.685054 (+ 1490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:13.686694 (+ 1640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:13.687670 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:13.688436 (+ 766us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:13.688552 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:13.688593 (+ 41us) server_negotiation.cc:299] Negotiation successful
0808 14:37:13.688692 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":395,"thread_start_us":159,"threads_started":1}
I20260808 14:37:13.691805 4661 tablet_service.cc:1467] Processing CreateTablet for tablet bd817157c5784b689aee352895507975 (DEFAULT_TABLE table=test-table [id=53035c9d420b42a68ba6bb7bf94ee0d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:37:13.691814 4450 tablet_service.cc:1467] Processing CreateTablet for tablet bd817157c5784b689aee352895507975 (DEFAULT_TABLE table=test-table [id=53035c9d420b42a68ba6bb7bf94ee0d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:37:13.692795 4450 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd817157c5784b689aee352895507975. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:37:13.692806 4661 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd817157c5784b689aee352895507975. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:37:13.699254 4176 tablet_bootstrap.cc:492] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd: No bootstrap required, opened a new log
I20260808 14:37:13.699374 4176 ts_tablet_manager.cc:1397] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.000s
I20260808 14:37:13.699950 4776 tablet_bootstrap.cc:492] T bd817157c5784b689aee352895507975 P 299eed87e3fb4bbb9c07f298376f5b84: Bootstrap starting.
I20260808 14:37:13.699904 4176 raft_consensus.cc:348] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "299eed87e3fb4bbb9c07f298376f5b84" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 34113 } } peers { permanent_uuid: "4caa5f5b9ece4d528143a7f95f85fd6c" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45767 } } peers { permanent_uuid: "16bb053aea7c4ab6b077a408aa7652dd" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 37453 } }
I20260808 14:37:13.700029 4176 raft_consensus.cc:374] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:37:13.700069 4176 raft_consensus.cc:729] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16bb053aea7c4ab6b077a408aa7652dd, State: Initialized, Role: FOLLOWER
I20260808 14:37:13.700706 4775 tablet_bootstrap.cc:492] T bd817157c5784b689aee352895507975 P 4caa5f5b9ece4d528143a7f95f85fd6c: Bootstrap starting.
I20260808 14:37:13.700695 4176 consensus_queue.cc:260] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "299eed87e3fb4bbb9c07f298376f5b84" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 34113 } } peers { permanent_uuid: "4caa5f5b9ece4d528143a7f95f85fd6c" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45767 } } peers { permanent_uuid: "16bb053aea7c4ab6b077a408aa7652dd" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 37453 } }
I20260808 14:37:13.701514 4176 ts_tablet_manager.cc:1428] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260808 14:37:13.703132 4776 tablet_bootstrap.cc:654] T bd817157c5784b689aee352895507975 P 299eed87e3fb4bbb9c07f298376f5b84: Neither blocks nor log segments found. Creating new log.
I20260808 14:37:13.703423 4775 tablet_bootstrap.cc:654] T bd817157c5784b689aee352895507975 P 4caa5f5b9ece4d528143a7f95f85fd6c: Neither blocks nor log segments found. Creating new log.
I20260808 14:37:13.704109 4776 log.cc:824] T bd817157c5784b689aee352895507975 P 299eed87e3fb4bbb9c07f298376f5b84: Log is configured to *not* fsync() on all Append() calls
I20260808 14:37:13.704150 4775 log.cc:824] T bd817157c5784b689aee352895507975 P 4caa5f5b9ece4d528143a7f95f85fd6c: Log is configured to *not* fsync() on all Append() calls
I20260808 14:37:13.706183 4776 tablet_bootstrap.cc:492] T bd817157c5784b689aee352895507975 P 299eed87e3fb4bbb9c07f298376f5b84: No bootstrap required, opened a new log
I20260808 14:37:13.706197 4775 tablet_bootstrap.cc:492] T bd817157c5784b689aee352895507975 P 4caa5f5b9ece4d528143a7f95f85fd6c: No bootstrap required, opened a new log
I20260808 14:37:13.706408 4776 ts_tablet_manager.cc:1397] T bd817157c5784b689aee352895507975 P 299eed87e3fb4bbb9c07f298376f5b84: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.003s
I20260808 14:37:13.706440 4775 ts_tablet_manager.cc:1397] T bd817157c5784b689aee352895507975 P 4caa5f5b9ece4d528143a7f95f85fd6c: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 14:37:13.709318 4776 raft_consensus.cc:348] T bd817157c5784b689aee352895507975 P 299eed87e3fb4bbb9c07f298376f5b84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "299eed87e3fb4bbb9c07f298376f5b84" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 34113 } } peers { permanent_uuid: "4caa5f5b9ece4d528143a7f95f85fd6c" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45767 } } peers { permanent_uuid: "16bb053aea7c4ab6b077a408aa7652dd" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 37453 } }
I20260808 14:37:13.709318 4775 raft_consensus.cc:348] T bd817157c5784b689aee352895507975 P 4caa5f5b9ece4d528143a7f95f85fd6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "299eed87e3fb4bbb9c07f298376f5b84" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 34113 } } peers { permanent_uuid: "4caa5f5b9ece4d528143a7f95f85fd6c" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45767 } } peers { permanent_uuid: "16bb053aea7c4ab6b077a408aa7652dd" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 37453 } }
I20260808 14:37:13.709589 4776 raft_consensus.cc:374] T bd817157c5784b689aee352895507975 P 299eed87e3fb4bbb9c07f298376f5b84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:37:13.709581 4775 raft_consensus.cc:374] T bd817157c5784b689aee352895507975 P 4caa5f5b9ece4d528143a7f95f85fd6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:37:13.709652 4775 raft_consensus.cc:729] T bd817157c5784b689aee352895507975 P 4caa5f5b9ece4d528143a7f95f85fd6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4caa5f5b9ece4d528143a7f95f85fd6c, State: Initialized, Role: FOLLOWER
I20260808 14:37:13.709659 4776 raft_consensus.cc:729] T bd817157c5784b689aee352895507975 P 299eed87e3fb4bbb9c07f298376f5b84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 299eed87e3fb4bbb9c07f298376f5b84, State: Initialized, Role: FOLLOWER
I20260808 14:37:13.710112 4776 consensus_queue.cc:260] T bd817157c5784b689aee352895507975 P 299eed87e3fb4bbb9c07f298376f5b84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "299eed87e3fb4bbb9c07f298376f5b84" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 34113 } } peers { permanent_uuid: "4caa5f5b9ece4d528143a7f95f85fd6c" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45767 } } peers { permanent_uuid: "16bb053aea7c4ab6b077a408aa7652dd" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 37453 } }
I20260808 14:37:13.710114 4775 consensus_queue.cc:260] T bd817157c5784b689aee352895507975 P 4caa5f5b9ece4d528143a7f95f85fd6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "299eed87e3fb4bbb9c07f298376f5b84" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 34113 } } peers { permanent_uuid: "4caa5f5b9ece4d528143a7f95f85fd6c" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45767 } } peers { permanent_uuid: "16bb053aea7c4ab6b077a408aa7652dd" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 37453 } }
I20260808 14:37:13.710812 4754 heartbeater.cc:503] Master 127.11.131.254:45813 was elected leader, sending a full tablet report...
I20260808 14:37:13.710812 4559 heartbeater.cc:503] Master 127.11.131.254:45813 was elected leader, sending a full tablet report...
I20260808 14:37:13.711185 4776 ts_tablet_manager.cc:1428] T bd817157c5784b689aee352895507975 P 299eed87e3fb4bbb9c07f298376f5b84: Time spent starting tablet: real 0.005s user 0.000s sys 0.005s
I20260808 14:37:13.711185 4775 ts_tablet_manager.cc:1428] T bd817157c5784b689aee352895507975 P 4caa5f5b9ece4d528143a7f95f85fd6c: Time spent starting tablet: real 0.005s user 0.001s sys 0.005s
W20260808 14:37:13.729719 4336 tablet.cc:2369] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:37:13.889372 4756 tablet.cc:2369] T bd817157c5784b689aee352895507975 P 4caa5f5b9ece4d528143a7f95f85fd6c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:37:13.929812 4563 tablet.cc:2369] T bd817157c5784b689aee352895507975 P 299eed87e3fb4bbb9c07f298376f5b84: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:37:13.946197 4344 raft_consensus.cc:482] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:37:13.946537 4344 raft_consensus.cc:504] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "299eed87e3fb4bbb9c07f298376f5b84" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 34113 } } peers { permanent_uuid: "4caa5f5b9ece4d528143a7f95f85fd6c" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45767 } } peers { permanent_uuid: "16bb053aea7c4ab6b077a408aa7652dd" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 37453 } }
I20260808 14:37:13.947916 4344 leader_election.cc:288] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 299eed87e3fb4bbb9c07f298376f5b84 (127.11.131.194:34113), 4caa5f5b9ece4d528143a7f95f85fd6c (127.11.131.195:45767)
I20260808 14:37:13.953151 4772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:13.948408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:40859 (local address 127.11.131.195:45767)
0808 14:37:13.948577 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:13.948582 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:13.948723 (+ 141us) server_negotiation.cc:407] Connection header received
0808 14:37:13.948887 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:13.948890 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:13.948941 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:13.949023 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:37:13.949278 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:13.949767 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:13.951726 (+ 1959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:13.952286 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:13.952416 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:13.952479 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:13.952870 (+ 391us) server_negotiation.cc:299] Negotiation successful
0808 14:37:13.952965 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 14:37:13.953613 4782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:13.948169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.195:45767 (local address 127.11.131.193:40859)
0808 14:37:13.948632 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:13.948644 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:37:13.948765 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:37:13.949035 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:37:13.949039 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:37:13.949057 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:37:13.949156 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:13.949164 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:13.949960 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:13.949963 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:13.951597 (+ 1634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:13.951608 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:13.952550 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:13.952554 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:13.952646 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:13.952721 (+ 75us) client_negotiation.cc:769] Sending connection context
0808 14:37:13.953306 (+ 585us) client_negotiation.cc:240] Negotiation successful
0808 14:37:13.953422 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":384,"mutex_wait_us":3,"thread_start_us":64,"threads_started":1}
I20260808 14:37:13.955430 4694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd817157c5784b689aee352895507975" candidate_uuid: "16bb053aea7c4ab6b077a408aa7652dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4caa5f5b9ece4d528143a7f95f85fd6c" is_pre_election: true
I20260808 14:37:13.955684 4784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:13.948122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.194:34113 (local address 127.11.131.193:50801)
0808 14:37:13.948496 (+ 374us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:13.948517 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 14:37:13.948675 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:37:13.948983 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:37:13.948986 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:37:13.949003 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:37:13.949130 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:13.949136 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:13.949881 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:13.949886 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:13.953212 (+ 3326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:13.953252 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:13.954851 (+ 1599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:13.954858 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:13.955060 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:13.955126 (+ 66us) client_negotiation.cc:769] Sending connection context
0808 14:37:13.955259 (+ 133us) client_negotiation.cc:240] Negotiation successful
0808 14:37:13.955453 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"mutex_wait_us":1544,"thread_start_us":101,"threads_started":1}
I20260808 14:37:13.955817 4694 raft_consensus.cc:2454] T bd817157c5784b689aee352895507975 P 4caa5f5b9ece4d528143a7f95f85fd6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16bb053aea7c4ab6b077a408aa7652dd in term 0.
I20260808 14:37:13.956477 4770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:13.948189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:50801 (local address 127.11.131.194:34113)
0808 14:37:13.948340 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:13.948344 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:13.948612 (+ 268us) server_negotiation.cc:407] Connection header received
0808 14:37:13.948824 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:13.948828 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:13.948876 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:13.948959 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:37:13.949250 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:13.949757 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:13.953462 (+ 3705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:13.954448 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:13.954556 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:13.954672 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:13.956243 (+ 1571us) server_negotiation.cc:299] Negotiation successful
0808 14:37:13.956328 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 14:37:13.956487 4173 leader_election.cc:302] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16bb053aea7c4ab6b077a408aa7652dd, 4caa5f5b9ece4d528143a7f95f85fd6c; no voters:
I20260808 14:37:13.957005 4344 raft_consensus.cc:2781] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:37:13.957108 4344 raft_consensus.cc:482] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:37:13.957172 4344 raft_consensus.cc:3037] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:37:13.957119 4483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd817157c5784b689aee352895507975" candidate_uuid: "16bb053aea7c4ab6b077a408aa7652dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "299eed87e3fb4bbb9c07f298376f5b84" is_pre_election: true
I20260808 14:37:13.957394 4483 raft_consensus.cc:2454] T bd817157c5784b689aee352895507975 P 299eed87e3fb4bbb9c07f298376f5b84 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16bb053aea7c4ab6b077a408aa7652dd in term 0.
I20260808 14:37:13.958755 4344 raft_consensus.cc:504] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "299eed87e3fb4bbb9c07f298376f5b84" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 34113 } } peers { permanent_uuid: "4caa5f5b9ece4d528143a7f95f85fd6c" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45767 } } peers { permanent_uuid: "16bb053aea7c4ab6b077a408aa7652dd" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 37453 } }
I20260808 14:37:13.959183 4344 leader_election.cc:288] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [CANDIDATE]: Term 1 election: Requested vote from peers 299eed87e3fb4bbb9c07f298376f5b84 (127.11.131.194:34113), 4caa5f5b9ece4d528143a7f95f85fd6c (127.11.131.195:45767)
I20260808 14:37:13.959484 4483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd817157c5784b689aee352895507975" candidate_uuid: "16bb053aea7c4ab6b077a408aa7652dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "299eed87e3fb4bbb9c07f298376f5b84"
I20260808 14:37:13.959561 4694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd817157c5784b689aee352895507975" candidate_uuid: "16bb053aea7c4ab6b077a408aa7652dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4caa5f5b9ece4d528143a7f95f85fd6c"
I20260808 14:37:13.959609 4483 raft_consensus.cc:3037] T bd817157c5784b689aee352895507975 P 299eed87e3fb4bbb9c07f298376f5b84 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:37:13.959681 4694 raft_consensus.cc:3037] T bd817157c5784b689aee352895507975 P 4caa5f5b9ece4d528143a7f95f85fd6c [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:37:13.960944 4694 raft_consensus.cc:2454] T bd817157c5784b689aee352895507975 P 4caa5f5b9ece4d528143a7f95f85fd6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16bb053aea7c4ab6b077a408aa7652dd in term 1.
I20260808 14:37:13.960944 4483 raft_consensus.cc:2454] T bd817157c5784b689aee352895507975 P 299eed87e3fb4bbb9c07f298376f5b84 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16bb053aea7c4ab6b077a408aa7652dd in term 1.
I20260808 14:37:13.961258 4171 leader_election.cc:302] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16bb053aea7c4ab6b077a408aa7652dd, 299eed87e3fb4bbb9c07f298376f5b84; no voters:
I20260808 14:37:13.961485 4344 raft_consensus.cc:2781] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:37:13.961723 4344 raft_consensus.cc:686] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [term 1 LEADER]: Becoming Leader. State: Replica: 16bb053aea7c4ab6b077a408aa7652dd, State: Running, Role: LEADER
I20260808 14:37:13.961985 4344 consensus_queue.cc:237] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "299eed87e3fb4bbb9c07f298376f5b84" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 34113 } } peers { permanent_uuid: "4caa5f5b9ece4d528143a7f95f85fd6c" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45767 } } peers { permanent_uuid: "16bb053aea7c4ab6b077a408aa7652dd" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 37453 } }
I20260808 14:37:13.965912 4049 catalog_manager.cc:5495] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 16bb053aea7c4ab6b077a408aa7652dd (127.11.131.193). New cstate: current_term: 1 leader_uuid: "16bb053aea7c4ab6b077a408aa7652dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "299eed87e3fb4bbb9c07f298376f5b84" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 34113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4caa5f5b9ece4d528143a7f95f85fd6c" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16bb053aea7c4ab6b077a408aa7652dd" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 37453 } health_report { overall_health: HEALTHY } } }
I20260808 14:37:13.985167 4791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:13.980484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36996 (local address 127.11.131.193:37453)
0808 14:37:13.980802 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:13.980814 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:13.980829 (+ 15us) server_negotiation.cc:407] Connection header received
0808 14:37:13.980923 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:13.980929 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:13.981003 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:13.981133 (+ 130us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:37:13.981393 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:13.982097 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:13.983374 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:13.983660 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:13.983810 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:13.984086 (+ 276us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:37:13.984741 (+ 655us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:37:13.984857 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:13.984926 (+ 69us) server_negotiation.cc:299] Negotiation successful
0808 14:37:13.984984 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":237,"thread_start_us":111,"threads_started":1}
I20260808 14:37:13.989378 4483 raft_consensus.cc:1261] T bd817157c5784b689aee352895507975 P 299eed87e3fb4bbb9c07f298376f5b84 [term 1 FOLLOWER]: Refusing update from remote peer 16bb053aea7c4ab6b077a408aa7652dd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:37:13.989379 4694 raft_consensus.cc:1261] T bd817157c5784b689aee352895507975 P 4caa5f5b9ece4d528143a7f95f85fd6c [term 1 FOLLOWER]: Refusing update from remote peer 16bb053aea7c4ab6b077a408aa7652dd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:37:13.990139 4344 consensus_queue.cc:1035] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "299eed87e3fb4bbb9c07f298376f5b84" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 34113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:37:13.990342 4788 consensus_queue.cc:1035] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "4caa5f5b9ece4d528143a7f95f85fd6c" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:37:14.001559 4797 mvcc.cc:205] Tried to move back new op lower bound from 7316274520013778944 to 7316274519911604224. Current Snapshot: MvccSnapshot[applied={T|T < 7316274520013778944}]
I20260808 14:37:14.007200 4049 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56958:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:37:14.007380 4049 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56958:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:37:14.009898 4049 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66: Sending DeleteTablet for 3 replicas of tablet bd817157c5784b689aee352895507975
I20260808 14:37:14.010746 4450 tablet_service.cc:1514] Processing DeleteTablet for tablet bd817157c5784b689aee352895507975 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:37:14 UTC) from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:42200
I20260808 14:37:14.010895 4661 tablet_service.cc:1514] Processing DeleteTablet for tablet bd817157c5784b689aee352895507975 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:37:14 UTC) from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:41584
I20260808 14:37:14.011530 4815 tablet_replica.cc:330] T bd817157c5784b689aee352895507975 P 4caa5f5b9ece4d528143a7f95f85fd6c: stopping tablet replica
I20260808 14:37:14.011663 4240 tablet_service.cc:1514] Processing DeleteTablet for tablet bd817157c5784b689aee352895507975 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:37:14 UTC) from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:36982
I20260808 14:37:14.012091 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 4111
I20260808 14:37:14.012090 4815 raft_consensus.cc:2229] T bd817157c5784b689aee352895507975 P 4caa5f5b9ece4d528143a7f95f85fd6c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:37:14.022454 4815 raft_consensus.cc:2258] T bd817157c5784b689aee352895507975 P 4caa5f5b9ece4d528143a7f95f85fd6c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:37:14.023348 4813 tablet_replica.cc:330] T bd817157c5784b689aee352895507975 P 299eed87e3fb4bbb9c07f298376f5b84: stopping tablet replica
I20260808 14:37:14.023788 4813 raft_consensus.cc:2229] T bd817157c5784b689aee352895507975 P 299eed87e3fb4bbb9c07f298376f5b84 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:37:14.024154 4813 raft_consensus.cc:2258] T bd817157c5784b689aee352895507975 P 299eed87e3fb4bbb9c07f298376f5b84 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:37:14.025739 4813 ts_tablet_manager.cc:1905] T bd817157c5784b689aee352895507975 P 299eed87e3fb4bbb9c07f298376f5b84: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:37:14.025739 4815 ts_tablet_manager.cc:1905] T bd817157c5784b689aee352895507975 P 4caa5f5b9ece4d528143a7f95f85fd6c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:37:14.028954 4813 ts_tablet_manager.cc:1918] T bd817157c5784b689aee352895507975 P 299eed87e3fb4bbb9c07f298376f5b84: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:37:14.028954 4815 ts_tablet_manager.cc:1918] T bd817157c5784b689aee352895507975 P 4caa5f5b9ece4d528143a7f95f85fd6c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:37:14.029078 4815 log.cc:1196] T bd817157c5784b689aee352895507975 P 4caa5f5b9ece4d528143a7f95f85fd6c: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-2/wal/wals/bd817157c5784b689aee352895507975
I20260808 14:37:14.029238 4813 log.cc:1196] T bd817157c5784b689aee352895507975 P 299eed87e3fb4bbb9c07f298376f5b84: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-1/wal/wals/bd817157c5784b689aee352895507975
I20260808 14:37:14.029534 4815 ts_tablet_manager.cc:1939] T bd817157c5784b689aee352895507975 P 4caa5f5b9ece4d528143a7f95f85fd6c: Deleting consensus metadata
I20260808 14:37:14.029789 4813 ts_tablet_manager.cc:1939] T bd817157c5784b689aee352895507975 P 299eed87e3fb4bbb9c07f298376f5b84: Deleting consensus metadata
I20260808 14:37:14.031180 4026 catalog_manager.cc:4841] TS 299eed87e3fb4bbb9c07f298376f5b84 (127.11.131.194:34113): tablet bd817157c5784b689aee352895507975 (table test-table [id=53035c9d420b42a68ba6bb7bf94ee0d0]) successfully deleted
I20260808 14:37:14.031183 4028 catalog_manager.cc:4841] TS 4caa5f5b9ece4d528143a7f95f85fd6c (127.11.131.195:45767): tablet bd817157c5784b689aee352895507975 (table test-table [id=53035c9d420b42a68ba6bb7bf94ee0d0]) successfully deleted
W20260808 14:37:14.032275 4027 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.131.193:37453 (error 108)
I20260808 14:37:14.033532 4345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:14.033201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:37453 (local address 127.0.0.1:37006)
0808 14:37:14.033312 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:14.033415 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.193:37453: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 14:37:14.033542 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 4341
W20260808 14:37:14.037504 4027 catalog_manager.cc:4584] TS 16bb053aea7c4ab6b077a408aa7652dd (127.11.131.193:37453): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet bd817157c5784b689aee352895507975: Network error: Client connection negotiation failed: client connection to 127.11.131.193:37453: connect: Connection refused (error 111)
I20260808 14:37:14.052026 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 4567
I20260808 14:37:14.066390 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 3998
I20260808 14:37:34.077730 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:45813
--webserver_interface=127.11.131.254
--webserver_port=35871
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:36449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:45813
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:37:34.199335 4818 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:37:34.199658 4818 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:37:34.199733 4818 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:37:34.203908 4818 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 14:37:34.203984 4818 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 14:37:34.204012 4818 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 14:37:34.204043 4818 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:37:34.204085 4818 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:37:34.204133 4818 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:37:34.204166 4818 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:37:34.204201 4818 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:37:34.210041 4818 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:36449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:45813
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:45813
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.131.254
--webserver_port=35871
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4818
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:37:34.211223 4818 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:37:34.212306 4818 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:37:34.221498 4832 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:37:34.221581 4818 server_base.cc:1034] running on GCE node
W20260808 14:37:34.221611 4824 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:37:34.221515 4827 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:37:34.222378 4818 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:37:34.223703 4818 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:37:34.224917 4818 hybrid_clock.cc:648] HybridClock initialized: now 1786199854224886 us; error 43 us; skew 500 ppm
Aug 08 14:37:34 dist-test-slave-twwt krb5kdc[3119](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199854, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:37:34.233804 4818 init.cc:377] Logged in from keytab as kudu/127.11.131.254@KRBTEST.COM (short username kudu)
I20260808 14:37:34.234907 4818 webserver.cc:460] Webserver started at http://127.11.131.254:35871/ using document root <none> and password file <none>
I20260808 14:37:34.235525 4818 fs_manager.cc:359] Metadata directory not provided
I20260808 14:37:34.235602 4818 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:37:34.240108 4818 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 14:37:34.242467 4840 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:34.243970 4818 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:37:34.244091 4818 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "75264d2b77954d589e6d554de0d2df66"
format_stamp: "Formatted at 2026-08-08 14:36:51 on dist-test-slave-twwt"
server_key: "7208582c9e4533aef55d091b3edeb6e3"
server_key_iv: "98ce3ec04f312870b047ba8a5a7201d9"
server_key_version: "encryptionkey@0"
I20260808 14:37:34.244659 4818 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:37:34.261253 4818 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:37:34.264483 4818 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:37:34.264647 4818 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:37:34.272202 4818 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.254:45813
I20260808 14:37:34.272504 4925 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.254:45813 every 8 connection(s)
I20260808 14:37:34.273463 4818 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:37:34.276454 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 4818
I20260808 14:37:34.276943 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.193:37453
--local_ip_for_outbound_sockets=127.11.131.193
--tserver_master_addrs=127.11.131.254:45813
--webserver_port=41379
--webserver_interface=127.11.131.193
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab
--principal=kudu/127.11.131.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:36449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:37:34.278379 4927 sys_catalog.cc:263] Verifying existing consensus state
I20260808 14:37:34.280220 4927 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66: Bootstrap starting.
I20260808 14:37:34.299877 4927 log.cc:824] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66: Log is configured to *not* fsync() on all Append() calls
I20260808 14:37:34.311646 4927 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:37:34.312080 4927 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66: Bootstrap complete.
I20260808 14:37:34.316440 4927 raft_consensus.cc:348] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75264d2b77954d589e6d554de0d2df66" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 45813 } }
I20260808 14:37:34.316887 4927 raft_consensus.cc:729] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75264d2b77954d589e6d554de0d2df66, State: Initialized, Role: FOLLOWER
I20260808 14:37:34.317446 4927 consensus_queue.cc:260] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75264d2b77954d589e6d554de0d2df66" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 45813 } }
I20260808 14:37:34.317600 4927 raft_consensus.cc:388] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:37:34.317687 4927 raft_consensus.cc:482] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:37:34.317812 4927 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66 [term 2 FOLLOWER]: Advancing to term 3
I20260808 14:37:34.319929 4927 raft_consensus.cc:504] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75264d2b77954d589e6d554de0d2df66" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 45813 } }
I20260808 14:37:34.320317 4927 leader_election.cc:302] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 75264d2b77954d589e6d554de0d2df66; no voters:
I20260808 14:37:34.320673 4927 leader_election.cc:288] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 14:37:34.320770 4936 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 14:37:34.321132 4936 raft_consensus.cc:686] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66 [term 3 LEADER]: Becoming Leader. State: Replica: 75264d2b77954d589e6d554de0d2df66, State: Running, Role: LEADER
I20260808 14:37:34.321640 4936 consensus_queue.cc:237] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75264d2b77954d589e6d554de0d2df66" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 45813 } }
I20260808 14:37:34.322062 4927 sys_catalog.cc:564] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:37:34.323158 4938 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "75264d2b77954d589e6d554de0d2df66" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75264d2b77954d589e6d554de0d2df66" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 45813 } } }
I20260808 14:37:34.323333 4938 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66 [sys.catalog]: This master's current role is: LEADER
I20260808 14:37:34.323804 4939 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 75264d2b77954d589e6d554de0d2df66. Latest consensus state: current_term: 3 leader_uuid: "75264d2b77954d589e6d554de0d2df66" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75264d2b77954d589e6d554de0d2df66" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 45813 } } }
I20260808 14:37:34.323982 4939 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66 [sys.catalog]: This master's current role is: LEADER
I20260808 14:37:34.324573 4949 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:37:34.330188 4949 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:37:34.330909 4949 catalog_manager.cc:1259] Loaded cluster ID: a3785d2427904f05b2d93c0469db6c96
I20260808 14:37:34.331104 4949 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:37:34.333794 4949 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:37:34.334575 4949 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66: Loaded TSK: 0
I20260808 14:37:34.334738 4949 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 75264d2b77954d589e6d554de0d2df66: Loaded TSK: 1
F20260808 14:37:34.335616 4949 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f6c98ab79ad google::LogMessage::Fail() at ??:0
@ 0x7f6c98aba88a google::LogMessage::SendToLog() at ??:0
@ 0x7f6c98ab74de google::LogMessage::Flush() at ??:0
@ 0x7f6c98ab8a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f6c9b77b18d kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f6c9b773f0d kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f6ca34227bb kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f6ca33fc99c kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f6ca33fd178 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlvE3_clEv at ??:0
@ 0x7f6ca343edf8 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f6ca345d82b std::function<>::operator()() at ??:0
@ 0x7f6ca33fcb4f _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f6ca33fdf3e kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f6ca33fa579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f6ca343e640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f6c9ad093d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f6c9ad09c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f6c9ad0b3f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f6c9acfa512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f6c9c3426db start_thread at ??:0
@ 0x7f6c975b561f clone at ??:0
W20260808 14:37:34.439900 4933 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:37:34.440254 4933 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:37:34.440326 4933 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:37:34.446399 4933 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:37:34.446480 4933 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:37:34.446568 4933 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.193
I20260808 14:37:34.454924 4933 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:36449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab
--principal=kudu/127.11.131.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.193:37453
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.131.193
--webserver_port=41379
--tserver_master_addrs=127.11.131.254:45813
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4933
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.193
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:37:34.456368 4933 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:37:34.457734 4933 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 14:37:34.469561 4933 server_base.cc:1034] running on GCE node
W20260808 14:37:34.469522 5002 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:37:34.469514 5001 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:37:34.469791 5004 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:37:34.470297 4933 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:37:34.471179 4933 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:37:34.472389 4933 hybrid_clock.cc:648] HybridClock initialized: now 1786199854472351 us; error 47 us; skew 500 ppm
Aug 08 14:37:34 dist-test-slave-twwt krb5kdc[3119](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199854, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:37:34.475953 4933 init.cc:377] Logged in from keytab as kudu/127.11.131.193@KRBTEST.COM (short username kudu)
I20260808 14:37:34.477080 4933 webserver.cc:460] Webserver started at http://127.11.131.193:41379/ using document root <none> and password file <none>
I20260808 14:37:34.477788 4933 fs_manager.cc:359] Metadata directory not provided
I20260808 14:37:34.477880 4933 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:37:34.483263 4933 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 14:37:34.486138 5014 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:34.487722 4933 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:37:34.487859 4933 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-0/wal
uuid: "16bb053aea7c4ab6b077a408aa7652dd"
format_stamp: "Formatted at 2026-08-08 14:36:51 on dist-test-slave-twwt"
server_key: "1e4210c444e60328885b7a573f9e9d76"
server_key_iv: "acd9120a82b3891d9061714a865f6be6"
server_key_version: "encryptionkey@0"
I20260808 14:37:34.488579 4933 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:37:34.523144 4933 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:37:34.527256 4933 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:37:34.527477 4933 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:37:34.528280 4933 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:37:34.529663 5027 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 14:37:34.534265 4933 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 14:37:34.534364 4933 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.001s sys 0.000s
I20260808 14:37:34.534433 4933 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 14:37:34.536726 4933 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 14:37:34.536789 4933 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260808 14:37:34.537138 5027 tablet_bootstrap.cc:492] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd: Bootstrap starting.
I20260808 14:37:34.548863 4933 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.193:37453
I20260808 14:37:34.549270 5187 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.193:37453 every 8 connection(s)
I20260808 14:37:34.550136 4933 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
I20260808 14:37:34.556559 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 4933
I20260808 14:37:34.557185 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.194:34113
--local_ip_for_outbound_sockets=127.11.131.194
--tserver_master_addrs=127.11.131.254:45813
--webserver_port=33439
--webserver_interface=127.11.131.194
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab
--principal=kudu/127.11.131.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:36449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:37:34.560797 5027 log.cc:824] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd: Log is configured to *not* fsync() on all Append() calls
I20260808 14:37:34.571812 5027 tablet_bootstrap.cc:492] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 14:37:34.572345 5027 tablet_bootstrap.cc:492] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd: Bootstrap complete.
I20260808 14:37:34.574064 5027 ts_tablet_manager.cc:1397] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd: Time spent bootstrapping tablet: real 0.037s user 0.025s sys 0.008s
I20260808 14:37:34.577446 5027 raft_consensus.cc:348] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "299eed87e3fb4bbb9c07f298376f5b84" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 34113 } } peers { permanent_uuid: "4caa5f5b9ece4d528143a7f95f85fd6c" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45767 } } peers { permanent_uuid: "16bb053aea7c4ab6b077a408aa7652dd" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 37453 } }
I20260808 14:37:34.578006 5027 raft_consensus.cc:729] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16bb053aea7c4ab6b077a408aa7652dd, State: Initialized, Role: FOLLOWER
I20260808 14:37:34.578537 5027 consensus_queue.cc:260] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "299eed87e3fb4bbb9c07f298376f5b84" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 34113 } } peers { permanent_uuid: "4caa5f5b9ece4d528143a7f95f85fd6c" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45767 } } peers { permanent_uuid: "16bb053aea7c4ab6b077a408aa7652dd" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 37453 } }
I20260808 14:37:34.579650 5027 ts_tablet_manager.cc:1428] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
W20260808 14:37:34.608644 5190 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:37:34.552859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.193:35249)
0808 14:37:34.553527 (+ 668us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:34.553591 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0808 14:37:34.554957 (+ 1366us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:37:34.607651 (+ 52694us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:45813: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":400,"thread_start_us":188,"threads_started":1}
W20260808 14:37:34.609301 5188 heartbeater.cc:644] Failed to heartbeat to 127.11.131.254:45813 (0 consecutive failures): Network error: Failed to ping master at 127.11.131.254:45813: Client connection negotiation failed: client connection to 127.11.131.254:45813: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 14:37:34.610100 5190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:34.609807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.193:57103)
0808 14:37:34.609961 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:34.610035 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260808 14:37:34.610809 5190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:34.610565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.193:50345)
0808 14:37:34.610701 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:34.610753 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260808 14:37:34.611001 5188 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 14:37:34.690392 5191 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:37:34.690681 5191 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:37:34.690725 5191 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:37:34.694728 5191 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:37:34.694782 5191 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:37:34.694839 5191 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.194
I20260808 14:37:34.700021 5191 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:36449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab
--principal=kudu/127.11.131.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.194:34113
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.131.194
--webserver_port=33439
--tserver_master_addrs=127.11.131.254:45813
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5191
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.194
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:37:34.701072 5191 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:37:34.702169 5191 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:37:34.712074 5202 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:37:34.712078 5203 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:37:34.712131 5206 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:37:34.712456 5191 server_base.cc:1034] running on GCE node
I20260808 14:37:34.712913 5191 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:37:34.713548 5191 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:37:34.714715 5191 hybrid_clock.cc:648] HybridClock initialized: now 1786199854714688 us; error 29 us; skew 500 ppm
Aug 08 14:37:34 dist-test-slave-twwt krb5kdc[3119](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199854, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:37:34.717485 5191 init.cc:377] Logged in from keytab as kudu/127.11.131.194@KRBTEST.COM (short username kudu)
I20260808 14:37:34.718366 5191 webserver.cc:460] Webserver started at http://127.11.131.194:33439/ using document root <none> and password file <none>
I20260808 14:37:34.718989 5191 fs_manager.cc:359] Metadata directory not provided
I20260808 14:37:34.719082 5191 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:37:34.722995 5191 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 14:37:34.725051 5215 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:34.726351 5191 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 14:37:34.726477 5191 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-1/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-1/wal
uuid: "299eed87e3fb4bbb9c07f298376f5b84"
format_stamp: "Formatted at 2026-08-08 14:36:52 on dist-test-slave-twwt"
server_key: "963a03d113a4f8c2a74ec1c7109c15b8"
server_key_iv: "62c68b88f904168ca405998501b11e5f"
server_key_version: "encryptionkey@0"
I20260808 14:37:34.727109 5191 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:37:34.743014 5191 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:37:34.746068 5191 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:37:34.746325 5191 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:37:34.747017 5191 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:37:34.747895 5191 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:37:34.747965 5191 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:34.748036 5191 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:37:34.748077 5191 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:34.757730 5191 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.194:34113
I20260808 14:37:34.757766 5390 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.194:34113 every 8 connection(s)
I20260808 14:37:34.758926 5191 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
I20260808 14:37:34.763535 5396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:34.761463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.194:44249)
0808 14:37:34.762047 (+ 584us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:34.762169 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":156,"threads_started":1}
W20260808 14:37:34.764052 5393 heartbeater.cc:644] Failed to heartbeat to 127.11.131.254:45813 (0 consecutive failures): Network error: Failed to ping master at 127.11.131.254:45813: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
I20260808 14:37:34.764719 5396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:34.764495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.194:33087)
0808 14:37:34.764608 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:34.764661 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260808 14:37:34.765444 5396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:34.765182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.194:55959)
0808 14:37:34.765339 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:34.765390 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
W20260808 14:37:34.765661 5393 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 14:37:34.766937 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 5191
I20260808 14:37:34.767416 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.195:45767
--local_ip_for_outbound_sockets=127.11.131.195
--tserver_master_addrs=127.11.131.254:45813
--webserver_port=44673
--webserver_interface=127.11.131.195
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab
--principal=kudu/127.11.131.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:36449
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:37:34.891553 5397 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:37:34.891839 5397 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:37:34.891882 5397 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:37:34.896128 5397 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:37:34.896202 5397 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:37:34.896296 5397 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.195
I20260808 14:37:34.901837 5397 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:36449
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab
--principal=kudu/127.11.131.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.195:45767
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.131.195
--webserver_port=44673
--tserver_master_addrs=127.11.131.254:45813
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5397
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.195
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:37:34.903225 5397 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:37:34.904321 5397 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 14:37:34.914803 5397 server_base.cc:1034] running on GCE node
W20260808 14:37:34.914736 5404 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:37:34.914711 5403 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:37:34.914750 5406 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:37:34.915444 5397 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:37:34.916081 5397 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:37:34.917279 5397 hybrid_clock.cc:648] HybridClock initialized: now 1786199854917245 us; error 53 us; skew 500 ppm
Aug 08 14:37:34 dist-test-slave-twwt krb5kdc[3119](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199854, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:37:34.920120 5397 init.cc:377] Logged in from keytab as kudu/127.11.131.195@KRBTEST.COM (short username kudu)
I20260808 14:37:34.920959 5397 webserver.cc:460] Webserver started at http://127.11.131.195:44673/ using document root <none> and password file <none>
I20260808 14:37:34.921504 5397 fs_manager.cc:359] Metadata directory not provided
I20260808 14:37:34.921566 5397 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:37:34.925464 5397 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260808 14:37:34.927615 5420 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:34.929026 5397 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:37:34.929127 5397 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-2/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-2/wal
uuid: "4caa5f5b9ece4d528143a7f95f85fd6c"
format_stamp: "Formatted at 2026-08-08 14:36:52 on dist-test-slave-twwt"
server_key: "986d4cde850005d5f2fd43887ef845e7"
server_key_iv: "8c8938bdd7f55337686264bf61409113"
server_key_version: "encryptionkey@0"
I20260808 14:37:34.929694 5397 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:37:34.948555 5397 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:37:34.951843 5397 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:37:34.952049 5397 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:37:34.952744 5397 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:37:34.953624 5397 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:37:34.953672 5397 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:34.953739 5397 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:37:34.953778 5397 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:34.963260 5397 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.195:45767
I20260808 14:37:34.963292 5598 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.195:45767 every 8 connection(s)
I20260808 14:37:34.964313 5397 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
I20260808 14:37:34.965775 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 5397
I20260808 14:37:34.968549 5604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:34.966760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.195:50019)
0808 14:37:34.967261 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:34.967374 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":149,"threads_started":1}
W20260808 14:37:34.969064 5599 heartbeater.cc:644] Failed to heartbeat to 127.11.131.254:45813 (0 consecutive failures): Network error: Failed to ping master at 127.11.131.254:45813: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
I20260808 14:37:34.969684 5604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:34.969467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.195:40687)
0808 14:37:34.969571 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:34.969623 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260808 14:37:34.970338 5604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:34.970141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.195:45953)
0808 14:37:34.970238 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:34.970280 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260808 14:37:34.970525 5599 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 14:37:35.612165 5606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:35.611652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.193:51205)
0808 14:37:35.611991 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:35.612055 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":91,"threads_started":1}
I20260808 14:37:35.766824 5607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:35.766306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.194:54899)
0808 14:37:35.766592 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:35.766713 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":76,"threads_started":1}
I20260808 14:37:35.971549 5608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:35.971111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.195:50337)
0808 14:37:35.971366 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:35.971427 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":94,"threads_started":1}
I20260808 14:37:36.070103 5609 raft_consensus.cc:482] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:37:36.070444 5609 raft_consensus.cc:504] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "299eed87e3fb4bbb9c07f298376f5b84" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 34113 } } peers { permanent_uuid: "4caa5f5b9ece4d528143a7f95f85fd6c" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45767 } } peers { permanent_uuid: "16bb053aea7c4ab6b077a408aa7652dd" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 37453 } }
I20260808 14:37:36.071696 5609 leader_election.cc:288] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 299eed87e3fb4bbb9c07f298376f5b84 (127.11.131.194:34113), 4caa5f5b9ece4d528143a7f95f85fd6c (127.11.131.195:45767)
Aug 08 14:37:36 dist-test-slave-twwt krb5kdc[3119](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199854, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.193@KRBTEST.COM for kudu/127.11.131.194@KRBTEST.COM
Aug 08 14:37:36 dist-test-slave-twwt krb5kdc[3119](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199854, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.193@KRBTEST.COM for kudu/127.11.131.195@KRBTEST.COM
I20260808 14:37:36.089617 5611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:36.072237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:47757 (local address 127.11.131.195:45767)
0808 14:37:36.072673 (+ 436us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:36.072708 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:36.072759 (+ 51us) server_negotiation.cc:407] Connection header received
0808 14:37:36.073721 (+ 962us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:36.073727 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:36.074195 (+ 468us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:36.074545 (+ 350us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:37:36.076649 (+ 2104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:36.078215 (+ 1566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:36.080264 (+ 2049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:36.081018 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:36.081200 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:36.084919 (+ 3719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:37:36.084923 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:37:36.084935 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:37:36.084965 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:37:36.086963 (+ 1998us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:37:36.087448 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:37:36.087457 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:37:36.087463 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:37:36.087620 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:37:36.087989 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:37:36.087992 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:37:36.087994 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:37:36.088411 (+ 417us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:37:36.088558 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:36.089141 (+ 583us) server_negotiation.cc:299] Negotiation successful
0808 14:37:36.089422 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":106,"threads_started":1}
I20260808 14:37:36.089604 5606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:36.071890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.194:34113 (local address 127.11.131.193:60863)
0808 14:37:36.072025 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:36.072041 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:37:36.072156 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:37:36.074689 (+ 2533us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:37:36.074696 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:37:36.075388 (+ 692us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:37:36.076362 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:36.076385 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:36.078419 (+ 2034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:36.078423 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:36.080127 (+ 1704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:36.080140 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:36.081175 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:36.081179 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:36.081548 (+ 369us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:36.082331 (+ 783us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:37:36.082349 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:37:36.084345 (+ 1996us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:37:36.086781 (+ 2436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:37:36.086788 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:37:36.086804 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:37:36.087197 (+ 393us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:37:36.087623 (+ 426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:37:36.087627 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:37:36.087630 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:37:36.087826 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:37:36.088547 (+ 721us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:37:36.088554 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:37:36.088809 (+ 255us) client_negotiation.cc:769] Sending connection context
0808 14:37:36.089001 (+ 192us) client_negotiation.cc:240] Negotiation successful
0808 14:37:36.089402 (+ 401us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47,"mutex_wait_us":425,"spinlock_wait_cycles":45568}
I20260808 14:37:36.089651 5610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:36.072000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.195:45767 (local address 127.11.131.193:47757)
0808 14:37:36.072317 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:36.072328 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:37:36.072404 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:37:36.074689 (+ 2285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:37:36.074696 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:37:36.075388 (+ 692us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:37:36.076362 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:36.076385 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:36.078419 (+ 2034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:36.078423 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:36.080127 (+ 1704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:36.080140 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:36.081175 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:36.081179 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:36.081545 (+ 366us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:36.082312 (+ 767us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:37:36.082346 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:37:36.084712 (+ 2366us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:37:36.087073 (+ 2361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:37:36.087076 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:37:36.087077 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:37:36.087310 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:37:36.087745 (+ 435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:37:36.087748 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:37:36.087750 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:37:36.087873 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:37:36.088583 (+ 710us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:37:36.088585 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:37:36.088808 (+ 223us) client_negotiation.cc:769] Sending connection context
0808 14:37:36.089001 (+ 193us) client_negotiation.cc:240] Negotiation successful
0808 14:37:36.089488 (+ 487us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"mutex_wait_us":662,"spinlock_wait_cycles":36608,"thread_start_us":85,"threads_started":1}
I20260808 14:37:36.089646 5613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:36.072279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:60863 (local address 127.11.131.194:34113)
0808 14:37:36.072661 (+ 382us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:36.072706 (+ 45us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:36.072759 (+ 53us) server_negotiation.cc:407] Connection header received
0808 14:37:36.073712 (+ 953us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:36.073722 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:36.074195 (+ 473us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:36.074545 (+ 350us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:37:36.076580 (+ 2035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:36.078215 (+ 1635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:36.080264 (+ 2049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:36.081018 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:36.081200 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:36.084640 (+ 3440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:37:36.084648 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:37:36.084668 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:37:36.084702 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:37:36.086651 (+ 1949us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:37:36.087341 (+ 690us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:37:36.087350 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:37:36.087359 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:37:36.087512 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:37:36.087974 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:37:36.087977 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:37:36.087979 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:37:36.088412 (+ 433us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:37:36.088528 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:36.089142 (+ 614us) server_negotiation.cc:299] Negotiation successful
0808 14:37:36.089454 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":241,"thread_start_us":127,"threads_started":1}
W20260808 14:37:36.092556 5023 leader_election.cc:341] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4caa5f5b9ece4d528143a7f95f85fd6c (127.11.131.195:45767): Not found: Tablet not found: bd817157c5784b689aee352895507975
W20260808 14:37:36.092758 5019 leader_election.cc:341] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 299eed87e3fb4bbb9c07f298376f5b84 (127.11.131.194:34113): Not found: Tablet not found: bd817157c5784b689aee352895507975
I20260808 14:37:36.092914 5019 leader_election.cc:302] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16bb053aea7c4ab6b077a408aa7652dd; no voters: 299eed87e3fb4bbb9c07f298376f5b84, 4caa5f5b9ece4d528143a7f95f85fd6c
I20260808 14:37:36.093204 5609 raft_consensus.cc:2726] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 14:37:36.613346 5614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:36.612938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.193:50997)
0808 14:37:36.613190 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:36.613244 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":77,"threads_started":1}
I20260808 14:37:36.768194 5615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:36.767736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.194:41179)
0808 14:37:36.768034 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:36.768095 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":84,"threads_started":1}
I20260808 14:37:36.972839 5616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:36.972367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.195:59263)
0808 14:37:36.972664 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:36.972743 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":79,"threads_started":1}
I20260808 14:37:37.614794 5618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:37.614290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.193:55425)
0808 14:37:37.614600 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:37.614690 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":108,"threads_started":1}
I20260808 14:37:37.709975 5619 raft_consensus.cc:482] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:37:37.710145 5619 raft_consensus.cc:504] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "299eed87e3fb4bbb9c07f298376f5b84" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 34113 } } peers { permanent_uuid: "4caa5f5b9ece4d528143a7f95f85fd6c" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45767 } } peers { permanent_uuid: "16bb053aea7c4ab6b077a408aa7652dd" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 37453 } }
I20260808 14:37:37.710666 5619 leader_election.cc:288] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 299eed87e3fb4bbb9c07f298376f5b84 (127.11.131.194:34113), 4caa5f5b9ece4d528143a7f95f85fd6c (127.11.131.195:45767)
W20260808 14:37:37.711561 5023 leader_election.cc:341] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4caa5f5b9ece4d528143a7f95f85fd6c (127.11.131.195:45767): Not found: Tablet not found: bd817157c5784b689aee352895507975
W20260808 14:37:37.711671 5019 leader_election.cc:341] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 299eed87e3fb4bbb9c07f298376f5b84 (127.11.131.194:34113): Not found: Tablet not found: bd817157c5784b689aee352895507975
I20260808 14:37:37.711799 5019 leader_election.cc:302] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16bb053aea7c4ab6b077a408aa7652dd; no voters: 299eed87e3fb4bbb9c07f298376f5b84, 4caa5f5b9ece4d528143a7f95f85fd6c
I20260808 14:37:37.712003 5619 raft_consensus.cc:2726] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 14:37:37.769760 5621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:37.769139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.194:58007)
0808 14:37:37.769552 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:37.769630 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":102,"threads_started":1}
I20260808 14:37:37.974025 5622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:37.973614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.195:49229)
0808 14:37:37.973873 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:37.973932 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":80,"threads_started":1}
I20260808 14:37:38.616044 5623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:38.615569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.193:44117)
0808 14:37:38.615878 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:38.615942 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":83,"threads_started":1}
I20260808 14:37:38.771162 5624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:38.770665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.194:53135)
0808 14:37:38.770992 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:38.771059 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":127,"threads_started":1}
I20260808 14:37:38.975468 5625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:38.974891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.195:37257)
0808 14:37:38.975239 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:38.975320 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":103,"threads_started":1}
I20260808 14:37:39.617604 5626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:39.617075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.193:38307)
0808 14:37:39.617438 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:39.617504 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":79,"threads_started":1}
I20260808 14:37:39.665764 5627 raft_consensus.cc:482] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:37:39.665952 5627 raft_consensus.cc:504] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "299eed87e3fb4bbb9c07f298376f5b84" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 34113 } } peers { permanent_uuid: "4caa5f5b9ece4d528143a7f95f85fd6c" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45767 } } peers { permanent_uuid: "16bb053aea7c4ab6b077a408aa7652dd" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 37453 } }
I20260808 14:37:39.666471 5627 leader_election.cc:288] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 299eed87e3fb4bbb9c07f298376f5b84 (127.11.131.194:34113), 4caa5f5b9ece4d528143a7f95f85fd6c (127.11.131.195:45767)
W20260808 14:37:39.667249 5023 leader_election.cc:341] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4caa5f5b9ece4d528143a7f95f85fd6c (127.11.131.195:45767): Not found: Tablet not found: bd817157c5784b689aee352895507975
W20260808 14:37:39.667344 5019 leader_election.cc:341] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 299eed87e3fb4bbb9c07f298376f5b84 (127.11.131.194:34113): Not found: Tablet not found: bd817157c5784b689aee352895507975
I20260808 14:37:39.667443 5019 leader_election.cc:302] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16bb053aea7c4ab6b077a408aa7652dd; no voters: 299eed87e3fb4bbb9c07f298376f5b84, 4caa5f5b9ece4d528143a7f95f85fd6c
I20260808 14:37:39.667583 5627 raft_consensus.cc:2726] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 14:37:39.772601 5628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:39.772110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.194:56369)
0808 14:37:39.772412 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:39.772495 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":90,"threads_started":1}
I20260808 14:37:39.976755 5629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:39.976328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.195:58301)
0808 14:37:39.976606 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:39.976660 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":113,"threads_started":1}
I20260808 14:37:40.618850 5630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:40.618346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.193:37615)
0808 14:37:40.618685 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:40.618748 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":84,"threads_started":1}
I20260808 14:37:40.774179 5634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:40.773729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.194:50409)
0808 14:37:40.774011 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:40.774075 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":82,"threads_started":1}
I20260808 14:37:40.978088 5635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:40.977624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.195:56523)
0808 14:37:40.977927 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:40.977987 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":100,"threads_started":1}
I20260808 14:37:41.620165 5636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:41.619655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.193:59563)
0808 14:37:41.619996 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:41.620061 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":123,"threads_started":1}
I20260808 14:37:41.775492 5637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:41.775010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.194:32915)
0808 14:37:41.775336 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:41.775394 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":93,"threads_started":1}
I20260808 14:37:41.979522 5638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:41.978996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.195:45457)
0808 14:37:41.979355 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:41.979421 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":82,"threads_started":1}
I20260808 14:37:42.621637 5640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:42.621099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.193:48529)
0808 14:37:42.621447 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:42.621521 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":88,"threads_started":1}
I20260808 14:37:42.776880 5642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:42.776423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.194:38365)
0808 14:37:42.776710 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:42.776778 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":87,"threads_started":1}
I20260808 14:37:42.981001 5644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:42.980502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.195:47731)
0808 14:37:42.980822 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:42.980895 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":84,"threads_started":1}
I20260808 14:37:43.390735 5646 raft_consensus.cc:482] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:37:43.390892 5646 raft_consensus.cc:504] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "299eed87e3fb4bbb9c07f298376f5b84" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 34113 } } peers { permanent_uuid: "4caa5f5b9ece4d528143a7f95f85fd6c" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45767 } } peers { permanent_uuid: "16bb053aea7c4ab6b077a408aa7652dd" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 37453 } }
I20260808 14:37:43.391484 5646 leader_election.cc:288] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 299eed87e3fb4bbb9c07f298376f5b84 (127.11.131.194:34113), 4caa5f5b9ece4d528143a7f95f85fd6c (127.11.131.195:45767)
W20260808 14:37:43.392395 5023 leader_election.cc:341] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4caa5f5b9ece4d528143a7f95f85fd6c (127.11.131.195:45767): Not found: Tablet not found: bd817157c5784b689aee352895507975
W20260808 14:37:43.392490 5019 leader_election.cc:341] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 299eed87e3fb4bbb9c07f298376f5b84 (127.11.131.194:34113): Not found: Tablet not found: bd817157c5784b689aee352895507975
I20260808 14:37:43.392602 5019 leader_election.cc:302] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16bb053aea7c4ab6b077a408aa7652dd; no voters: 299eed87e3fb4bbb9c07f298376f5b84, 4caa5f5b9ece4d528143a7f95f85fd6c
I20260808 14:37:43.392788 5646 raft_consensus.cc:2726] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 14:37:43.623196 5649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:43.622712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.193:54803)
0808 14:37:43.623024 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:43.623092 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":102,"threads_started":1}
I20260808 14:37:43.778154 5652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:43.777751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.194:38823)
0808 14:37:43.778003 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:43.778056 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":78,"threads_started":1}
I20260808 14:37:43.982414 5654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:43.981928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.195:59917)
0808 14:37:43.982251 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:43.982314 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":107,"threads_started":1}
I20260808 14:37:44.624548 5656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:44.624093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.193:58821)
0808 14:37:44.624382 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:44.624441 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":98,"threads_started":1}
I20260808 14:37:44.779521 5657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:44.779056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.194:33325)
0808 14:37:44.779360 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:44.779421 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":91,"threads_started":1}
I20260808 14:37:44.983752 5659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:44.983292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.195:47985)
0808 14:37:44.983585 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:44.983649 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":92,"threads_started":1}
I20260808 14:37:45.626139 5660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:45.625545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.193:58053)
0808 14:37:45.625930 (+ 385us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:45.626012 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":82,"threads_started":1}
I20260808 14:37:45.780712 5661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:45.780285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.194:41983)
0808 14:37:45.780558 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:45.780613 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":93,"threads_started":1}
I20260808 14:37:45.985121 5662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:45.984641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.195:51691)
0808 14:37:45.984947 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:45.985013 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":83,"threads_started":1}
I20260808 14:37:46.627683 5663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:46.627137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.193:52285)
0808 14:37:46.627486 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:46.627561 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":79,"threads_started":1}
I20260808 14:37:46.782112 5664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:46.781607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.194:40375)
0808 14:37:46.781935 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:46.782008 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":91,"threads_started":1}
I20260808 14:37:46.986346 5666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:46.985904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.195:42735)
0808 14:37:46.986185 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:46.986239 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":105,"threads_started":1}
I20260808 14:37:47.628997 5667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:47.628526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.193:46069)
0808 14:37:47.628831 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:47.628895 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":82,"threads_started":1}
I20260808 14:37:47.783463 5668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:47.783048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.194:44583)
0808 14:37:47.783309 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:47.783364 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":80,"threads_started":1}
I20260808 14:37:47.987622 5671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:47.987165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.195:44859)
0808 14:37:47.987439 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:47.987498 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":82,"threads_started":1}
I20260808 14:37:48.013245 5675 raft_consensus.cc:482] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:37:48.013473 5675 raft_consensus.cc:504] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "299eed87e3fb4bbb9c07f298376f5b84" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 34113 } } peers { permanent_uuid: "4caa5f5b9ece4d528143a7f95f85fd6c" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45767 } } peers { permanent_uuid: "16bb053aea7c4ab6b077a408aa7652dd" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 37453 } }
I20260808 14:37:48.013988 5675 leader_election.cc:288] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 299eed87e3fb4bbb9c07f298376f5b84 (127.11.131.194:34113), 4caa5f5b9ece4d528143a7f95f85fd6c (127.11.131.195:45767)
W20260808 14:37:48.014801 5019 leader_election.cc:341] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 299eed87e3fb4bbb9c07f298376f5b84 (127.11.131.194:34113): Not found: Tablet not found: bd817157c5784b689aee352895507975
W20260808 14:37:48.014942 5023 leader_election.cc:341] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4caa5f5b9ece4d528143a7f95f85fd6c (127.11.131.195:45767): Not found: Tablet not found: bd817157c5784b689aee352895507975
I20260808 14:37:48.015033 5023 leader_election.cc:302] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 16bb053aea7c4ab6b077a408aa7652dd; no voters: 299eed87e3fb4bbb9c07f298376f5b84, 4caa5f5b9ece4d528143a7f95f85fd6c
I20260808 14:37:48.015198 5675 raft_consensus.cc:2726] T bd817157c5784b689aee352895507975 P 16bb053aea7c4ab6b077a408aa7652dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 14:37:48.630502 5676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:48.629945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.193:52509)
0808 14:37:48.630319 (+ 374us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:48.630380 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":122,"threads_started":1}
I20260808 14:37:48.784787 5677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:48.784320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.194:55531)
0808 14:37:48.784626 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:48.784684 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":113,"threads_started":1}
I20260808 14:37:48.988924 5680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:48.988461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.195:42407)
0808 14:37:48.988753 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:48.988821 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":110,"threads_started":1}
I20260808 14:37:49.632037 5681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:49.631571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.193:57709)
0808 14:37:49.631877 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:49.631938 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":91,"threads_started":1}
I20260808 14:37:49.786293 5683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:49.785883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.194:59035)
0808 14:37:49.786144 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:49.786195 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":92,"threads_started":1}
I20260808 14:37:49.969775 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 4933
I20260808 14:37:49.990456 5686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:49.989975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:45813 (local address 127.11.131.195:50969)
0808 14:37:49.990279 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:49.990348 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.254:45813: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":106,"threads_started":1}
I20260808 14:37:49.992035 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 5191
I20260808 14:37:50.004626 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 5397
2026-08-08T14:37:50Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (59883 ms)
[----------] 30 tests from SecurityITest (254746 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:37:50 dist-test-slave-twwt krb5kdc[5689](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:37:50 dist-test-slave-twwt krb5kdc[5689](info): set up 2 sockets
Aug 08 14:37:50 dist-test-slave-twwt krb5kdc[5689](info): commencing operation
krb5kdc: starting...
W20260808 14:37:51.273140 11791 mini_kdc.cc:121] Time spent starting KDC: real 1.237s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Aug 08 14:37:51 dist-test-slave-twwt krb5kdc[5689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199871, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:37:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:37:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.131.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
I20260808 14:37:51.413306 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:43545
--webserver_interface=127.11.131.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:46837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:43545
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:37:51.532369 5710 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:37:51.532709 5710 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:37:51.532783 5710 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:37:51.536861 5710 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:37:51.536952 5710 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:37:51.536993 5710 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:37:51.537060 5710 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:37:51.537101 5710 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:37:51.542469 5710 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:46837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:43545
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:43545
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.131.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5710
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:37:51.543572 5710 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:37:51.544624 5710 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 14:37:51.553954 5710 server_base.cc:1034] running on GCE node
W20260808 14:37:51.553905 5720 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:37:51.553998 5719 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:37:51.553905 5722 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:37:51.554941 5710 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:37:51.556277 5710 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:37:51.557500 5710 hybrid_clock.cc:648] HybridClock initialized: now 1786199871557470 us; error 44 us; skew 500 ppm
Aug 08 14:37:51 dist-test-slave-twwt krb5kdc[5689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199871, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:37:51.565135 5710 init.cc:377] Logged in from keytab as kudu/127.11.131.254@KRBTEST.COM (short username kudu)
I20260808 14:37:51.566416 5710 webserver.cc:460] Webserver started at http://127.11.131.254:41767/ using document root <none> and password file <none>
I20260808 14:37:51.567183 5710 fs_manager.cc:359] Metadata directory not provided
I20260808 14:37:51.567312 5710 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:37:51.567593 5710 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:37:51.570055 5710 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/master-0/data/instance:
uuid: "415c95cc0e714b618872673fbae4c446"
format_stamp: "Formatted at 2026-08-08 14:37:51 on dist-test-slave-twwt"
server_key: "8f74509184b2a53e82c4ed7c8a01cd5c"
server_key_iv: "c7d8b4b0c86e58c5cf36062a0d20d0c1"
server_key_version: "encryptionkey@0"
I20260808 14:37:51.570822 5710 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/master-0/wal/instance:
uuid: "415c95cc0e714b618872673fbae4c446"
format_stamp: "Formatted at 2026-08-08 14:37:51 on dist-test-slave-twwt"
server_key: "8f74509184b2a53e82c4ed7c8a01cd5c"
server_key_iv: "c7d8b4b0c86e58c5cf36062a0d20d0c1"
server_key_version: "encryptionkey@0"
I20260808 14:37:51.575289 5710 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 14:37:51.578296 5736 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:51.579768 5710 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:37:51.579944 5710 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "415c95cc0e714b618872673fbae4c446"
format_stamp: "Formatted at 2026-08-08 14:37:51 on dist-test-slave-twwt"
server_key: "8f74509184b2a53e82c4ed7c8a01cd5c"
server_key_iv: "c7d8b4b0c86e58c5cf36062a0d20d0c1"
server_key_version: "encryptionkey@0"
I20260808 14:37:51.580080 5710 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:37:51.600282 5710 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:37:51.603534 5710 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:37:51.603755 5710 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:37:51.611435 5710 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.254:43545
I20260808 14:37:51.611460 5814 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.254:43545 every 8 connection(s)
I20260808 14:37:51.612409 5710 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:37:51.615553 5816 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:37:51.621222 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 5710
I20260808 14:37:51.621394 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/master-0/wal/instance
I20260808 14:37:51.621760 11791 external_mini_cluster.cc:1428] Setting key a55e7abbae988f14a8eec756a02be776
I20260808 14:37:51.622084 5816 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 415c95cc0e714b618872673fbae4c446: Bootstrap starting.
I20260808 14:37:51.625029 5816 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 415c95cc0e714b618872673fbae4c446: Neither blocks nor log segments found. Creating new log.
I20260808 14:37:51.626104 5816 log.cc:824] T 00000000000000000000000000000000 P 415c95cc0e714b618872673fbae4c446: Log is configured to *not* fsync() on all Append() calls
I20260808 14:37:51.628746 5816 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 415c95cc0e714b618872673fbae4c446: No bootstrap required, opened a new log
Aug 08 14:37:51 dist-test-slave-twwt krb5kdc[5689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199871, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:37:51.633816 5816 raft_consensus.cc:348] T 00000000000000000000000000000000 P 415c95cc0e714b618872673fbae4c446 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "415c95cc0e714b618872673fbae4c446" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 43545 } }
I20260808 14:37:51.634063 5816 raft_consensus.cc:374] T 00000000000000000000000000000000 P 415c95cc0e714b618872673fbae4c446 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:37:51.634172 5816 raft_consensus.cc:729] T 00000000000000000000000000000000 P 415c95cc0e714b618872673fbae4c446 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 415c95cc0e714b618872673fbae4c446, State: Initialized, Role: FOLLOWER
I20260808 14:37:51.634835 5816 consensus_queue.cc:260] T 00000000000000000000000000000000 P 415c95cc0e714b618872673fbae4c446 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "415c95cc0e714b618872673fbae4c446" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 43545 } }
I20260808 14:37:51.634985 5816 raft_consensus.cc:388] T 00000000000000000000000000000000 P 415c95cc0e714b618872673fbae4c446 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:37:51.635079 5816 raft_consensus.cc:482] T 00000000000000000000000000000000 P 415c95cc0e714b618872673fbae4c446 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:37:51.635190 5816 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 415c95cc0e714b618872673fbae4c446 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:37:51.636500 5816 raft_consensus.cc:504] T 00000000000000000000000000000000 P 415c95cc0e714b618872673fbae4c446 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "415c95cc0e714b618872673fbae4c446" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 43545 } }
I20260808 14:37:51.636925 5816 leader_election.cc:302] T 00000000000000000000000000000000 P 415c95cc0e714b618872673fbae4c446 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 415c95cc0e714b618872673fbae4c446; no voters:
I20260808 14:37:51.637323 5816 leader_election.cc:288] T 00000000000000000000000000000000 P 415c95cc0e714b618872673fbae4c446 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:37:51.637455 5826 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 415c95cc0e714b618872673fbae4c446 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:37:51.637754 5826 raft_consensus.cc:686] T 00000000000000000000000000000000 P 415c95cc0e714b618872673fbae4c446 [term 1 LEADER]: Becoming Leader. State: Replica: 415c95cc0e714b618872673fbae4c446, State: Running, Role: LEADER
I20260808 14:37:51.638154 5826 consensus_queue.cc:237] T 00000000000000000000000000000000 P 415c95cc0e714b618872673fbae4c446 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "415c95cc0e714b618872673fbae4c446" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 43545 } }
I20260808 14:37:51.638932 5816 sys_catalog.cc:564] T 00000000000000000000000000000000 P 415c95cc0e714b618872673fbae4c446 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:37:51.639050 5823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:51.623353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47262 (local address 127.11.131.254:43545)
0808 14:37:51.623857 (+ 504us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:51.623875 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:51.623912 (+ 37us) server_negotiation.cc:407] Connection header received
0808 14:37:51.624566 (+ 654us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:51.624584 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:51.624919 (+ 335us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:51.625296 (+ 377us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:37:51.626349 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:51.627709 (+ 1360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:51.629006 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:51.629478 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:51.629630 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:51.632903 (+ 3273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:37:51.632909 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:37:51.632925 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:37:51.632957 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:37:51.635224 (+ 2267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:37:51.635755 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:37:51.635762 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:37:51.635769 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:37:51.635927 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:37:51.636325 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:37:51.636332 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:37:51.636337 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:37:51.636942 (+ 605us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:37:51.637155 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:51.637598 (+ 443us) server_negotiation.cc:299] Negotiation successful
0808 14:37:51.637948 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":345,"thread_start_us":152,"threads_started":1}
I20260808 14:37:51.640064 5827 sys_catalog.cc:455] T 00000000000000000000000000000000 P 415c95cc0e714b618872673fbae4c446 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "415c95cc0e714b618872673fbae4c446" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "415c95cc0e714b618872673fbae4c446" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 43545 } } }
I20260808 14:37:51.640457 5827 sys_catalog.cc:458] T 00000000000000000000000000000000 P 415c95cc0e714b618872673fbae4c446 [sys.catalog]: This master's current role is: LEADER
I20260808 14:37:51.640352 5829 sys_catalog.cc:455] T 00000000000000000000000000000000 P 415c95cc0e714b618872673fbae4c446 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 415c95cc0e714b618872673fbae4c446. Latest consensus state: current_term: 1 leader_uuid: "415c95cc0e714b618872673fbae4c446" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "415c95cc0e714b618872673fbae4c446" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 43545 } } }
I20260808 14:37:51.640800 5829 sys_catalog.cc:458] T 00000000000000000000000000000000 P 415c95cc0e714b618872673fbae4c446 [sys.catalog]: This master's current role is: LEADER
I20260808 14:37:51.641496 5838 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:37:51.644467 5838 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:37:51.650851 5838 catalog_manager.cc:1347] Generated new cluster ID: 08762a9e032a400d88f73b65a001bb44
I20260808 14:37:51.650934 5838 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:37:51.689333 5838 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:37:51.690359 5838 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:37:51.699703 5838 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 415c95cc0e714b618872673fbae4c446: Generated new TSK 0
I20260808 14:37:51.700486 5838 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.131.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab.
Entry for principal kudu/127.11.131.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab.
I20260808 14:37:51.748333 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.193:0
--local_ip_for_outbound_sockets=127.11.131.193
--webserver_interface=127.11.131.193
--webserver_port=0
--tserver_master_addrs=127.11.131.254:43545
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab
--principal=kudu/127.11.131.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:46837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:37:51.869083 5858 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:37:51.869467 5858 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:37:51.869565 5858 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:37:51.873799 5858 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:37:51.873867 5858 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:37:51.873929 5858 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.193
I20260808 14:37:51.879453 5858 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:46837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab
--principal=kudu/127.11.131.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.131.193
--webserver_port=0
--tserver_master_addrs=127.11.131.254:43545
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5858
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.193
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:37:51.880589 5858 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:37:51.881691 5858 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:37:51.892416 5869 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:37:51.892417 5872 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:37:51.892441 5875 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:37:51.892799 5858 server_base.cc:1034] running on GCE node
I20260808 14:37:51.893326 5858 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:37:51.894080 5858 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:37:51.895283 5858 hybrid_clock.cc:648] HybridClock initialized: now 1786199871895268 us; error 36 us; skew 500 ppm
Aug 08 14:37:51 dist-test-slave-twwt krb5kdc[5689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199871, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:37:51.898811 5858 init.cc:377] Logged in from keytab as kudu/127.11.131.193@KRBTEST.COM (short username kudu)
I20260808 14:37:51.899909 5858 webserver.cc:460] Webserver started at http://127.11.131.193:32909/ using document root <none> and password file <none>
I20260808 14:37:51.900574 5858 fs_manager.cc:359] Metadata directory not provided
I20260808 14:37:51.900647 5858 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:37:51.900934 5858 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:37:51.903393 5858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/ts-0/data/instance:
uuid: "a84c2deaa93d45679e8dcb302109ddac"
format_stamp: "Formatted at 2026-08-08 14:37:51 on dist-test-slave-twwt"
server_key: "b2dbbc95ad35d9e0c63cecba3ce230b8"
server_key_iv: "3c507793cb1b4bcdca1dcc2c22532585"
server_key_version: "encryptionkey@0"
I20260808 14:37:51.904084 5858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/ts-0/wal/instance:
uuid: "a84c2deaa93d45679e8dcb302109ddac"
format_stamp: "Formatted at 2026-08-08 14:37:51 on dist-test-slave-twwt"
server_key: "b2dbbc95ad35d9e0c63cecba3ce230b8"
server_key_iv: "3c507793cb1b4bcdca1dcc2c22532585"
server_key_version: "encryptionkey@0"
I20260808 14:37:51.908352 5858 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 14:37:51.911207 5883 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:51.912518 5858 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:37:51.912660 5858 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/ts-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/ts-0/wal
uuid: "a84c2deaa93d45679e8dcb302109ddac"
format_stamp: "Formatted at 2026-08-08 14:37:51 on dist-test-slave-twwt"
server_key: "b2dbbc95ad35d9e0c63cecba3ce230b8"
server_key_iv: "3c507793cb1b4bcdca1dcc2c22532585"
server_key_version: "encryptionkey@0"
I20260808 14:37:51.912807 5858 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:37:51.928226 5858 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:37:51.931985 5858 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:37:51.932221 5858 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:37:51.932922 5858 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:37:51.933844 5858 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:37:51.933897 5858 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:51.933941 5858 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:37:51.934005 5858 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:51.944797 5858 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.193:34549
I20260808 14:37:51.944820 6053 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.193:34549 every 8 connection(s)
I20260808 14:37:51.945782 5858 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
I20260808 14:37:51.946766 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 5858
I20260808 14:37:51.946920 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/ts-0/wal/instance
I20260808 14:37:51.947271 11791 external_mini_cluster.cc:1428] Setting key 98f196bf871ff3caec16c69016c81a92
Aug 08 14:37:51 dist-test-slave-twwt krb5kdc[5689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199871, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.193@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.131.194@KRBTEST.COM; defaulting to no policy
I20260808 14:37:51.964664 5823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:51.947865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:49631 (local address 127.11.131.254:43545)
0808 14:37:51.948045 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:51.948049 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:51.949114 (+ 1065us) server_negotiation.cc:407] Connection header received
0808 14:37:51.950864 (+ 1750us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:51.950871 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:51.950942 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:51.951046 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:37:51.952838 (+ 1792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:51.953892 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:51.956016 (+ 2124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:51.956500 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:51.956612 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:51.960436 (+ 3824us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:37:51.960440 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:37:51.960442 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:37:51.960474 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:37:51.962211 (+ 1737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:37:51.962943 (+ 732us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:37:51.962947 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:37:51.962949 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:37:51.963042 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:37:51.963434 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:37:51.963437 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:37:51.963439 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:37:51.963676 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:37:51.963829 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:51.964407 (+ 578us) server_negotiation.cc:299] Negotiation successful
0808 14:37:51.964526 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.194@KRBTEST.COM" created.
I20260808 14:37:51.965637 6057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:51.948275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:43545 (local address 127.11.131.193:49631)
0808 14:37:51.948946 (+ 671us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:51.949001 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 14:37:51.950575 (+ 1574us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:37:51.951298 (+ 723us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:37:51.951308 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:37:51.951881 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:37:51.952625 (+ 744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:51.952646 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:51.954079 (+ 1433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:51.954083 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:51.955854 (+ 1771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:51.955872 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:51.956809 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:51.956813 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:51.957040 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:51.957861 (+ 821us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:37:51.957888 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:37:51.960179 (+ 2291us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:37:51.962357 (+ 2178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:37:51.962364 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:37:51.962383 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:37:51.962800 (+ 417us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:37:51.963152 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:37:51.963156 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:37:51.963158 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:37:51.963324 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:37:51.963827 (+ 503us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:37:51.963833 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:37:51.964124 (+ 291us) client_negotiation.cc:769] Sending connection context
0808 14:37:51.964308 (+ 184us) client_negotiation.cc:240] Negotiation successful
0808 14:37:51.964607 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":434,"thread_start_us":148,"threads_started":1}
I20260808 14:37:51.967146 6054 heartbeater.cc:347] Connected to a master server at 127.11.131.254:43545
I20260808 14:37:51.967428 6054 heartbeater.cc:464] Registering TS with master...
I20260808 14:37:51.968036 6054 heartbeater.cc:511] Master 127.11.131.254:43545 requested a full tablet report, sending...
I20260808 14:37:51.969911 5760 ts_manager.cc:194] Registered new tserver with Master: a84c2deaa93d45679e8dcb302109ddac (127.11.131.193:34549)
I20260808 14:37:51.971808 5760 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.193@KRBTEST.COM'} at 127.11.131.193:49631
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab.
Entry for principal kudu/127.11.131.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab.
I20260808 14:37:51.986351 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.194:0
--local_ip_for_outbound_sockets=127.11.131.194
--webserver_interface=127.11.131.194
--webserver_port=0
--tserver_master_addrs=127.11.131.254:43545
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab
--principal=kudu/127.11.131.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:46837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:37:52.107364 6065 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:37:52.107631 6065 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:37:52.107674 6065 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:37:52.111608 6065 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:37:52.111657 6065 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:37:52.111714 6065 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.194
I20260808 14:37:52.116938 6065 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:46837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab
--principal=kudu/127.11.131.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.131.194
--webserver_port=0
--tserver_master_addrs=127.11.131.254:43545
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6065
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.194
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:37:52.117973 6065 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:37:52.119032 6065 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:37:52.128811 6077 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:37:52.128752 6074 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:37:52.128755 6072 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:37:52.129122 6065 server_base.cc:1034] running on GCE node
I20260808 14:37:52.129544 6065 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:37:52.130133 6065 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:37:52.131297 6065 hybrid_clock.cc:648] HybridClock initialized: now 1786199872131264 us; error 39 us; skew 500 ppm
Aug 08 14:37:52 dist-test-slave-twwt krb5kdc[5689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199872, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:37:52.134235 6065 init.cc:377] Logged in from keytab as kudu/127.11.131.194@KRBTEST.COM (short username kudu)
I20260808 14:37:52.135208 6065 webserver.cc:460] Webserver started at http://127.11.131.194:45289/ using document root <none> and password file <none>
I20260808 14:37:52.135803 6065 fs_manager.cc:359] Metadata directory not provided
I20260808 14:37:52.135871 6065 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:37:52.136097 6065 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:37:52.138293 6065 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/ts-1/data/instance:
uuid: "55399ca225c546d7b98de5683a4c2c6c"
format_stamp: "Formatted at 2026-08-08 14:37:52 on dist-test-slave-twwt"
server_key: "4a74a0641f1b1f2ee2802c21331a9d6b"
server_key_iv: "4a154b330434358da1c72c49463a8f02"
server_key_version: "encryptionkey@0"
I20260808 14:37:52.138947 6065 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/ts-1/wal/instance:
uuid: "55399ca225c546d7b98de5683a4c2c6c"
format_stamp: "Formatted at 2026-08-08 14:37:52 on dist-test-slave-twwt"
server_key: "4a74a0641f1b1f2ee2802c21331a9d6b"
server_key_iv: "4a154b330434358da1c72c49463a8f02"
server_key_version: "encryptionkey@0"
I20260808 14:37:52.143213 6065 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 14:37:52.145744 6089 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:52.147164 6065 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:37:52.147305 6065 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/ts-1/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/ts-1/wal
uuid: "55399ca225c546d7b98de5683a4c2c6c"
format_stamp: "Formatted at 2026-08-08 14:37:52 on dist-test-slave-twwt"
server_key: "4a74a0641f1b1f2ee2802c21331a9d6b"
server_key_iv: "4a154b330434358da1c72c49463a8f02"
server_key_version: "encryptionkey@0"
I20260808 14:37:52.147424 6065 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:37:52.164709 6065 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:37:52.168354 6065 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:37:52.168609 6065 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:37:52.169289 6065 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:37:52.170302 6065 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:37:52.170382 6065 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:52.170457 6065 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:37:52.170497 6065 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:52.180434 6065 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.194:45763
I20260808 14:37:52.180454 6245 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.194:45763 every 8 connection(s)
I20260808 14:37:52.181422 6065 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
I20260808 14:37:52.184480 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 6065
I20260808 14:37:52.184615 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/ts-1/wal/instance
I20260808 14:37:52.184927 11791 external_mini_cluster.cc:1428] Setting key 605e8a4e35313504c8aa060b1930b741
Aug 08 14:37:52 dist-test-slave-twwt krb5kdc[5689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199872, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.194@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.131.195@KRBTEST.COM; defaulting to no policy
I20260808 14:37:52.196780 5823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:52.183312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:45119 (local address 127.11.131.254:43545)
0808 14:37:52.183456 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:52.183460 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:52.184457 (+ 997us) server_negotiation.cc:407] Connection header received
0808 14:37:52.186126 (+ 1669us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:52.186129 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:52.186185 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:52.186268 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:37:52.187564 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:52.188082 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:52.189812 (+ 1730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:52.190050 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:52.190175 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:52.193063 (+ 2888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:37:52.193067 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:37:52.193069 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:37:52.193095 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:37:52.194655 (+ 1560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:37:52.195190 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:37:52.195194 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:37:52.195196 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:37:52.195283 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:37:52.195641 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:37:52.195646 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:37:52.195647 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:37:52.195843 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:37:52.195963 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:52.196472 (+ 509us) server_negotiation.cc:299] Negotiation successful
0808 14:37:52.196610 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 14:37:52.197721 6249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:52.183747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:43545 (local address 127.11.131.194:45119)
0808 14:37:52.184272 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:52.184355 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0808 14:37:52.185907 (+ 1552us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:37:52.186449 (+ 542us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:37:52.186455 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:37:52.186884 (+ 429us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:37:52.187396 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:52.187410 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:52.188212 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:52.188218 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:52.189673 (+ 1455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:52.189688 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:52.190231 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:52.190235 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:52.190418 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:52.191078 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:37:52.191095 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:37:52.192885 (+ 1790us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:37:52.194780 (+ 1895us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:37:52.194787 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:37:52.194803 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:37:52.195079 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:37:52.195388 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:37:52.195392 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:37:52.195394 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:37:52.195540 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:37:52.195962 (+ 422us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:37:52.195969 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:37:52.196227 (+ 258us) client_negotiation.cc:769] Sending connection context
0808 14:37:52.196427 (+ 200us) client_negotiation.cc:240] Negotiation successful
0808 14:37:52.196799 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":128,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.195@KRBTEST.COM" created.
I20260808 14:37:52.199074 6246 heartbeater.cc:347] Connected to a master server at 127.11.131.254:43545
I20260808 14:37:52.199368 6246 heartbeater.cc:464] Registering TS with master...
I20260808 14:37:52.200002 6246 heartbeater.cc:511] Master 127.11.131.254:43545 requested a full tablet report, sending...
I20260808 14:37:52.201227 5760 ts_manager.cc:194] Registered new tserver with Master: 55399ca225c546d7b98de5683a4c2c6c (127.11.131.194:45763)
I20260808 14:37:52.201843 5760 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.194@KRBTEST.COM'} at 127.11.131.194:45119
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab.
Entry for principal kudu/127.11.131.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab.
I20260808 14:37:52.216022 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.195:0
--local_ip_for_outbound_sockets=127.11.131.195
--webserver_interface=127.11.131.195
--webserver_port=0
--tserver_master_addrs=127.11.131.254:43545
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab
--principal=kudu/127.11.131.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:46837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:37:52.335628 6252 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:37:52.336014 6252 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:37:52.336104 6252 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:37:52.340633 6252 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:37:52.340719 6252 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:37:52.340806 6252 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.195
I20260808 14:37:52.346252 6252 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:46837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab
--principal=kudu/127.11.131.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.131.195
--webserver_port=0
--tserver_master_addrs=127.11.131.254:43545
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6252
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.195
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:37:52.347427 6252 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:37:52.348528 6252 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:37:52.358914 6257 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:37:52.358963 6252 server_base.cc:1034] running on GCE node
W20260808 14:37:52.358922 6258 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:37:52.358922 6262 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:37:52.359601 6252 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:37:52.360242 6252 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:37:52.361411 6252 hybrid_clock.cc:648] HybridClock initialized: now 1786199872361380 us; error 47 us; skew 500 ppm
Aug 08 14:37:52 dist-test-slave-twwt krb5kdc[5689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199872, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:37:52.364283 6252 init.cc:377] Logged in from keytab as kudu/127.11.131.195@KRBTEST.COM (short username kudu)
I20260808 14:37:52.365226 6252 webserver.cc:460] Webserver started at http://127.11.131.195:42667/ using document root <none> and password file <none>
I20260808 14:37:52.365828 6252 fs_manager.cc:359] Metadata directory not provided
I20260808 14:37:52.365921 6252 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:37:52.366165 6252 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:37:52.368338 6252 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/ts-2/data/instance:
uuid: "e2b3fdf0f7f149af9399fd934aa58672"
format_stamp: "Formatted at 2026-08-08 14:37:52 on dist-test-slave-twwt"
server_key: "d95f703f5a2a46120c9261dd9ca948df"
server_key_iv: "647c88309cbd4dcef2b629ab92ce8055"
server_key_version: "encryptionkey@0"
I20260808 14:37:52.368932 6252 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/ts-2/wal/instance:
uuid: "e2b3fdf0f7f149af9399fd934aa58672"
format_stamp: "Formatted at 2026-08-08 14:37:52 on dist-test-slave-twwt"
server_key: "d95f703f5a2a46120c9261dd9ca948df"
server_key_iv: "647c88309cbd4dcef2b629ab92ce8055"
server_key_version: "encryptionkey@0"
I20260808 14:37:52.372901 6252 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260808 14:37:52.375535 6275 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:52.377033 6252 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:37:52.377213 6252 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/ts-2/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/ts-2/wal
uuid: "e2b3fdf0f7f149af9399fd934aa58672"
format_stamp: "Formatted at 2026-08-08 14:37:52 on dist-test-slave-twwt"
server_key: "d95f703f5a2a46120c9261dd9ca948df"
server_key_iv: "647c88309cbd4dcef2b629ab92ce8055"
server_key_version: "encryptionkey@0"
I20260808 14:37:52.377358 6252 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:37:52.406595 6252 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:37:52.410204 6252 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:37:52.410437 6252 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:37:52.411181 6252 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:37:52.412014 6252 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:37:52.412062 6252 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:52.412103 6252 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:37:52.412127 6252 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:52.422032 6252 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.195:36441
I20260808 14:37:52.422060 6444 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.195:36441 every 8 connection(s)
I20260808 14:37:52.423023 6252 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
I20260808 14:37:52.423693 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 6252
I20260808 14:37:52.423851 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/ts-2/wal/instance
I20260808 14:37:52.424175 11791 external_mini_cluster.cc:1428] Setting key f3755a1570006c3826b84bf7b68362f5
Aug 08 14:37:52 dist-test-slave-twwt krb5kdc[5689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199872, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.195@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:37:52.438925 5823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:52.426119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:52275 (local address 127.11.131.254:43545)
0808 14:37:52.426269 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:52.426274 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:52.427363 (+ 1089us) server_negotiation.cc:407] Connection header received
0808 14:37:52.428714 (+ 1351us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:52.428717 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:52.428781 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:52.428854 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:37:52.430052 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:52.430578 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:52.431946 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:52.432179 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:52.432262 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:52.434969 (+ 2707us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:37:52.434972 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:37:52.434974 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:37:52.435005 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:37:52.436482 (+ 1477us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:37:52.437058 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:37:52.437061 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:37:52.437063 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:37:52.437142 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:37:52.437612 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:37:52.437617 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:37:52.437619 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:37:52.437904 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:37:52.438014 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:52.438569 (+ 555us) server_negotiation.cc:299] Negotiation successful
0808 14:37:52.438718 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 14:37:52.439918 6450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:52.426720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:43545 (local address 127.11.131.195:52275)
0808 14:37:52.427203 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:52.427246 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 14:37:52.428520 (+ 1274us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:37:52.429025 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:37:52.429032 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:37:52.429403 (+ 371us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:37:52.429922 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:52.429937 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:52.430750 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:52.430753 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:52.431829 (+ 1076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:52.431840 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:52.432352 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:52.432356 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:52.432526 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:52.433099 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:37:52.433117 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:37:52.434809 (+ 1692us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:37:52.436585 (+ 1776us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:37:52.436590 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:37:52.436603 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:37:52.436947 (+ 344us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:37:52.437344 (+ 397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:37:52.437348 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:37:52.437350 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:37:52.437503 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:37:52.438028 (+ 525us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:37:52.438036 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:37:52.438294 (+ 258us) client_negotiation.cc:769] Sending connection context
0808 14:37:52.438493 (+ 199us) client_negotiation.cc:240] Negotiation successful
0808 14:37:52.438884 (+ 391us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":114,"threads_started":1}
I20260808 14:37:52.441100 6447 heartbeater.cc:347] Connected to a master server at 127.11.131.254:43545
I20260808 14:37:52.441357 6447 heartbeater.cc:464] Registering TS with master...
I20260808 14:37:52.441864 6447 heartbeater.cc:511] Master 127.11.131.254:43545 requested a full tablet report, sending...
I20260808 14:37:52.442971 5760 ts_manager.cc:194] Registered new tserver with Master: e2b3fdf0f7f149af9399fd934aa58672 (127.11.131.195:36441)
I20260808 14:37:52.443548 5760 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.195@KRBTEST.COM'} at 127.11.131.195:52275
I20260808 14:37:52.450314 11791 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:37:52.459966 5823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:52.452563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57838 (local address 127.11.131.254:43545)
0808 14:37:52.452728 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:52.452733 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:52.452871 (+ 138us) server_negotiation.cc:407] Connection header received
0808 14:37:52.453013 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:52.453016 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:52.453061 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:52.453136 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:37:52.453824 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:52.454327 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:52.455188 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:52.455410 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:52.455491 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:52.456851 (+ 1360us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:37:52.456854 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:37:52.456856 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:37:52.456876 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:37:52.458142 (+ 1266us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:37:52.458542 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:37:52.458545 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:37:52.458546 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:37:52.458697 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:37:52.459140 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:37:52.459143 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:37:52.459144 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:37:52.459371 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:37:52.459474 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:52.459682 (+ 208us) server_negotiation.cc:299] Negotiation successful
0808 14:37:52.459774 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 14:37:52.463001 5760 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57838:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:37:52.466040 5760 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:37:52.480614 6471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:52.475842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50096 (local address 127.11.131.194:45763)
0808 14:37:52.476291 (+ 449us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:52.476305 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:52.476339 (+ 34us) server_negotiation.cc:407] Connection header received
0808 14:37:52.476418 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:52.476423 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:52.476641 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:52.476794 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:37:52.477052 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:52.478109 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:52.479350 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:52.479934 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:52.480075 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:52.480216 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:52.480370 (+ 154us) server_negotiation.cc:299] Negotiation successful
0808 14:37:52.480465 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":350,"thread_start_us":127,"threads_started":1}
I20260808 14:37:52.480716 6462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:52.474566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:34549 (local address 127.0.0.1:39004)
0808 14:37:52.474917 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:52.474962 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 14:37:52.475084 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:37:52.476046 (+ 962us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:37:52.476052 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:37:52.476079 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:37:52.476236 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:52.476243 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:52.477917 (+ 1674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:52.477921 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:52.479166 (+ 1245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:52.479176 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:52.480267 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:52.480271 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:52.480380 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:52.480407 (+ 27us) client_negotiation.cc:769] Sending connection context
0808 14:37:52.480455 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 14:37:52.480532 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"mutex_wait_us":32,"thread_start_us":90,"threads_started":1}
I20260808 14:37:52.480605 6465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:52.475295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.194:45763 (local address 127.0.0.1:50096)
0808 14:37:52.475898 (+ 603us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:52.475911 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:37:52.475996 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:37:52.476809 (+ 813us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:37:52.476814 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:37:52.476837 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:37:52.476928 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:52.476936 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:52.478224 (+ 1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:52.478230 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:52.479219 (+ 989us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:52.479230 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:52.480064 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:52.480068 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:52.480170 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:52.480207 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 14:37:52.480335 (+ 128us) client_negotiation.cc:240] Negotiation successful
0808 14:37:52.480455 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":535,"thread_start_us":116,"threads_started":1}
I20260808 14:37:52.481156 6463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:52.474753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39004 (local address 127.11.131.193:34549)
0808 14:37:52.475471 (+ 718us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:52.475481 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:52.475511 (+ 30us) server_negotiation.cc:407] Connection header received
0808 14:37:52.475599 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:52.475605 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:52.475850 (+ 245us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:52.476407 (+ 557us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:37:52.476546 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:52.477744 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:52.479287 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:52.480130 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:52.480699 (+ 569us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:52.480823 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:52.480873 (+ 50us) server_negotiation.cc:299] Negotiation successful
0808 14:37:52.480959 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":605,"thread_start_us":127,"threads_started":1}
I20260808 14:37:52.481775 6464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:52.474820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.195:36441 (local address 127.0.0.1:55996)
0808 14:37:52.475397 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:52.475413 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:37:52.475501 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:37:52.476622 (+ 1121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:37:52.476625 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:37:52.476644 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:37:52.476750 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:52.476760 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:52.477797 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:52.477803 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:52.480301 (+ 2498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:52.480310 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:52.481424 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:52.481428 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:52.481516 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:52.481539 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 14:37:52.481589 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 14:37:52.481652 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":509,"mutex_wait_us":84,"thread_start_us":99,"threads_started":1}
I20260808 14:37:52.482664 6467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:52.475380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55996 (local address 127.11.131.195:36441)
0808 14:37:52.476202 (+ 822us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:52.476211 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:52.476228 (+ 17us) server_negotiation.cc:407] Connection header received
0808 14:37:52.476299 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:52.476303 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:52.476450 (+ 147us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:52.476646 (+ 196us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:37:52.476897 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:52.477662 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:52.480436 (+ 2774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:52.481278 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:52.482259 (+ 981us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:52.482379 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:52.482427 (+ 48us) server_negotiation.cc:299] Negotiation successful
0808 14:37:52.482510 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":734,"thread_start_us":139,"threads_started":1}
I20260808 14:37:52.484579 5952 tablet_service.cc:1467] Processing CreateTablet for tablet b35a05f7094943ab9cc2e4b7b049b99e (DEFAULT_TABLE table=test-table [id=8a3eb53fbfa946b9b277fc628eea844f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:37:52.484596 6151 tablet_service.cc:1467] Processing CreateTablet for tablet b35a05f7094943ab9cc2e4b7b049b99e (DEFAULT_TABLE table=test-table [id=8a3eb53fbfa946b9b277fc628eea844f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:37:52.485134 6342 tablet_service.cc:1467] Processing CreateTablet for tablet b35a05f7094943ab9cc2e4b7b049b99e (DEFAULT_TABLE table=test-table [id=8a3eb53fbfa946b9b277fc628eea844f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:37:52.485692 6151 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b35a05f7094943ab9cc2e4b7b049b99e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:37:52.485692 5952 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b35a05f7094943ab9cc2e4b7b049b99e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:37:52.486037 6342 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b35a05f7094943ab9cc2e4b7b049b99e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:37:52.492024 6472 tablet_bootstrap.cc:492] T b35a05f7094943ab9cc2e4b7b049b99e P a84c2deaa93d45679e8dcb302109ddac: Bootstrap starting.
I20260808 14:37:52.493536 6473 tablet_bootstrap.cc:492] T b35a05f7094943ab9cc2e4b7b049b99e P 55399ca225c546d7b98de5683a4c2c6c: Bootstrap starting.
I20260808 14:37:52.493960 6476 tablet_bootstrap.cc:492] T b35a05f7094943ab9cc2e4b7b049b99e P e2b3fdf0f7f149af9399fd934aa58672: Bootstrap starting.
I20260808 14:37:52.494478 6472 tablet_bootstrap.cc:654] T b35a05f7094943ab9cc2e4b7b049b99e P a84c2deaa93d45679e8dcb302109ddac: Neither blocks nor log segments found. Creating new log.
I20260808 14:37:52.495421 6473 tablet_bootstrap.cc:654] T b35a05f7094943ab9cc2e4b7b049b99e P 55399ca225c546d7b98de5683a4c2c6c: Neither blocks nor log segments found. Creating new log.
I20260808 14:37:52.495464 6472 log.cc:824] T b35a05f7094943ab9cc2e4b7b049b99e P a84c2deaa93d45679e8dcb302109ddac: Log is configured to *not* fsync() on all Append() calls
I20260808 14:37:52.496136 6476 tablet_bootstrap.cc:654] T b35a05f7094943ab9cc2e4b7b049b99e P e2b3fdf0f7f149af9399fd934aa58672: Neither blocks nor log segments found. Creating new log.
I20260808 14:37:52.496835 6473 log.cc:824] T b35a05f7094943ab9cc2e4b7b049b99e P 55399ca225c546d7b98de5683a4c2c6c: Log is configured to *not* fsync() on all Append() calls
I20260808 14:37:52.497368 6476 log.cc:824] T b35a05f7094943ab9cc2e4b7b049b99e P e2b3fdf0f7f149af9399fd934aa58672: Log is configured to *not* fsync() on all Append() calls
I20260808 14:37:52.497783 6472 tablet_bootstrap.cc:492] T b35a05f7094943ab9cc2e4b7b049b99e P a84c2deaa93d45679e8dcb302109ddac: No bootstrap required, opened a new log
I20260808 14:37:52.497978 6472 ts_tablet_manager.cc:1397] T b35a05f7094943ab9cc2e4b7b049b99e P a84c2deaa93d45679e8dcb302109ddac: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.005s
I20260808 14:37:52.498920 6473 tablet_bootstrap.cc:492] T b35a05f7094943ab9cc2e4b7b049b99e P 55399ca225c546d7b98de5683a4c2c6c: No bootstrap required, opened a new log
I20260808 14:37:52.499104 6473 ts_tablet_manager.cc:1397] T b35a05f7094943ab9cc2e4b7b049b99e P 55399ca225c546d7b98de5683a4c2c6c: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 14:37:52.499195 6476 tablet_bootstrap.cc:492] T b35a05f7094943ab9cc2e4b7b049b99e P e2b3fdf0f7f149af9399fd934aa58672: No bootstrap required, opened a new log
I20260808 14:37:52.499396 6476 ts_tablet_manager.cc:1397] T b35a05f7094943ab9cc2e4b7b049b99e P e2b3fdf0f7f149af9399fd934aa58672: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 14:37:52.502322 6476 raft_consensus.cc:348] T b35a05f7094943ab9cc2e4b7b049b99e P e2b3fdf0f7f149af9399fd934aa58672 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a84c2deaa93d45679e8dcb302109ddac" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 34549 } } peers { permanent_uuid: "55399ca225c546d7b98de5683a4c2c6c" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 45763 } } peers { permanent_uuid: "e2b3fdf0f7f149af9399fd934aa58672" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 36441 } }
I20260808 14:37:52.502733 6476 raft_consensus.cc:374] T b35a05f7094943ab9cc2e4b7b049b99e P e2b3fdf0f7f149af9399fd934aa58672 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:37:52.502831 6476 raft_consensus.cc:729] T b35a05f7094943ab9cc2e4b7b049b99e P e2b3fdf0f7f149af9399fd934aa58672 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2b3fdf0f7f149af9399fd934aa58672, State: Initialized, Role: FOLLOWER
I20260808 14:37:52.502578 6472 raft_consensus.cc:348] T b35a05f7094943ab9cc2e4b7b049b99e P a84c2deaa93d45679e8dcb302109ddac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a84c2deaa93d45679e8dcb302109ddac" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 34549 } } peers { permanent_uuid: "55399ca225c546d7b98de5683a4c2c6c" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 45763 } } peers { permanent_uuid: "e2b3fdf0f7f149af9399fd934aa58672" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 36441 } }
I20260808 14:37:52.503048 6473 raft_consensus.cc:348] T b35a05f7094943ab9cc2e4b7b049b99e P 55399ca225c546d7b98de5683a4c2c6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a84c2deaa93d45679e8dcb302109ddac" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 34549 } } peers { permanent_uuid: "55399ca225c546d7b98de5683a4c2c6c" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 45763 } } peers { permanent_uuid: "e2b3fdf0f7f149af9399fd934aa58672" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 36441 } }
I20260808 14:37:52.503227 6472 raft_consensus.cc:374] T b35a05f7094943ab9cc2e4b7b049b99e P a84c2deaa93d45679e8dcb302109ddac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:37:52.503280 6473 raft_consensus.cc:374] T b35a05f7094943ab9cc2e4b7b049b99e P 55399ca225c546d7b98de5683a4c2c6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:37:52.503288 6472 raft_consensus.cc:729] T b35a05f7094943ab9cc2e4b7b049b99e P a84c2deaa93d45679e8dcb302109ddac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a84c2deaa93d45679e8dcb302109ddac, State: Initialized, Role: FOLLOWER
I20260808 14:37:52.503363 6473 raft_consensus.cc:729] T b35a05f7094943ab9cc2e4b7b049b99e P 55399ca225c546d7b98de5683a4c2c6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55399ca225c546d7b98de5683a4c2c6c, State: Initialized, Role: FOLLOWER
I20260808 14:37:52.503391 6476 consensus_queue.cc:260] T b35a05f7094943ab9cc2e4b7b049b99e P e2b3fdf0f7f149af9399fd934aa58672 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a84c2deaa93d45679e8dcb302109ddac" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 34549 } } peers { permanent_uuid: "55399ca225c546d7b98de5683a4c2c6c" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 45763 } } peers { permanent_uuid: "e2b3fdf0f7f149af9399fd934aa58672" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 36441 } }
I20260808 14:37:52.503732 6472 consensus_queue.cc:260] T b35a05f7094943ab9cc2e4b7b049b99e P a84c2deaa93d45679e8dcb302109ddac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a84c2deaa93d45679e8dcb302109ddac" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 34549 } } peers { permanent_uuid: "55399ca225c546d7b98de5683a4c2c6c" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 45763 } } peers { permanent_uuid: "e2b3fdf0f7f149af9399fd934aa58672" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 36441 } }
I20260808 14:37:52.503736 6473 consensus_queue.cc:260] T b35a05f7094943ab9cc2e4b7b049b99e P 55399ca225c546d7b98de5683a4c2c6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a84c2deaa93d45679e8dcb302109ddac" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 34549 } } peers { permanent_uuid: "55399ca225c546d7b98de5683a4c2c6c" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 45763 } } peers { permanent_uuid: "e2b3fdf0f7f149af9399fd934aa58672" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 36441 } }
I20260808 14:37:52.504175 6447 heartbeater.cc:503] Master 127.11.131.254:43545 was elected leader, sending a full tablet report...
I20260808 14:37:52.504516 6476 ts_tablet_manager.cc:1428] T b35a05f7094943ab9cc2e4b7b049b99e P e2b3fdf0f7f149af9399fd934aa58672: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260808 14:37:52.504707 6473 ts_tablet_manager.cc:1428] T b35a05f7094943ab9cc2e4b7b049b99e P 55399ca225c546d7b98de5683a4c2c6c: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260808 14:37:52.504707 6472 ts_tablet_manager.cc:1428] T b35a05f7094943ab9cc2e4b7b049b99e P a84c2deaa93d45679e8dcb302109ddac: Time spent starting tablet: real 0.007s user 0.003s sys 0.002s
I20260808 14:37:52.505045 6054 heartbeater.cc:503] Master 127.11.131.254:43545 was elected leader, sending a full tablet report...
I20260808 14:37:52.505620 6246 heartbeater.cc:503] Master 127.11.131.254:43545 was elected leader, sending a full tablet report...
I20260808 14:37:52.651957 6481 raft_consensus.cc:482] T b35a05f7094943ab9cc2e4b7b049b99e P e2b3fdf0f7f149af9399fd934aa58672 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:37:52.652209 6481 raft_consensus.cc:504] T b35a05f7094943ab9cc2e4b7b049b99e P e2b3fdf0f7f149af9399fd934aa58672 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a84c2deaa93d45679e8dcb302109ddac" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 34549 } } peers { permanent_uuid: "55399ca225c546d7b98de5683a4c2c6c" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 45763 } } peers { permanent_uuid: "e2b3fdf0f7f149af9399fd934aa58672" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 36441 } }
I20260808 14:37:52.653609 6481 leader_election.cc:288] T b35a05f7094943ab9cc2e4b7b049b99e P e2b3fdf0f7f149af9399fd934aa58672 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a84c2deaa93d45679e8dcb302109ddac (127.11.131.193:34549), 55399ca225c546d7b98de5683a4c2c6c (127.11.131.194:45763)
I20260808 14:37:52.658869 6471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:52.654275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:42215 (local address 127.11.131.194:45763)
0808 14:37:52.654420 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:52.654424 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:52.654682 (+ 258us) server_negotiation.cc:407] Connection header received
0808 14:37:52.654865 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:52.654867 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:52.654910 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:52.654971 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:37:52.655257 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:52.655967 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:52.657463 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:52.658071 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:52.658205 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:52.658260 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:52.658661 (+ 401us) server_negotiation.cc:299] Negotiation successful
0808 14:37:52.658736 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 14:37:52.658870 6463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:52.654283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:60905 (local address 127.11.131.193:34549)
0808 14:37:52.654432 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:52.654437 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:52.654456 (+ 19us) server_negotiation.cc:407] Connection header received
0808 14:37:52.654506 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:52.654508 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:52.654548 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:52.654680 (+ 132us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:37:52.655055 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:52.655846 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:52.657463 (+ 1617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:52.658090 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:52.658205 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:52.658260 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:52.658661 (+ 401us) server_negotiation.cc:299] Negotiation successful
0808 14:37:52.658736 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 14:37:52.658963 6450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:52.653836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:34549 (local address 127.11.131.195:60905)
0808 14:37:52.653989 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:52.654005 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:37:52.654106 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:37:52.654695 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:37:52.654698 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:37:52.654739 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:37:52.654905 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:52.654912 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:52.655953 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:52.655956 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:52.657323 (+ 1367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:52.657335 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:52.658206 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:52.658210 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:52.658482 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:52.658538 (+ 56us) client_negotiation.cc:769] Sending connection context
0808 14:37:52.658645 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 14:37:52.658761 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51,"mutex_wait_us":98,"spinlock_wait_cycles":38400}
I20260808 14:37:52.658972 6486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:52.654134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.194:45763 (local address 127.11.131.195:42215)
0808 14:37:52.654554 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:52.654565 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:37:52.654744 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:37:52.655008 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:37:52.655014 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:37:52.655035 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:37:52.655148 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:52.655153 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:52.656064 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:52.656067 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:52.657331 (+ 1264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:52.657336 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:52.658206 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:52.658210 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:52.658486 (+ 276us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:52.658539 (+ 53us) client_negotiation.cc:769] Sending connection context
0808 14:37:52.658653 (+ 114us) client_negotiation.cc:240] Negotiation successful
0808 14:37:52.658766 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":363,"mutex_wait_us":216,"spinlock_wait_cycles":2176,"thread_start_us":143,"threads_started":1}
I20260808 14:37:52.659957 5981 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b35a05f7094943ab9cc2e4b7b049b99e" candidate_uuid: "e2b3fdf0f7f149af9399fd934aa58672" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a84c2deaa93d45679e8dcb302109ddac" is_pre_election: true
I20260808 14:37:52.659962 6186 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b35a05f7094943ab9cc2e4b7b049b99e" candidate_uuid: "e2b3fdf0f7f149af9399fd934aa58672" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55399ca225c546d7b98de5683a4c2c6c" is_pre_election: true
I20260808 14:37:52.660292 5981 raft_consensus.cc:2454] T b35a05f7094943ab9cc2e4b7b049b99e P a84c2deaa93d45679e8dcb302109ddac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2b3fdf0f7f149af9399fd934aa58672 in term 0.
I20260808 14:37:52.660290 6186 raft_consensus.cc:2454] T b35a05f7094943ab9cc2e4b7b049b99e P 55399ca225c546d7b98de5683a4c2c6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2b3fdf0f7f149af9399fd934aa58672 in term 0.
I20260808 14:37:52.660851 6281 leader_election.cc:302] T b35a05f7094943ab9cc2e4b7b049b99e P e2b3fdf0f7f149af9399fd934aa58672 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55399ca225c546d7b98de5683a4c2c6c, e2b3fdf0f7f149af9399fd934aa58672; no voters:
I20260808 14:37:52.661160 6481 raft_consensus.cc:2781] T b35a05f7094943ab9cc2e4b7b049b99e P e2b3fdf0f7f149af9399fd934aa58672 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:37:52.661255 6481 raft_consensus.cc:482] T b35a05f7094943ab9cc2e4b7b049b99e P e2b3fdf0f7f149af9399fd934aa58672 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:37:52.661311 6481 raft_consensus.cc:3037] T b35a05f7094943ab9cc2e4b7b049b99e P e2b3fdf0f7f149af9399fd934aa58672 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:37:52.662415 6481 raft_consensus.cc:504] T b35a05f7094943ab9cc2e4b7b049b99e P e2b3fdf0f7f149af9399fd934aa58672 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a84c2deaa93d45679e8dcb302109ddac" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 34549 } } peers { permanent_uuid: "55399ca225c546d7b98de5683a4c2c6c" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 45763 } } peers { permanent_uuid: "e2b3fdf0f7f149af9399fd934aa58672" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 36441 } }
I20260808 14:37:52.662832 6481 leader_election.cc:288] T b35a05f7094943ab9cc2e4b7b049b99e P e2b3fdf0f7f149af9399fd934aa58672 [CANDIDATE]: Term 1 election: Requested vote from peers a84c2deaa93d45679e8dcb302109ddac (127.11.131.193:34549), 55399ca225c546d7b98de5683a4c2c6c (127.11.131.194:45763)
I20260808 14:37:52.663179 5981 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b35a05f7094943ab9cc2e4b7b049b99e" candidate_uuid: "e2b3fdf0f7f149af9399fd934aa58672" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a84c2deaa93d45679e8dcb302109ddac"
I20260808 14:37:52.663250 6186 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b35a05f7094943ab9cc2e4b7b049b99e" candidate_uuid: "e2b3fdf0f7f149af9399fd934aa58672" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55399ca225c546d7b98de5683a4c2c6c"
I20260808 14:37:52.663297 5981 raft_consensus.cc:3037] T b35a05f7094943ab9cc2e4b7b049b99e P a84c2deaa93d45679e8dcb302109ddac [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:37:52.663429 6186 raft_consensus.cc:3037] T b35a05f7094943ab9cc2e4b7b049b99e P 55399ca225c546d7b98de5683a4c2c6c [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:37:52.664407 5981 raft_consensus.cc:2454] T b35a05f7094943ab9cc2e4b7b049b99e P a84c2deaa93d45679e8dcb302109ddac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2b3fdf0f7f149af9399fd934aa58672 in term 1.
I20260808 14:37:52.664566 6186 raft_consensus.cc:2454] T b35a05f7094943ab9cc2e4b7b049b99e P 55399ca225c546d7b98de5683a4c2c6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2b3fdf0f7f149af9399fd934aa58672 in term 1.
I20260808 14:37:52.664727 6281 leader_election.cc:302] T b35a05f7094943ab9cc2e4b7b049b99e P e2b3fdf0f7f149af9399fd934aa58672 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a84c2deaa93d45679e8dcb302109ddac, e2b3fdf0f7f149af9399fd934aa58672; no voters:
I20260808 14:37:52.664906 6481 raft_consensus.cc:2781] T b35a05f7094943ab9cc2e4b7b049b99e P e2b3fdf0f7f149af9399fd934aa58672 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:37:52.665138 6481 raft_consensus.cc:686] T b35a05f7094943ab9cc2e4b7b049b99e P e2b3fdf0f7f149af9399fd934aa58672 [term 1 LEADER]: Becoming Leader. State: Replica: e2b3fdf0f7f149af9399fd934aa58672, State: Running, Role: LEADER
I20260808 14:37:52.665479 6481 consensus_queue.cc:237] T b35a05f7094943ab9cc2e4b7b049b99e P e2b3fdf0f7f149af9399fd934aa58672 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a84c2deaa93d45679e8dcb302109ddac" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 34549 } } peers { permanent_uuid: "55399ca225c546d7b98de5683a4c2c6c" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 45763 } } peers { permanent_uuid: "e2b3fdf0f7f149af9399fd934aa58672" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 36441 } }
I20260808 14:37:52.668792 5759 catalog_manager.cc:5495] T b35a05f7094943ab9cc2e4b7b049b99e P e2b3fdf0f7f149af9399fd934aa58672 reported cstate change: term changed from 0 to 1, leader changed from <none> to e2b3fdf0f7f149af9399fd934aa58672 (127.11.131.195). New cstate: current_term: 1 leader_uuid: "e2b3fdf0f7f149af9399fd934aa58672" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a84c2deaa93d45679e8dcb302109ddac" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 34549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55399ca225c546d7b98de5683a4c2c6c" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 45763 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2b3fdf0f7f149af9399fd934aa58672" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 36441 } health_report { overall_health: HEALTHY } } }
W20260808 14:37:52.673965 6449 tablet.cc:2369] T b35a05f7094943ab9cc2e4b7b049b99e P e2b3fdf0f7f149af9399fd934aa58672: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:37:52.682672 6248 tablet.cc:2369] T b35a05f7094943ab9cc2e4b7b049b99e P 55399ca225c546d7b98de5683a4c2c6c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:37:52.697209 6056 tablet.cc:2369] T b35a05f7094943ab9cc2e4b7b049b99e P a84c2deaa93d45679e8dcb302109ddac: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:37:52.715502 6467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:52.711780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56002 (local address 127.11.131.195:36441)
0808 14:37:52.711932 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:52.711937 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:52.711954 (+ 17us) server_negotiation.cc:407] Connection header received
0808 14:37:52.712059 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:52.712062 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:52.712119 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:52.712239 (+ 120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:37:52.712508 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:52.713043 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:52.713937 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:52.714164 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:52.714278 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:52.714646 (+ 368us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:37:52.715086 (+ 440us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:37:52.715222 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:52.715292 (+ 70us) server_negotiation.cc:299] Negotiation successful
0808 14:37:52.715350 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 14:37:52.721496 6186 raft_consensus.cc:1261] T b35a05f7094943ab9cc2e4b7b049b99e P 55399ca225c546d7b98de5683a4c2c6c [term 1 FOLLOWER]: Refusing update from remote peer e2b3fdf0f7f149af9399fd934aa58672: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:37:52.721496 5981 raft_consensus.cc:1261] T b35a05f7094943ab9cc2e4b7b049b99e P a84c2deaa93d45679e8dcb302109ddac [term 1 FOLLOWER]: Refusing update from remote peer e2b3fdf0f7f149af9399fd934aa58672: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:37:52.722213 6481 consensus_queue.cc:1035] T b35a05f7094943ab9cc2e4b7b049b99e P e2b3fdf0f7f149af9399fd934aa58672 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a84c2deaa93d45679e8dcb302109ddac" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 34549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:37:52.722404 6487 consensus_queue.cc:1035] T b35a05f7094943ab9cc2e4b7b049b99e P e2b3fdf0f7f149af9399fd934aa58672 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55399ca225c546d7b98de5683a4c2c6c" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 45763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:37:52.732280 6493 mvcc.cc:205] Tried to move back new op lower bound from 7316274678659936256 to 7316274678440759296. Current Snapshot: MvccSnapshot[applied={T|T < 7316274678659936256}]
I20260808 14:37:52.741062 5760 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57838:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:37:52.741243 5760 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57838:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:37:52.743829 5760 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 415c95cc0e714b618872673fbae4c446: Sending DeleteTablet for 3 replicas of tablet b35a05f7094943ab9cc2e4b7b049b99e
I20260808 14:37:52.744704 6151 tablet_service.cc:1514] Processing DeleteTablet for tablet b35a05f7094943ab9cc2e4b7b049b99e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:37:52 UTC) from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:50096
I20260808 14:37:52.744706 6342 tablet_service.cc:1514] Processing DeleteTablet for tablet b35a05f7094943ab9cc2e4b7b049b99e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:37:52 UTC) from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:55996
I20260808 14:37:52.744750 5952 tablet_service.cc:1514] Processing DeleteTablet for tablet b35a05f7094943ab9cc2e4b7b049b99e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:37:52 UTC) from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:39004
I20260808 14:37:52.745249 6519 tablet_replica.cc:330] T b35a05f7094943ab9cc2e4b7b049b99e P e2b3fdf0f7f149af9399fd934aa58672: stopping tablet replica
I20260808 14:37:52.745267 6520 tablet_replica.cc:330] T b35a05f7094943ab9cc2e4b7b049b99e P a84c2deaa93d45679e8dcb302109ddac: stopping tablet replica
I20260808 14:37:52.745579 6519 raft_consensus.cc:2229] T b35a05f7094943ab9cc2e4b7b049b99e P e2b3fdf0f7f149af9399fd934aa58672 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:37:52.745579 6520 raft_consensus.cc:2229] T b35a05f7094943ab9cc2e4b7b049b99e P a84c2deaa93d45679e8dcb302109ddac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:37:52.745646 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 5858
I20260808 14:37:52.758388 6517 tablet_replica.cc:330] T b35a05f7094943ab9cc2e4b7b049b99e P 55399ca225c546d7b98de5683a4c2c6c: stopping tablet replica
I20260808 14:37:52.758937 6517 raft_consensus.cc:2229] T b35a05f7094943ab9cc2e4b7b049b99e P 55399ca225c546d7b98de5683a4c2c6c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:37:52.759379 6517 raft_consensus.cc:2258] T b35a05f7094943ab9cc2e4b7b049b99e P 55399ca225c546d7b98de5683a4c2c6c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:37:52.760023 6519 raft_consensus.cc:2258] T b35a05f7094943ab9cc2e4b7b049b99e P e2b3fdf0f7f149af9399fd934aa58672 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:37:52.762036 6519 ts_tablet_manager.cc:1905] T b35a05f7094943ab9cc2e4b7b049b99e P e2b3fdf0f7f149af9399fd934aa58672: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:37:52.764636 6519 ts_tablet_manager.cc:1918] T b35a05f7094943ab9cc2e4b7b049b99e P e2b3fdf0f7f149af9399fd934aa58672: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:37:52.764765 6519 log.cc:1196] T b35a05f7094943ab9cc2e4b7b049b99e P e2b3fdf0f7f149af9399fd934aa58672: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786199615258783-11791-0/minicluster-data/ts-2/wal/wals/b35a05f7094943ab9cc2e4b7b049b99e
I20260808 14:37:52.765132 6519 ts_tablet_manager.cc:1939] T b35a05f7094943ab9cc2e4b7b049b99e P e2b3fdf0f7f149af9399fd934aa58672: Deleting consensus metadata
I20260808 14:37:52.766474 5738 catalog_manager.cc:4841] TS e2b3fdf0f7f149af9399fd934aa58672 (127.11.131.195:36441): tablet b35a05f7094943ab9cc2e4b7b049b99e (table test-table [id=8a3eb53fbfa946b9b277fc628eea844f]) successfully deleted
W20260808 14:37:52.767123 5740 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.131.193:34549 (error 108)
I20260808 14:37:52.767838 6517 ts_tablet_manager.cc:1905] T b35a05f7094943ab9cc2e4b7b049b99e P 55399ca225c546d7b98de5683a4c2c6c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:37:52.768151 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 6065
I20260808 14:37:52.768250 6464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:52.767954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:34549 (local address 127.0.0.1:39010)
0808 14:37:52.768082 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:52.768156 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.193:34549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260808 14:37:52.768410 5740 catalog_manager.cc:4584] TS a84c2deaa93d45679e8dcb302109ddac (127.11.131.193:34549): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b35a05f7094943ab9cc2e4b7b049b99e: Network error: Client connection negotiation failed: client connection to 127.11.131.193:34549: connect: Connection refused (error 111)
I20260808 14:37:52.785919 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 6252
I20260808 14:37:52.791316 6464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:52.790860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.194:45763 (local address 127.0.0.1:50104)
0808 14:37:52.791110 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:52.791179 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.194:45763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142}
I20260808 14:37:52.797571 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 5710
2026-08-08T14:37:52Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2789 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-08T14:37:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:37:52Z Disabled control of system clock
I20260808 14:37:52.836804 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:41473
--webserver_interface=127.11.131.254
--webserver_port=0
--builtin_ntp_servers=127.11.131.212:40377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:41473
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 14:37:52.952438 6525 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:37:52.952701 6525 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:37:52.952739 6525 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:37:52.956684 6525 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:37:52.956735 6525 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:37:52.956751 6525 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:37:52.956768 6525 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:37:52.956782 6525 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:37:52.961387 6525 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:40377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:41473
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:41473
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.131.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6525
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:37:52.962412 6525 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:37:52.963898 6525 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:37:52.972859 6540 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:37:52.972854 6535 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:37:52.972854 6533 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:37:52.973001 6525 server_base.cc:1034] running on GCE node
I20260808 14:37:52.973763 6525 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:37:52.974949 6525 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:37:52.976121 6525 hybrid_clock.cc:648] HybridClock initialized: now 1786199872976086 us; error 49 us; skew 500 ppm
I20260808 14:37:52.978211 6525 webserver.cc:460] Webserver started at http://127.11.131.254:37785/ using document root <none> and password file <none>
I20260808 14:37:52.978896 6525 fs_manager.cc:359] Metadata directory not provided
I20260808 14:37:52.978965 6525 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:37:52.979225 6525 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:37:52.981381 6525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/master-0/data/instance:
uuid: "62fc0bd3dd204f37bfaed757e1095f41"
format_stamp: "Formatted at 2026-08-08 14:37:52 on dist-test-slave-twwt"
server_key: "77bca3cd81ae287f8e141d074ba92de1"
server_key_iv: "cbd6d6ab4245d6cff6eab1dd701a0e88"
server_key_version: "encryptionkey@0"
I20260808 14:37:52.982002 6525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/master-0/wal/instance:
uuid: "62fc0bd3dd204f37bfaed757e1095f41"
format_stamp: "Formatted at 2026-08-08 14:37:52 on dist-test-slave-twwt"
server_key: "77bca3cd81ae287f8e141d074ba92de1"
server_key_iv: "cbd6d6ab4245d6cff6eab1dd701a0e88"
server_key_version: "encryptionkey@0"
I20260808 14:37:52.985882 6525 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 14:37:52.988431 6548 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:52.989723 6525 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 14:37:52.989880 6525 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "62fc0bd3dd204f37bfaed757e1095f41"
format_stamp: "Formatted at 2026-08-08 14:37:52 on dist-test-slave-twwt"
server_key: "77bca3cd81ae287f8e141d074ba92de1"
server_key_iv: "cbd6d6ab4245d6cff6eab1dd701a0e88"
server_key_version: "encryptionkey@0"
I20260808 14:37:52.989998 6525 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:37:53.018935 6525 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:37:53.019755 6525 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:37:53.020018 6525 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:37:53.027556 6525 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.254:41473
I20260808 14:37:53.027602 6621 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.254:41473 every 8 connection(s)
I20260808 14:37:53.028618 6525 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:37:53.032089 6622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:37:53.033284 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 6525
I20260808 14:37:53.033432 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/master-0/wal/instance
I20260808 14:37:53.033789 11791 external_mini_cluster.cc:1428] Setting key 5d9689e7ab840255a43e372d618307cb
I20260808 14:37:53.038966 6622 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62fc0bd3dd204f37bfaed757e1095f41: Bootstrap starting.
I20260808 14:37:53.041769 6622 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 62fc0bd3dd204f37bfaed757e1095f41: Neither blocks nor log segments found. Creating new log.
I20260808 14:37:53.042742 6622 log.cc:824] T 00000000000000000000000000000000 P 62fc0bd3dd204f37bfaed757e1095f41: Log is configured to *not* fsync() on all Append() calls
I20260808 14:37:53.043525 6625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:53.035273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50056 (local address 127.11.131.254:41473)
0808 14:37:53.035911 (+ 638us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:53.035928 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:53.035967 (+ 39us) server_negotiation.cc:407] Connection header received
0808 14:37:53.036663 (+ 696us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:53.036682 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:53.037092 (+ 410us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:53.037399 (+ 307us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:37:53.037765 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:53.038781 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:53.039950 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:53.040418 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:53.040539 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:53.041427 (+ 888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:37:53.041432 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:37:53.041445 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:37:53.041883 (+ 438us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:37:53.041958 (+ 75us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:37:53.041981 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:37:53.042058 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:53.042233 (+ 175us) server_negotiation.cc:299] Negotiation successful
0808 14:37:53.042536 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":271,"thread_start_us":136,"threads_started":1}
I20260808 14:37:53.044842 6622 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62fc0bd3dd204f37bfaed757e1095f41: No bootstrap required, opened a new log
I20260808 14:37:53.048458 6622 raft_consensus.cc:348] T 00000000000000000000000000000000 P 62fc0bd3dd204f37bfaed757e1095f41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62fc0bd3dd204f37bfaed757e1095f41" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 41473 } }
I20260808 14:37:53.048673 6622 raft_consensus.cc:374] T 00000000000000000000000000000000 P 62fc0bd3dd204f37bfaed757e1095f41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:37:53.048753 6622 raft_consensus.cc:729] T 00000000000000000000000000000000 P 62fc0bd3dd204f37bfaed757e1095f41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62fc0bd3dd204f37bfaed757e1095f41, State: Initialized, Role: FOLLOWER
I20260808 14:37:53.049162 6622 consensus_queue.cc:260] T 00000000000000000000000000000000 P 62fc0bd3dd204f37bfaed757e1095f41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62fc0bd3dd204f37bfaed757e1095f41" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 41473 } }
I20260808 14:37:53.049322 6622 raft_consensus.cc:388] T 00000000000000000000000000000000 P 62fc0bd3dd204f37bfaed757e1095f41 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:37:53.049412 6622 raft_consensus.cc:482] T 00000000000000000000000000000000 P 62fc0bd3dd204f37bfaed757e1095f41 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:37:53.049531 6622 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 62fc0bd3dd204f37bfaed757e1095f41 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:37:53.050437 6622 raft_consensus.cc:504] T 00000000000000000000000000000000 P 62fc0bd3dd204f37bfaed757e1095f41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62fc0bd3dd204f37bfaed757e1095f41" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 41473 } }
I20260808 14:37:53.050814 6622 leader_election.cc:302] T 00000000000000000000000000000000 P 62fc0bd3dd204f37bfaed757e1095f41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62fc0bd3dd204f37bfaed757e1095f41; no voters:
I20260808 14:37:53.051122 6622 leader_election.cc:288] T 00000000000000000000000000000000 P 62fc0bd3dd204f37bfaed757e1095f41 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:37:53.051244 6628 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 62fc0bd3dd204f37bfaed757e1095f41 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:37:53.051546 6628 raft_consensus.cc:686] T 00000000000000000000000000000000 P 62fc0bd3dd204f37bfaed757e1095f41 [term 1 LEADER]: Becoming Leader. State: Replica: 62fc0bd3dd204f37bfaed757e1095f41, State: Running, Role: LEADER
I20260808 14:37:53.051847 6628 consensus_queue.cc:237] T 00000000000000000000000000000000 P 62fc0bd3dd204f37bfaed757e1095f41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62fc0bd3dd204f37bfaed757e1095f41" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 41473 } }
I20260808 14:37:53.052348 6622 sys_catalog.cc:564] T 00000000000000000000000000000000 P 62fc0bd3dd204f37bfaed757e1095f41 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:37:53.053485 6629 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62fc0bd3dd204f37bfaed757e1095f41 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "62fc0bd3dd204f37bfaed757e1095f41" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62fc0bd3dd204f37bfaed757e1095f41" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 41473 } } }
I20260808 14:37:53.053612 6629 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62fc0bd3dd204f37bfaed757e1095f41 [sys.catalog]: This master's current role is: LEADER
I20260808 14:37:53.053942 6630 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62fc0bd3dd204f37bfaed757e1095f41 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 62fc0bd3dd204f37bfaed757e1095f41. Latest consensus state: current_term: 1 leader_uuid: "62fc0bd3dd204f37bfaed757e1095f41" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62fc0bd3dd204f37bfaed757e1095f41" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 41473 } } }
I20260808 14:37:53.054039 6630 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62fc0bd3dd204f37bfaed757e1095f41 [sys.catalog]: This master's current role is: LEADER
I20260808 14:37:53.054041 6638 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:37:53.056797 6638 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:37:53.062870 6638 catalog_manager.cc:1347] Generated new cluster ID: 1a327196dd4f4d1aac156c7a401aed77
I20260808 14:37:53.062954 6638 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:37:53.073542 6638 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:37:53.074585 6638 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:37:53.083666 6638 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 62fc0bd3dd204f37bfaed757e1095f41: Generated new TSK 0
I20260808 14:37:53.084482 6638 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:37:53.089077 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.193:0
--local_ip_for_outbound_sockets=127.11.131.193
--webserver_interface=127.11.131.193
--webserver_port=0
--tserver_master_addrs=127.11.131.254:41473
--builtin_ntp_servers=127.11.131.212:40377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 14:37:53.208065 6652 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:37:53.208326 6652 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:37:53.208366 6652 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:37:53.212322 6652 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:37:53.212376 6652 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:37:53.212428 6652 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.193
I20260808 14:37:53.217157 6652 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:40377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.131.193
--webserver_port=0
--tserver_master_addrs=127.11.131.254:41473
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6652
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.193
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:37:53.218243 6652 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:37:53.219726 6652 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:37:53.229692 6661 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:37:53.229739 6659 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:37:53.229974 6652 server_base.cc:1034] running on GCE node
W20260808 14:37:53.229739 6666 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:37:53.230405 6652 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:37:53.231101 6652 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:37:53.232266 6652 hybrid_clock.cc:648] HybridClock initialized: now 1786199873232255 us; error 29 us; skew 500 ppm
I20260808 14:37:53.234340 6652 webserver.cc:460] Webserver started at http://127.11.131.193:41229/ using document root <none> and password file <none>
I20260808 14:37:53.234993 6652 fs_manager.cc:359] Metadata directory not provided
I20260808 14:37:53.235057 6652 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:37:53.235316 6652 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:37:53.237390 6652 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/ts-0/data/instance:
uuid: "1af32ff9999b4913a94febc56560f98f"
format_stamp: "Formatted at 2026-08-08 14:37:53 on dist-test-slave-twwt"
server_key: "776d09f9a1a2c98d20fabd9e506ff9dc"
server_key_iv: "25e52e532d4cb5f7d4bb088903ee4adc"
server_key_version: "encryptionkey@0"
I20260808 14:37:53.237972 6652 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/ts-0/wal/instance:
uuid: "1af32ff9999b4913a94febc56560f98f"
format_stamp: "Formatted at 2026-08-08 14:37:53 on dist-test-slave-twwt"
server_key: "776d09f9a1a2c98d20fabd9e506ff9dc"
server_key_iv: "25e52e532d4cb5f7d4bb088903ee4adc"
server_key_version: "encryptionkey@0"
I20260808 14:37:53.241694 6652 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 14:37:53.244242 6675 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:53.245430 6652 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 14:37:53.245566 6652 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/ts-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/ts-0/wal
uuid: "1af32ff9999b4913a94febc56560f98f"
format_stamp: "Formatted at 2026-08-08 14:37:53 on dist-test-slave-twwt"
server_key: "776d09f9a1a2c98d20fabd9e506ff9dc"
server_key_iv: "25e52e532d4cb5f7d4bb088903ee4adc"
server_key_version: "encryptionkey@0"
I20260808 14:37:53.245674 6652 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:37:53.259351 6652 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:37:53.260064 6652 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:37:53.260274 6652 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:37:53.260903 6652 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:37:53.261879 6652 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:37:53.261926 6652 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:53.261996 6652 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:37:53.262027 6652 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:53.271029 6652 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.193:43649
I20260808 14:37:53.271126 6847 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.193:43649 every 8 connection(s)
I20260808 14:37:53.271975 6652 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
I20260808 14:37:53.276911 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 6652
I20260808 14:37:53.277037 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/ts-0/wal/instance
I20260808 14:37:53.277367 11791 external_mini_cluster.cc:1428] Setting key 5d4723d38b88e3a70ad097b47a45d3f6
I20260808 14:37:53.279484 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.194:0
--local_ip_for_outbound_sockets=127.11.131.194
--webserver_interface=127.11.131.194
--webserver_port=0
--tserver_master_addrs=127.11.131.254:41473
--builtin_ntp_servers=127.11.131.212:40377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 14:37:53.282116 6625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:53.273905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:41981 (local address 127.11.131.254:41473)
0808 14:37:53.274100 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:53.274105 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:53.275202 (+ 1097us) server_negotiation.cc:407] Connection header received
0808 14:37:53.276687 (+ 1485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:53.276691 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:53.276749 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:53.276864 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:37:53.277889 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:53.278608 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:53.279956 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:53.280198 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:53.280312 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:53.281635 (+ 1323us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:37:53.281638 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:37:53.281640 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:37:53.281652 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:37:53.281672 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:37:53.281681 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:37:53.281749 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:53.281946 (+ 197us) server_negotiation.cc:299] Negotiation successful
0808 14:37:53.282002 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 14:37:53.283367 6855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:53.274377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:41473 (local address 127.11.131.193:41981)
0808 14:37:53.275056 (+ 679us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:53.275097 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 14:37:53.276446 (+ 1349us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:37:53.277055 (+ 609us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:37:53.277062 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:37:53.277186 (+ 124us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:37:53.277734 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:53.277748 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:53.278813 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:53.278824 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:53.279829 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:53.279840 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:53.280364 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:53.280369 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:53.280540 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:53.281282 (+ 742us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:37:53.281286 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:37:53.281360 (+ 74us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:37:53.281453 (+ 93us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:37:53.281775 (+ 322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:37:53.281787 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:37:53.281795 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 14:37:53.281932 (+ 137us) client_negotiation.cc:240] Negotiation successful
0808 14:37:53.282261 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":161,"threads_started":1}
I20260808 14:37:53.284680 6848 heartbeater.cc:347] Connected to a master server at 127.11.131.254:41473
I20260808 14:37:53.284927 6848 heartbeater.cc:464] Registering TS with master...
I20260808 14:37:53.285483 6848 heartbeater.cc:511] Master 127.11.131.254:41473 requested a full tablet report, sending...
I20260808 14:37:53.287181 6573 ts_manager.cc:194] Registered new tserver with Master: 1af32ff9999b4913a94febc56560f98f (127.11.131.193:43649)
I20260808 14:37:53.288371 6573 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.131.193:41981
W20260808 14:37:53.399595 6856 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:37:53.399909 6856 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:37:53.399979 6856 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:37:53.403981 6856 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:37:53.404073 6856 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:37:53.404166 6856 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.194
I20260808 14:37:53.409073 6856 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:40377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.131.194
--webserver_port=0
--tserver_master_addrs=127.11.131.254:41473
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6856
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.194
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:37:53.410228 6856 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:37:53.411670 6856 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:37:53.421494 6866 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:37:53.421483 6869 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:37:53.421483 6865 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:37:53.421835 6856 server_base.cc:1034] running on GCE node
I20260808 14:37:53.422302 6856 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:37:53.423019 6856 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:37:53.424183 6856 hybrid_clock.cc:648] HybridClock initialized: now 1786199873424167 us; error 26 us; skew 500 ppm
I20260808 14:37:53.426275 6856 webserver.cc:460] Webserver started at http://127.11.131.194:45577/ using document root <none> and password file <none>
I20260808 14:37:53.426940 6856 fs_manager.cc:359] Metadata directory not provided
I20260808 14:37:53.427007 6856 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:37:53.427265 6856 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:37:53.429313 6856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/ts-1/data/instance:
uuid: "c4a94f9d7e97490396d8188d52cdf0e8"
format_stamp: "Formatted at 2026-08-08 14:37:53 on dist-test-slave-twwt"
server_key: "60b2140419603e83aaea2858de6b8115"
server_key_iv: "1a3590e364890e13cdd35a17292cff1f"
server_key_version: "encryptionkey@0"
I20260808 14:37:53.429893 6856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/ts-1/wal/instance:
uuid: "c4a94f9d7e97490396d8188d52cdf0e8"
format_stamp: "Formatted at 2026-08-08 14:37:53 on dist-test-slave-twwt"
server_key: "60b2140419603e83aaea2858de6b8115"
server_key_iv: "1a3590e364890e13cdd35a17292cff1f"
server_key_version: "encryptionkey@0"
I20260808 14:37:53.433557 6856 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.002s
I20260808 14:37:53.436230 6878 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:53.437583 6856 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 14:37:53.437714 6856 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/ts-1/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/ts-1/wal
uuid: "c4a94f9d7e97490396d8188d52cdf0e8"
format_stamp: "Formatted at 2026-08-08 14:37:53 on dist-test-slave-twwt"
server_key: "60b2140419603e83aaea2858de6b8115"
server_key_iv: "1a3590e364890e13cdd35a17292cff1f"
server_key_version: "encryptionkey@0"
I20260808 14:37:53.437822 6856 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:37:53.461591 6856 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:37:53.462327 6856 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:37:53.462533 6856 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:37:53.463217 6856 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:37:53.464236 6856 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:37:53.464284 6856 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:53.464359 6856 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:37:53.464393 6856 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:53.473893 6856 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.194:34847
I20260808 14:37:53.473941 7052 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.194:34847 every 8 connection(s)
I20260808 14:37:53.474974 6856 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
I20260808 14:37:53.478351 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 6856
I20260808 14:37:53.478492 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/ts-1/wal/instance
I20260808 14:37:53.478837 11791 external_mini_cluster.cc:1428] Setting key 4a983e2e334a14a980c00272f441ab3f
I20260808 14:37:53.480986 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.195:0
--local_ip_for_outbound_sockets=127.11.131.195
--webserver_interface=127.11.131.195
--webserver_port=0
--tserver_master_addrs=127.11.131.254:41473
--builtin_ntp_servers=127.11.131.212:40377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 14:37:53.485317 6625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:53.476827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:37693 (local address 127.11.131.254:41473)
0808 14:37:53.476995 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:53.477000 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:53.478118 (+ 1118us) server_negotiation.cc:407] Connection header received
0808 14:37:53.479728 (+ 1610us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:53.479732 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:53.479779 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:53.479906 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:37:53.480904 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:53.481690 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:53.483072 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:53.483294 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:53.483376 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:53.484771 (+ 1395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:37:53.484779 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:37:53.484781 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:37:53.484795 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:37:53.484821 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:37:53.484829 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:37:53.484912 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:53.485089 (+ 177us) server_negotiation.cc:299] Negotiation successful
0808 14:37:53.485158 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 14:37:53.486256 7056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:53.477256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:41473 (local address 127.11.131.194:37693)
0808 14:37:53.477933 (+ 677us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:53.477974 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 14:37:53.479496 (+ 1522us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:37:53.480070 (+ 574us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:37:53.480098 (+ 28us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:37:53.480212 (+ 114us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:37:53.480749 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:53.480764 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:53.481843 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:53.481846 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:53.482920 (+ 1074us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:53.482935 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:53.483459 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:53.483466 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:53.483716 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:53.484429 (+ 713us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:37:53.484431 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:37:53.484492 (+ 61us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:37:53.484588 (+ 96us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:37:53.484916 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:37:53.484928 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:37:53.484937 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 14:37:53.485084 (+ 147us) client_negotiation.cc:240] Negotiation successful
0808 14:37:53.485416 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":117,"threads_started":1}
I20260808 14:37:53.487589 7053 heartbeater.cc:347] Connected to a master server at 127.11.131.254:41473
I20260808 14:37:53.487911 7053 heartbeater.cc:464] Registering TS with master...
I20260808 14:37:53.488677 7053 heartbeater.cc:511] Master 127.11.131.254:41473 requested a full tablet report, sending...
I20260808 14:37:53.490022 6573 ts_manager.cc:194] Registered new tserver with Master: c4a94f9d7e97490396d8188d52cdf0e8 (127.11.131.194:34847)
I20260808 14:37:53.490710 6573 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.131.194:37693
W20260808 14:37:53.610268 7057 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:37:53.610559 7057 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:37:53.610663 7057 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:37:53.614976 7057 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:37:53.615031 7057 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:37:53.615118 7057 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.195
I20260808 14:37:53.619985 7057 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:40377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.131.195
--webserver_port=0
--tserver_master_addrs=127.11.131.254:41473
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7057
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.195
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:37:53.621109 7057 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:37:53.622531 7057 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:37:53.632385 7065 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:37:53.632385 7069 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:37:53.632440 7057 server_base.cc:1034] running on GCE node
W20260808 14:37:53.632385 7067 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:37:53.633019 7057 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:37:53.633682 7057 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:37:53.634928 7057 hybrid_clock.cc:648] HybridClock initialized: now 1786199873634874 us; error 33 us; skew 500 ppm
I20260808 14:37:53.636924 7057 webserver.cc:460] Webserver started at http://127.11.131.195:44955/ using document root <none> and password file <none>
I20260808 14:37:53.637533 7057 fs_manager.cc:359] Metadata directory not provided
I20260808 14:37:53.637609 7057 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:37:53.637859 7057 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:37:53.640107 7057 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/ts-2/data/instance:
uuid: "5c061dcbd6834916a7293278b38010b7"
format_stamp: "Formatted at 2026-08-08 14:37:53 on dist-test-slave-twwt"
server_key: "8f3fe6401e4a4eb979b1aca41ff677b0"
server_key_iv: "8a68a0397021c90bab6cbaf0b4137734"
server_key_version: "encryptionkey@0"
I20260808 14:37:53.640826 7057 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/ts-2/wal/instance:
uuid: "5c061dcbd6834916a7293278b38010b7"
format_stamp: "Formatted at 2026-08-08 14:37:53 on dist-test-slave-twwt"
server_key: "8f3fe6401e4a4eb979b1aca41ff677b0"
server_key_iv: "8a68a0397021c90bab6cbaf0b4137734"
server_key_version: "encryptionkey@0"
I20260808 14:37:53.644855 7057 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 14:37:53.647445 7075 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:53.648674 7057 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 14:37:53.648816 7057 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/ts-2/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/ts-2/wal
uuid: "5c061dcbd6834916a7293278b38010b7"
format_stamp: "Formatted at 2026-08-08 14:37:53 on dist-test-slave-twwt"
server_key: "8f3fe6401e4a4eb979b1aca41ff677b0"
server_key_iv: "8a68a0397021c90bab6cbaf0b4137734"
server_key_version: "encryptionkey@0"
I20260808 14:37:53.648978 7057 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:37:53.669271 7057 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:37:53.669997 7057 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:37:53.670203 7057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:37:53.670895 7057 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:37:53.671870 7057 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:37:53.671942 7057 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:53.672013 7057 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:37:53.672065 7057 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:53.681057 7057 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.195:34593
I20260808 14:37:53.681114 7240 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.195:34593 every 8 connection(s)
I20260808 14:37:53.682011 7057 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
I20260808 14:37:53.689779 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 7057
I20260808 14:37:53.689931 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/ts-2/wal/instance
I20260808 14:37:53.690209 11791 external_mini_cluster.cc:1428] Setting key a515cc6a34606493539b868e35dc5d9a
I20260808 14:37:53.691604 6625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:53.684002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:57163 (local address 127.11.131.254:41473)
0808 14:37:53.684167 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:53.684172 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:53.685241 (+ 1069us) server_negotiation.cc:407] Connection header received
0808 14:37:53.686720 (+ 1479us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:53.686723 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:53.686776 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:53.686854 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:37:53.687794 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:53.688344 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:53.689460 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:53.689701 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:53.689839 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:53.691095 (+ 1256us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:37:53.691099 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:37:53.691102 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:37:53.691115 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:37:53.691142 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:37:53.691151 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:37:53.691230 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:53.691400 (+ 170us) server_negotiation.cc:299] Negotiation successful
0808 14:37:53.691462 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 14:37:53.692458 7246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:53.684441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:41473 (local address 127.11.131.195:57163)
0808 14:37:53.685099 (+ 658us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:53.685139 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 14:37:53.686440 (+ 1301us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:37:53.687059 (+ 619us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:37:53.687066 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:37:53.687171 (+ 105us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:37:53.687651 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:53.687664 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:53.688460 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:53.688462 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:53.689330 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:53.689340 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:53.689884 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:53.689888 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:53.690105 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:53.690829 (+ 724us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:37:53.690830 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:37:53.690870 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:37:53.690932 (+ 62us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:37:53.691246 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:37:53.691258 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:37:53.691268 (+ 10us) client_negotiation.cc:769] Sending connection context
0808 14:37:53.691396 (+ 128us) client_negotiation.cc:240] Negotiation successful
0808 14:37:53.691689 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":115,"threads_started":1}
I20260808 14:37:53.693574 7241 heartbeater.cc:347] Connected to a master server at 127.11.131.254:41473
I20260808 14:37:53.693840 7241 heartbeater.cc:464] Registering TS with master...
I20260808 14:37:53.694425 7241 heartbeater.cc:511] Master 127.11.131.254:41473 requested a full tablet report, sending...
I20260808 14:37:53.695505 6573 ts_manager.cc:194] Registered new tserver with Master: 5c061dcbd6834916a7293278b38010b7 (127.11.131.195:34593)
I20260808 14:37:53.696079 6573 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.131.195:57163
I20260808 14:37:53.704069 11791 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:37:53.709755 6625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:53.706178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50066 (local address 127.11.131.254:41473)
0808 14:37:53.706318 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:53.706324 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:53.706478 (+ 154us) server_negotiation.cc:407] Connection header received
0808 14:37:53.706572 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:53.706575 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:53.706629 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:53.706694 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:37:53.706959 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:53.707451 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:53.708251 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:53.708458 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:53.708535 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:53.709365 (+ 830us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:37:53.709368 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:37:53.709370 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:37:53.709381 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:37:53.709398 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:37:53.709406 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:37:53.709462 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:53.709556 (+ 94us) server_negotiation.cc:299] Negotiation successful
0808 14:37:53.709603 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 14:37:53.712749 6573 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50066:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:37:53.715728 6573 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:37:53.730279 7262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:53.725218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33288 (local address 127.11.131.194:34847)
0808 14:37:53.725628 (+ 410us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:53.725640 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:53.725849 (+ 209us) server_negotiation.cc:407] Connection header received
0808 14:37:53.725948 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:53.725952 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:53.726169 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:53.726326 (+ 157us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:37:53.726692 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:53.727525 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:53.728728 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:53.729520 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:53.729655 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:53.729857 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:53.729973 (+ 116us) server_negotiation.cc:299] Negotiation successful
0808 14:37:53.730099 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":285,"thread_start_us":164,"threads_started":1}
I20260808 14:37:53.730317 7256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:53.724024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:43649 (local address 127.0.0.1:58246)
0808 14:37:53.724643 (+ 619us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:53.724699 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 14:37:53.724872 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:37:53.725740 (+ 868us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:37:53.725746 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:37:53.725774 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:37:53.725928 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:53.725935 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:53.727412 (+ 1477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:53.727415 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:53.728807 (+ 1392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:53.728818 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:53.729814 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:53.729829 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:53.729932 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:53.729996 (+ 64us) client_negotiation.cc:769] Sending connection context
0808 14:37:53.730079 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 14:37:53.730156 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":457,"mutex_wait_us":33,"thread_start_us":94,"threads_started":1}
I20260808 14:37:53.730937 7257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:53.724120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.195:34593 (local address 127.0.0.1:34280)
0808 14:37:53.725422 (+ 1302us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:53.725440 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 14:37:53.725540 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:37:53.726263 (+ 723us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:37:53.726266 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:37:53.726284 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:37:53.726402 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:53.726412 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:53.727778 (+ 1366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:53.727782 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:53.728907 (+ 1125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:53.728917 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:53.729929 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:53.729932 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:53.730103 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:53.730124 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 14:37:53.730187 (+ 63us) client_negotiation.cc:240] Negotiation successful
0808 14:37:53.730244 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1227,"mutex_wait_us":4,"thread_start_us":91,"threads_started":1}
I20260808 14:37:53.731176 7260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:53.724529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34280 (local address 127.11.131.195:34593)
0808 14:37:53.725014 (+ 485us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:53.725029 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:53.725646 (+ 617us) server_negotiation.cc:407] Connection header received
0808 14:37:53.725734 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:53.725739 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:53.726078 (+ 339us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:53.726264 (+ 186us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:37:53.726517 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:53.727650 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:53.729008 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:53.729534 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:53.729684 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:53.729872 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:53.730357 (+ 485us) server_negotiation.cc:299] Negotiation successful
0808 14:37:53.730477 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":378,"thread_start_us":104,"threads_started":1}
I20260808 14:37:53.731235 7258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:53.724161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58246 (local address 127.11.131.193:43649)
0808 14:37:53.725227 (+ 1066us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:53.725239 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:53.725265 (+ 26us) server_negotiation.cc:407] Connection header received
0808 14:37:53.725354 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:53.725360 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:53.725586 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:53.725764 (+ 178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:37:53.726060 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:53.727277 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:53.728945 (+ 1668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:53.729678 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:53.730709 (+ 1031us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:53.730903 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:53.730960 (+ 57us) server_negotiation.cc:299] Negotiation successful
0808 14:37:53.731066 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":959,"thread_start_us":119,"threads_started":1}
I20260808 14:37:53.730266 7261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:53.724778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.194:34847 (local address 127.0.0.1:33288)
0808 14:37:53.725648 (+ 870us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:53.725664 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:37:53.725756 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:37:53.726434 (+ 678us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:37:53.726439 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:37:53.726462 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:37:53.726547 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:53.726552 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:53.727651 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:53.727654 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:53.728598 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:53.728608 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:53.729663 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:53.729667 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:53.729773 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:53.729813 (+ 40us) client_negotiation.cc:769] Sending connection context
0808 14:37:53.729933 (+ 120us) client_negotiation.cc:240] Negotiation successful
0808 14:37:53.730111 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":799,"thread_start_us":103,"threads_started":1}
I20260808 14:37:53.734422 6744 tablet_service.cc:1467] Processing CreateTablet for tablet 8918eabfb0c8441f93e98dd494056d3e (DEFAULT_TABLE table=test-table [id=80a33c2578f34f16839a679769e4c73e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:37:53.734426 7146 tablet_service.cc:1467] Processing CreateTablet for tablet 8918eabfb0c8441f93e98dd494056d3e (DEFAULT_TABLE table=test-table [id=80a33c2578f34f16839a679769e4c73e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:37:53.734436 6951 tablet_service.cc:1467] Processing CreateTablet for tablet 8918eabfb0c8441f93e98dd494056d3e (DEFAULT_TABLE table=test-table [id=80a33c2578f34f16839a679769e4c73e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:37:53.735611 6744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8918eabfb0c8441f93e98dd494056d3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:37:53.735611 7146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8918eabfb0c8441f93e98dd494056d3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:37:53.735612 6951 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8918eabfb0c8441f93e98dd494056d3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:37:53.742269 7263 tablet_bootstrap.cc:492] T 8918eabfb0c8441f93e98dd494056d3e P c4a94f9d7e97490396d8188d52cdf0e8: Bootstrap starting.
I20260808 14:37:53.743690 7266 tablet_bootstrap.cc:492] T 8918eabfb0c8441f93e98dd494056d3e P 1af32ff9999b4913a94febc56560f98f: Bootstrap starting.
I20260808 14:37:53.745086 7263 tablet_bootstrap.cc:654] T 8918eabfb0c8441f93e98dd494056d3e P c4a94f9d7e97490396d8188d52cdf0e8: Neither blocks nor log segments found. Creating new log.
I20260808 14:37:53.745954 7266 tablet_bootstrap.cc:654] T 8918eabfb0c8441f93e98dd494056d3e P 1af32ff9999b4913a94febc56560f98f: Neither blocks nor log segments found. Creating new log.
I20260808 14:37:53.746028 7263 log.cc:824] T 8918eabfb0c8441f93e98dd494056d3e P c4a94f9d7e97490396d8188d52cdf0e8: Log is configured to *not* fsync() on all Append() calls
I20260808 14:37:53.746862 7264 tablet_bootstrap.cc:492] T 8918eabfb0c8441f93e98dd494056d3e P 5c061dcbd6834916a7293278b38010b7: Bootstrap starting.
I20260808 14:37:53.746876 7266 log.cc:824] T 8918eabfb0c8441f93e98dd494056d3e P 1af32ff9999b4913a94febc56560f98f: Log is configured to *not* fsync() on all Append() calls
I20260808 14:37:53.748992 7264 tablet_bootstrap.cc:654] T 8918eabfb0c8441f93e98dd494056d3e P 5c061dcbd6834916a7293278b38010b7: Neither blocks nor log segments found. Creating new log.
I20260808 14:37:53.749857 7264 log.cc:824] T 8918eabfb0c8441f93e98dd494056d3e P 5c061dcbd6834916a7293278b38010b7: Log is configured to *not* fsync() on all Append() calls
I20260808 14:37:53.750243 7263 tablet_bootstrap.cc:492] T 8918eabfb0c8441f93e98dd494056d3e P c4a94f9d7e97490396d8188d52cdf0e8: No bootstrap required, opened a new log
I20260808 14:37:53.750475 7263 ts_tablet_manager.cc:1397] T 8918eabfb0c8441f93e98dd494056d3e P c4a94f9d7e97490396d8188d52cdf0e8: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260808 14:37:53.751677 7266 tablet_bootstrap.cc:492] T 8918eabfb0c8441f93e98dd494056d3e P 1af32ff9999b4913a94febc56560f98f: No bootstrap required, opened a new log
I20260808 14:37:53.751884 7266 ts_tablet_manager.cc:1397] T 8918eabfb0c8441f93e98dd494056d3e P 1af32ff9999b4913a94febc56560f98f: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260808 14:37:53.752012 7264 tablet_bootstrap.cc:492] T 8918eabfb0c8441f93e98dd494056d3e P 5c061dcbd6834916a7293278b38010b7: No bootstrap required, opened a new log
I20260808 14:37:53.752239 7264 ts_tablet_manager.cc:1397] T 8918eabfb0c8441f93e98dd494056d3e P 5c061dcbd6834916a7293278b38010b7: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 14:37:53.755096 7263 raft_consensus.cc:348] T 8918eabfb0c8441f93e98dd494056d3e P c4a94f9d7e97490396d8188d52cdf0e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1af32ff9999b4913a94febc56560f98f" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 43649 } } peers { permanent_uuid: "5c061dcbd6834916a7293278b38010b7" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34593 } } peers { permanent_uuid: "c4a94f9d7e97490396d8188d52cdf0e8" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 34847 } }
I20260808 14:37:53.755390 7263 raft_consensus.cc:374] T 8918eabfb0c8441f93e98dd494056d3e P c4a94f9d7e97490396d8188d52cdf0e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:37:53.755457 7263 raft_consensus.cc:729] T 8918eabfb0c8441f93e98dd494056d3e P c4a94f9d7e97490396d8188d52cdf0e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4a94f9d7e97490396d8188d52cdf0e8, State: Initialized, Role: FOLLOWER
I20260808 14:37:53.755935 7263 consensus_queue.cc:260] T 8918eabfb0c8441f93e98dd494056d3e P c4a94f9d7e97490396d8188d52cdf0e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1af32ff9999b4913a94febc56560f98f" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 43649 } } peers { permanent_uuid: "5c061dcbd6834916a7293278b38010b7" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34593 } } peers { permanent_uuid: "c4a94f9d7e97490396d8188d52cdf0e8" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 34847 } }
I20260808 14:37:53.756194 7264 raft_consensus.cc:348] T 8918eabfb0c8441f93e98dd494056d3e P 5c061dcbd6834916a7293278b38010b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1af32ff9999b4913a94febc56560f98f" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 43649 } } peers { permanent_uuid: "5c061dcbd6834916a7293278b38010b7" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34593 } } peers { permanent_uuid: "c4a94f9d7e97490396d8188d52cdf0e8" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 34847 } }
I20260808 14:37:53.756302 7266 raft_consensus.cc:348] T 8918eabfb0c8441f93e98dd494056d3e P 1af32ff9999b4913a94febc56560f98f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1af32ff9999b4913a94febc56560f98f" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 43649 } } peers { permanent_uuid: "5c061dcbd6834916a7293278b38010b7" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34593 } } peers { permanent_uuid: "c4a94f9d7e97490396d8188d52cdf0e8" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 34847 } }
I20260808 14:37:53.756484 7264 raft_consensus.cc:374] T 8918eabfb0c8441f93e98dd494056d3e P 5c061dcbd6834916a7293278b38010b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:37:53.756538 7264 raft_consensus.cc:729] T 8918eabfb0c8441f93e98dd494056d3e P 5c061dcbd6834916a7293278b38010b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c061dcbd6834916a7293278b38010b7, State: Initialized, Role: FOLLOWER
I20260808 14:37:53.756552 7266 raft_consensus.cc:374] T 8918eabfb0c8441f93e98dd494056d3e P 1af32ff9999b4913a94febc56560f98f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:37:53.756606 7266 raft_consensus.cc:729] T 8918eabfb0c8441f93e98dd494056d3e P 1af32ff9999b4913a94febc56560f98f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1af32ff9999b4913a94febc56560f98f, State: Initialized, Role: FOLLOWER
I20260808 14:37:53.756959 7053 heartbeater.cc:503] Master 127.11.131.254:41473 was elected leader, sending a full tablet report...
I20260808 14:37:53.757028 7263 ts_tablet_manager.cc:1428] T 8918eabfb0c8441f93e98dd494056d3e P c4a94f9d7e97490396d8188d52cdf0e8: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 14:37:53.756958 7264 consensus_queue.cc:260] T 8918eabfb0c8441f93e98dd494056d3e P 5c061dcbd6834916a7293278b38010b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1af32ff9999b4913a94febc56560f98f" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 43649 } } peers { permanent_uuid: "5c061dcbd6834916a7293278b38010b7" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34593 } } peers { permanent_uuid: "c4a94f9d7e97490396d8188d52cdf0e8" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 34847 } }
I20260808 14:37:53.757066 7266 consensus_queue.cc:260] T 8918eabfb0c8441f93e98dd494056d3e P 1af32ff9999b4913a94febc56560f98f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1af32ff9999b4913a94febc56560f98f" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 43649 } } peers { permanent_uuid: "5c061dcbd6834916a7293278b38010b7" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34593 } } peers { permanent_uuid: "c4a94f9d7e97490396d8188d52cdf0e8" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 34847 } }
I20260808 14:37:53.757612 7241 heartbeater.cc:503] Master 127.11.131.254:41473 was elected leader, sending a full tablet report...
I20260808 14:37:53.757853 6848 heartbeater.cc:503] Master 127.11.131.254:41473 was elected leader, sending a full tablet report...
I20260808 14:37:53.757886 7264 ts_tablet_manager.cc:1428] T 8918eabfb0c8441f93e98dd494056d3e P 5c061dcbd6834916a7293278b38010b7: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260808 14:37:53.759276 7266 ts_tablet_manager.cc:1428] T 8918eabfb0c8441f93e98dd494056d3e P 1af32ff9999b4913a94febc56560f98f: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
W20260808 14:37:53.773168 6853 tablet.cc:2369] T 8918eabfb0c8441f93e98dd494056d3e P 1af32ff9999b4913a94febc56560f98f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:37:53.874673 7273 raft_consensus.cc:482] T 8918eabfb0c8441f93e98dd494056d3e P 1af32ff9999b4913a94febc56560f98f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:37:53.875051 7273 raft_consensus.cc:504] T 8918eabfb0c8441f93e98dd494056d3e P 1af32ff9999b4913a94febc56560f98f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1af32ff9999b4913a94febc56560f98f" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 43649 } } peers { permanent_uuid: "5c061dcbd6834916a7293278b38010b7" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34593 } } peers { permanent_uuid: "c4a94f9d7e97490396d8188d52cdf0e8" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 34847 } }
I20260808 14:37:53.876503 7273 leader_election.cc:288] T 8918eabfb0c8441f93e98dd494056d3e P 1af32ff9999b4913a94febc56560f98f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c061dcbd6834916a7293278b38010b7 (127.11.131.195:34593), c4a94f9d7e97490396d8188d52cdf0e8 (127.11.131.194:34847)
I20260808 14:37:53.881079 7260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:53.876849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:59617 (local address 127.11.131.195:34593)
0808 14:37:53.877020 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:53.877025 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:53.877189 (+ 164us) server_negotiation.cc:407] Connection header received
0808 14:37:53.877432 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:53.877437 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:53.877497 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:53.877574 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:37:53.877975 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:53.878646 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:53.879924 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:53.880498 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:53.880636 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:53.880688 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:53.880884 (+ 196us) server_negotiation.cc:299] Negotiation successful
0808 14:37:53.880955 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 14:37:53.881101 7276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:53.876795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.195:34593 (local address 127.11.131.193:59617)
0808 14:37:53.877075 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:53.877089 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:37:53.877282 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:37:53.877598 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:37:53.877602 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:37:53.877627 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:37:53.877827 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:53.877836 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:53.878761 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:53.878764 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:53.879762 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:53.879775 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:53.880629 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:53.880633 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:53.880744 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:53.880768 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 14:37:53.880867 (+ 99us) client_negotiation.cc:240] Negotiation successful
0808 14:37:53.880938 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":201,"mutex_wait_us":2,"thread_start_us":119,"threads_started":1}
I20260808 14:37:53.881256 7262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:53.877437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:55917 (local address 127.11.131.194:34847)
0808 14:37:53.877579 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:53.877583 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:53.877715 (+ 132us) server_negotiation.cc:407] Connection header received
0808 14:37:53.877842 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:53.877845 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:53.877906 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:53.877984 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:37:53.878280 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:53.878895 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:53.880170 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:53.880722 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:53.880872 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:53.880920 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:53.881076 (+ 156us) server_negotiation.cc:299] Negotiation successful
0808 14:37:53.881147 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 14:37:53.881278 7277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:53.877260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.194:34847 (local address 127.11.131.193:55917)
0808 14:37:53.877613 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:53.877626 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:37:53.877735 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:37:53.878010 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:37:53.878013 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:37:53.878032 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:37:53.878156 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:53.878163 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:53.879012 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:53.879014 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:53.879988 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:53.880000 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:53.880862 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:53.880866 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:53.880961 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:53.880983 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 14:37:53.881058 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 14:37:53.881127 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"mutex_wait_us":28,"thread_start_us":147,"threads_started":1}
I20260808 14:37:53.881769 7173 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8918eabfb0c8441f93e98dd494056d3e" candidate_uuid: "1af32ff9999b4913a94febc56560f98f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c061dcbd6834916a7293278b38010b7" is_pre_election: true
I20260808 14:37:53.881822 6986 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8918eabfb0c8441f93e98dd494056d3e" candidate_uuid: "1af32ff9999b4913a94febc56560f98f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4a94f9d7e97490396d8188d52cdf0e8" is_pre_election: true
I20260808 14:37:53.882104 7173 raft_consensus.cc:2454] T 8918eabfb0c8441f93e98dd494056d3e P 5c061dcbd6834916a7293278b38010b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1af32ff9999b4913a94febc56560f98f in term 0.
I20260808 14:37:53.882118 6986 raft_consensus.cc:2454] T 8918eabfb0c8441f93e98dd494056d3e P c4a94f9d7e97490396d8188d52cdf0e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1af32ff9999b4913a94febc56560f98f in term 0.
I20260808 14:37:53.882665 6680 leader_election.cc:302] T 8918eabfb0c8441f93e98dd494056d3e P 1af32ff9999b4913a94febc56560f98f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1af32ff9999b4913a94febc56560f98f, 5c061dcbd6834916a7293278b38010b7; no voters:
I20260808 14:37:53.882973 7273 raft_consensus.cc:2781] T 8918eabfb0c8441f93e98dd494056d3e P 1af32ff9999b4913a94febc56560f98f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:37:53.883076 7273 raft_consensus.cc:482] T 8918eabfb0c8441f93e98dd494056d3e P 1af32ff9999b4913a94febc56560f98f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:37:53.883136 7273 raft_consensus.cc:3037] T 8918eabfb0c8441f93e98dd494056d3e P 1af32ff9999b4913a94febc56560f98f [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:37:53.884224 7273 raft_consensus.cc:504] T 8918eabfb0c8441f93e98dd494056d3e P 1af32ff9999b4913a94febc56560f98f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1af32ff9999b4913a94febc56560f98f" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 43649 } } peers { permanent_uuid: "5c061dcbd6834916a7293278b38010b7" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34593 } } peers { permanent_uuid: "c4a94f9d7e97490396d8188d52cdf0e8" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 34847 } }
I20260808 14:37:53.884575 7273 leader_election.cc:288] T 8918eabfb0c8441f93e98dd494056d3e P 1af32ff9999b4913a94febc56560f98f [CANDIDATE]: Term 1 election: Requested vote from peers 5c061dcbd6834916a7293278b38010b7 (127.11.131.195:34593), c4a94f9d7e97490396d8188d52cdf0e8 (127.11.131.194:34847)
I20260808 14:37:53.884931 7173 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8918eabfb0c8441f93e98dd494056d3e" candidate_uuid: "1af32ff9999b4913a94febc56560f98f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c061dcbd6834916a7293278b38010b7"
I20260808 14:37:53.885025 6986 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8918eabfb0c8441f93e98dd494056d3e" candidate_uuid: "1af32ff9999b4913a94febc56560f98f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4a94f9d7e97490396d8188d52cdf0e8"
I20260808 14:37:53.885072 7173 raft_consensus.cc:3037] T 8918eabfb0c8441f93e98dd494056d3e P 5c061dcbd6834916a7293278b38010b7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:37:53.885185 6986 raft_consensus.cc:3037] T 8918eabfb0c8441f93e98dd494056d3e P c4a94f9d7e97490396d8188d52cdf0e8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:37:53.886145 7173 raft_consensus.cc:2454] T 8918eabfb0c8441f93e98dd494056d3e P 5c061dcbd6834916a7293278b38010b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1af32ff9999b4913a94febc56560f98f in term 1.
I20260808 14:37:53.886276 6986 raft_consensus.cc:2454] T 8918eabfb0c8441f93e98dd494056d3e P c4a94f9d7e97490396d8188d52cdf0e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1af32ff9999b4913a94febc56560f98f in term 1.
I20260808 14:37:53.886490 6680 leader_election.cc:302] T 8918eabfb0c8441f93e98dd494056d3e P 1af32ff9999b4913a94febc56560f98f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1af32ff9999b4913a94febc56560f98f, 5c061dcbd6834916a7293278b38010b7; no voters:
I20260808 14:37:53.886696 7273 raft_consensus.cc:2781] T 8918eabfb0c8441f93e98dd494056d3e P 1af32ff9999b4913a94febc56560f98f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:37:53.886955 7273 raft_consensus.cc:686] T 8918eabfb0c8441f93e98dd494056d3e P 1af32ff9999b4913a94febc56560f98f [term 1 LEADER]: Becoming Leader. State: Replica: 1af32ff9999b4913a94febc56560f98f, State: Running, Role: LEADER
I20260808 14:37:53.887276 7273 consensus_queue.cc:237] T 8918eabfb0c8441f93e98dd494056d3e P 1af32ff9999b4913a94febc56560f98f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1af32ff9999b4913a94febc56560f98f" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 43649 } } peers { permanent_uuid: "5c061dcbd6834916a7293278b38010b7" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34593 } } peers { permanent_uuid: "c4a94f9d7e97490396d8188d52cdf0e8" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 34847 } }
I20260808 14:37:53.890390 6569 catalog_manager.cc:5495] T 8918eabfb0c8441f93e98dd494056d3e P 1af32ff9999b4913a94febc56560f98f reported cstate change: term changed from 0 to 1, leader changed from <none> to 1af32ff9999b4913a94febc56560f98f (127.11.131.193). New cstate: current_term: 1 leader_uuid: "1af32ff9999b4913a94febc56560f98f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1af32ff9999b4913a94febc56560f98f" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 43649 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c061dcbd6834916a7293278b38010b7" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34593 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4a94f9d7e97490396d8188d52cdf0e8" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 34847 } health_report { overall_health: UNKNOWN } } }
I20260808 14:37:53.926869 7258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:53.923020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58250 (local address 127.11.131.193:43649)
0808 14:37:53.923164 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:53.923168 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:53.923181 (+ 13us) server_negotiation.cc:407] Connection header received
0808 14:37:53.923294 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:53.923296 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:53.923359 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:53.923455 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:37:53.923731 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:53.924246 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:53.925243 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:53.925458 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:53.925527 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:53.925943 (+ 416us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:37:53.926430 (+ 487us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:37:53.926525 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:53.926690 (+ 165us) server_negotiation.cc:299] Negotiation successful
0808 14:37:53.926742 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
W20260808 14:37:53.933082 7245 tablet.cc:2369] T 8918eabfb0c8441f93e98dd494056d3e P 5c061dcbd6834916a7293278b38010b7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:37:53.933328 6986 raft_consensus.cc:1261] T 8918eabfb0c8441f93e98dd494056d3e P c4a94f9d7e97490396d8188d52cdf0e8 [term 1 FOLLOWER]: Refusing update from remote peer 1af32ff9999b4913a94febc56560f98f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:37:53.933336 7173 raft_consensus.cc:1261] T 8918eabfb0c8441f93e98dd494056d3e P 5c061dcbd6834916a7293278b38010b7 [term 1 FOLLOWER]: Refusing update from remote peer 1af32ff9999b4913a94febc56560f98f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:37:53.934142 7273 consensus_queue.cc:1035] T 8918eabfb0c8441f93e98dd494056d3e P 1af32ff9999b4913a94febc56560f98f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c061dcbd6834916a7293278b38010b7" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 34593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:37:53.934351 7278 consensus_queue.cc:1035] T 8918eabfb0c8441f93e98dd494056d3e P 1af32ff9999b4913a94febc56560f98f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4a94f9d7e97490396d8188d52cdf0e8" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 34847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:37:53.944437 7283 mvcc.cc:205] Tried to move back new op lower bound from 7316274683622895616 to 7316274683444834304. Current Snapshot: MvccSnapshot[applied={T|T < 7316274683622895616}]
I20260808 14:37:53.953073 6568 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:50066:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:37:53.953289 6568 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:50066:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:37:53.956528 6568 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 62fc0bd3dd204f37bfaed757e1095f41: Sending DeleteTablet for 3 replicas of tablet 8918eabfb0c8441f93e98dd494056d3e
I20260808 14:37:53.957377 6744 tablet_service.cc:1514] Processing DeleteTablet for tablet 8918eabfb0c8441f93e98dd494056d3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:37:53 UTC) from {username='slave'} at 127.0.0.1:58246
I20260808 14:37:53.957436 6951 tablet_service.cc:1514] Processing DeleteTablet for tablet 8918eabfb0c8441f93e98dd494056d3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:37:53 UTC) from {username='slave'} at 127.0.0.1:33288
I20260808 14:37:53.957919 7296 tablet_replica.cc:330] T 8918eabfb0c8441f93e98dd494056d3e P 1af32ff9999b4913a94febc56560f98f: stopping tablet replica
I20260808 14:37:53.957990 7298 tablet_replica.cc:330] T 8918eabfb0c8441f93e98dd494056d3e P c4a94f9d7e97490396d8188d52cdf0e8: stopping tablet replica
I20260808 14:37:53.958161 7146 tablet_service.cc:1514] Processing DeleteTablet for tablet 8918eabfb0c8441f93e98dd494056d3e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:37:53 UTC) from {username='slave'} at 127.0.0.1:34280
I20260808 14:37:53.958369 7298 raft_consensus.cc:2229] T 8918eabfb0c8441f93e98dd494056d3e P c4a94f9d7e97490396d8188d52cdf0e8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:37:53.958494 7296 raft_consensus.cc:2229] T 8918eabfb0c8441f93e98dd494056d3e P 1af32ff9999b4913a94febc56560f98f [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:37:53.958787 7298 raft_consensus.cc:2258] T 8918eabfb0c8441f93e98dd494056d3e P c4a94f9d7e97490396d8188d52cdf0e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:37:53.959079 7296 raft_consensus.cc:2258] T 8918eabfb0c8441f93e98dd494056d3e P 1af32ff9999b4913a94febc56560f98f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:37:53.960587 7298 ts_tablet_manager.cc:1905] T 8918eabfb0c8441f93e98dd494056d3e P c4a94f9d7e97490396d8188d52cdf0e8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:37:53.960887 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 6652
I20260808 14:37:53.961125 7296 ts_tablet_manager.cc:1905] T 8918eabfb0c8441f93e98dd494056d3e P 1af32ff9999b4913a94febc56560f98f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:37:53.961650 7300 tablet_replica.cc:330] T 8918eabfb0c8441f93e98dd494056d3e P 5c061dcbd6834916a7293278b38010b7: stopping tablet replica
I20260808 14:37:53.961966 7300 raft_consensus.cc:2229] T 8918eabfb0c8441f93e98dd494056d3e P 5c061dcbd6834916a7293278b38010b7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:37:53.962255 7300 raft_consensus.cc:2258] T 8918eabfb0c8441f93e98dd494056d3e P 5c061dcbd6834916a7293278b38010b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:37:53.964314 7298 ts_tablet_manager.cc:1918] T 8918eabfb0c8441f93e98dd494056d3e P c4a94f9d7e97490396d8188d52cdf0e8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:37:53.964425 7298 log.cc:1196] T 8918eabfb0c8441f93e98dd494056d3e P c4a94f9d7e97490396d8188d52cdf0e8: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/ts-1/wal/wals/8918eabfb0c8441f93e98dd494056d3e
I20260808 14:37:53.964784 7298 ts_tablet_manager.cc:1939] T 8918eabfb0c8441f93e98dd494056d3e P c4a94f9d7e97490396d8188d52cdf0e8: Deleting consensus metadata
I20260808 14:37:53.965306 7300 ts_tablet_manager.cc:1905] T 8918eabfb0c8441f93e98dd494056d3e P 5c061dcbd6834916a7293278b38010b7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:37:53.967339 6552 catalog_manager.cc:4841] TS c4a94f9d7e97490396d8188d52cdf0e8 (127.11.131.194:34847): tablet 8918eabfb0c8441f93e98dd494056d3e (table test-table [id=80a33c2578f34f16839a679769e4c73e]) successfully deleted
I20260808 14:37:53.969012 7300 ts_tablet_manager.cc:1918] T 8918eabfb0c8441f93e98dd494056d3e P 5c061dcbd6834916a7293278b38010b7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:37:53.969122 7300 log.cc:1196] T 8918eabfb0c8441f93e98dd494056d3e P 5c061dcbd6834916a7293278b38010b7: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786199615258783-11791-0/minicluster-data/ts-2/wal/wals/8918eabfb0c8441f93e98dd494056d3e
I20260808 14:37:53.969444 7300 ts_tablet_manager.cc:1939] T 8918eabfb0c8441f93e98dd494056d3e P 5c061dcbd6834916a7293278b38010b7: Deleting consensus metadata
I20260808 14:37:53.970773 6552 catalog_manager.cc:4841] TS 5c061dcbd6834916a7293278b38010b7 (127.11.131.195:34593): tablet 8918eabfb0c8441f93e98dd494056d3e (table test-table [id=80a33c2578f34f16839a679769e4c73e]) successfully deleted
W20260808 14:37:53.975054 6549 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.131.193:43649 (error 108)
I20260808 14:37:53.975967 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 6856
I20260808 14:37:53.976208 7261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:53.975877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:43649 (local address 127.0.0.1:58262)
0808 14:37:53.976013 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:53.976095 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.193:43649: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260808 14:37:53.982808 6549 catalog_manager.cc:4584] TS 1af32ff9999b4913a94febc56560f98f (127.11.131.193:43649): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8918eabfb0c8441f93e98dd494056d3e: Network error: Client connection negotiation failed: client connection to 127.11.131.193:43649: connect: Connection refused (error 111)
I20260808 14:37:53.990216 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 7057
I20260808 14:37:54.003938 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 6525
2026-08-08T14:37:54Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (1206 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:37:54 dist-test-slave-twwt krb5kdc[7309](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:37:54 dist-test-slave-twwt krb5kdc[7309](info): set up 2 sockets
Aug 08 14:37:54 dist-test-slave-twwt krb5kdc[7309](info): commencing operation
krb5kdc: starting...
W20260808 14:37:55.255060 11791 mini_kdc.cc:121] Time spent starting KDC: real 1.222s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Aug 08 14:37:55 dist-test-slave-twwt krb5kdc[7309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199875, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:37:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:37:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.131.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
I20260808 14:37:55.390136 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:34899
--webserver_interface=127.11.131.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:39149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:34899
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:37:55.509858 7330 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:37:55.510161 7330 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:37:55.510228 7330 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:37:55.514292 7330 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:37:55.514382 7330 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:37:55.514423 7330 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:37:55.514484 7330 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:37:55.514524 7330 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:37:55.519848 7330 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:39149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:34899
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:34899
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.131.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7330
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:37:55.520989 7330 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:37:55.522059 7330 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:37:55.531167 7341 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:37:55.531175 7339 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:37:55.531270 7338 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:37:55.531416 7330 server_base.cc:1034] running on GCE node
I20260808 14:37:55.532146 7330 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:37:55.533290 7330 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:37:55.534492 7330 hybrid_clock.cc:648] HybridClock initialized: now 1786199875534482 us; error 32 us; skew 500 ppm
Aug 08 14:37:55 dist-test-slave-twwt krb5kdc[7309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199875, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:37:55.537343 7330 init.cc:377] Logged in from keytab as kudu/127.11.131.254@KRBTEST.COM (short username kudu)
I20260808 14:37:55.538306 7330 webserver.cc:460] Webserver started at http://127.11.131.254:34111/ using document root <none> and password file <none>
I20260808 14:37:55.538954 7330 fs_manager.cc:359] Metadata directory not provided
I20260808 14:37:55.539045 7330 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:37:55.539285 7330 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:37:55.541340 7330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/master-0/data/instance:
uuid: "7cc948bbfb66439c950cb50e2b998d40"
format_stamp: "Formatted at 2026-08-08 14:37:55 on dist-test-slave-twwt"
server_key: "3b0d06d5b38b73226339069d088d94a1"
server_key_iv: "06794c298564e4b1676f3e3132ca789b"
server_key_version: "encryptionkey@0"
I20260808 14:37:55.541927 7330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/master-0/wal/instance:
uuid: "7cc948bbfb66439c950cb50e2b998d40"
format_stamp: "Formatted at 2026-08-08 14:37:55 on dist-test-slave-twwt"
server_key: "3b0d06d5b38b73226339069d088d94a1"
server_key_iv: "06794c298564e4b1676f3e3132ca789b"
server_key_version: "encryptionkey@0"
I20260808 14:37:55.546077 7330 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.003s
I20260808 14:37:55.548540 7352 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:55.549808 7330 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 14:37:55.549960 7330 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "7cc948bbfb66439c950cb50e2b998d40"
format_stamp: "Formatted at 2026-08-08 14:37:55 on dist-test-slave-twwt"
server_key: "3b0d06d5b38b73226339069d088d94a1"
server_key_iv: "06794c298564e4b1676f3e3132ca789b"
server_key_version: "encryptionkey@0"
I20260808 14:37:55.550076 7330 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:37:55.577733 7330 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:37:55.581097 7330 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:37:55.581326 7330 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:37:55.588614 7330 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.254:34899
I20260808 14:37:55.588686 7428 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.254:34899 every 8 connection(s)
I20260808 14:37:55.589833 7330 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:37:55.592804 7429 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:37:55.598263 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 7330
I20260808 14:37:55.598325 7429 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7cc948bbfb66439c950cb50e2b998d40: Bootstrap starting.
I20260808 14:37:55.598451 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/master-0/wal/instance
I20260808 14:37:55.598829 11791 external_mini_cluster.cc:1428] Setting key 11272cff99a1590849132cb722a7be8b
I20260808 14:37:55.600934 7429 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7cc948bbfb66439c950cb50e2b998d40: Neither blocks nor log segments found. Creating new log.
I20260808 14:37:55.601699 7429 log.cc:824] T 00000000000000000000000000000000 P 7cc948bbfb66439c950cb50e2b998d40: Log is configured to *not* fsync() on all Append() calls
I20260808 14:37:55.603660 7429 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7cc948bbfb66439c950cb50e2b998d40: No bootstrap required, opened a new log
I20260808 14:37:55.607038 7429 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7cc948bbfb66439c950cb50e2b998d40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cc948bbfb66439c950cb50e2b998d40" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 34899 } }
I20260808 14:37:55.607280 7429 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7cc948bbfb66439c950cb50e2b998d40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:37:55.607371 7429 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7cc948bbfb66439c950cb50e2b998d40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cc948bbfb66439c950cb50e2b998d40, State: Initialized, Role: FOLLOWER
Aug 08 14:37:55 dist-test-slave-twwt krb5kdc[7309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199875, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:37:55.607908 7429 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7cc948bbfb66439c950cb50e2b998d40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cc948bbfb66439c950cb50e2b998d40" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 34899 } }
I20260808 14:37:55.608078 7429 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7cc948bbfb66439c950cb50e2b998d40 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:37:55.608146 7429 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7cc948bbfb66439c950cb50e2b998d40 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:37:55.608240 7429 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7cc948bbfb66439c950cb50e2b998d40 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:37:55.609375 7429 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7cc948bbfb66439c950cb50e2b998d40 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cc948bbfb66439c950cb50e2b998d40" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 34899 } }
I20260808 14:37:55.609736 7429 leader_election.cc:302] T 00000000000000000000000000000000 P 7cc948bbfb66439c950cb50e2b998d40 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7cc948bbfb66439c950cb50e2b998d40; no voters:
I20260808 14:37:55.610082 7429 leader_election.cc:288] T 00000000000000000000000000000000 P 7cc948bbfb66439c950cb50e2b998d40 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:37:55.610174 7435 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7cc948bbfb66439c950cb50e2b998d40 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:37:55.610394 7435 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7cc948bbfb66439c950cb50e2b998d40 [term 1 LEADER]: Becoming Leader. State: Replica: 7cc948bbfb66439c950cb50e2b998d40, State: Running, Role: LEADER
I20260808 14:37:55.610723 7435 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7cc948bbfb66439c950cb50e2b998d40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cc948bbfb66439c950cb50e2b998d40" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 34899 } }
I20260808 14:37:55.611433 7429 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7cc948bbfb66439c950cb50e2b998d40 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:37:55.612512 7436 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7cc948bbfb66439c950cb50e2b998d40 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7cc948bbfb66439c950cb50e2b998d40. Latest consensus state: current_term: 1 leader_uuid: "7cc948bbfb66439c950cb50e2b998d40" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cc948bbfb66439c950cb50e2b998d40" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 34899 } } }
I20260808 14:37:55.612540 7437 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7cc948bbfb66439c950cb50e2b998d40 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7cc948bbfb66439c950cb50e2b998d40" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cc948bbfb66439c950cb50e2b998d40" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 34899 } } }
I20260808 14:37:55.612655 7436 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7cc948bbfb66439c950cb50e2b998d40 [sys.catalog]: This master's current role is: LEADER
I20260808 14:37:55.612663 7437 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7cc948bbfb66439c950cb50e2b998d40 [sys.catalog]: This master's current role is: LEADER
I20260808 14:37:55.613106 7445 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:37:55.614349 7433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:55.600216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59678 (local address 127.11.131.254:34899)
0808 14:37:55.600698 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:55.600713 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:55.600747 (+ 34us) server_negotiation.cc:407] Connection header received
0808 14:37:55.601443 (+ 696us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:55.601461 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:55.601801 (+ 340us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:55.602181 (+ 380us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:37:55.603057 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:55.604088 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:55.604962 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:55.605447 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:55.605624 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:55.608435 (+ 2811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:37:55.608441 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:37:55.608454 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:37:55.608481 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:37:55.610400 (+ 1919us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:37:55.610961 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:37:55.610966 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:37:55.610971 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:37:55.611098 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:37:55.611393 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:37:55.611396 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:37:55.611397 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:37:55.611909 (+ 512us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:37:55.612897 (+ 988us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:55.613054 (+ 157us) server_negotiation.cc:299] Negotiation successful
0808 14:37:55.613370 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323,"thread_start_us":129,"threads_started":1}
I20260808 14:37:55.616458 7445 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:37:55.622189 7445 catalog_manager.cc:1347] Generated new cluster ID: b7a064257034480f9b39ef3aa49ebf07
I20260808 14:37:55.622287 7445 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:37:55.633333 7445 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:37:55.634639 7445 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:37:55.647023 7445 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7cc948bbfb66439c950cb50e2b998d40: Generated new TSK 0
I20260808 14:37:55.647907 7445 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.131.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab.
Entry for principal kudu/127.11.131.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab.
I20260808 14:37:55.685741 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.193:0
--local_ip_for_outbound_sockets=127.11.131.193
--webserver_interface=127.11.131.193
--webserver_port=0
--tserver_master_addrs=127.11.131.254:34899
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab
--principal=kudu/127.11.131.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:39149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:37:55.808583 7463 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:37:55.808851 7463 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:37:55.808894 7463 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:37:55.813315 7463 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:37:55.813373 7463 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:37:55.813467 7463 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.193
I20260808 14:37:55.818770 7463 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:39149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab
--principal=kudu/127.11.131.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.131.193
--webserver_port=0
--tserver_master_addrs=127.11.131.254:34899
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7463
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.193
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:37:55.819873 7463 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:37:55.820969 7463 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:37:55.831192 7478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:37:55.831182 7474 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:37:55.831192 7476 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:37:55.831488 7463 server_base.cc:1034] running on GCE node
I20260808 14:37:55.831969 7463 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:37:55.832762 7463 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:37:55.833966 7463 hybrid_clock.cc:648] HybridClock initialized: now 1786199875833939 us; error 44 us; skew 500 ppm
Aug 08 14:37:55 dist-test-slave-twwt krb5kdc[7309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199875, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:37:55.837005 7463 init.cc:377] Logged in from keytab as kudu/127.11.131.193@KRBTEST.COM (short username kudu)
I20260808 14:37:55.837949 7463 webserver.cc:460] Webserver started at http://127.11.131.193:45405/ using document root <none> and password file <none>
I20260808 14:37:55.838557 7463 fs_manager.cc:359] Metadata directory not provided
I20260808 14:37:55.838678 7463 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:37:55.838927 7463 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:37:55.841180 7463 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/ts-0/data/instance:
uuid: "e6901a1d3eac486498e89de0a1f684f8"
format_stamp: "Formatted at 2026-08-08 14:37:55 on dist-test-slave-twwt"
server_key: "632eb521e52de67c683b61d5725c13de"
server_key_iv: "9ebf4140c058c1e620e1c1f4336b0dce"
server_key_version: "encryptionkey@0"
I20260808 14:37:55.841809 7463 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/ts-0/wal/instance:
uuid: "e6901a1d3eac486498e89de0a1f684f8"
format_stamp: "Formatted at 2026-08-08 14:37:55 on dist-test-slave-twwt"
server_key: "632eb521e52de67c683b61d5725c13de"
server_key_iv: "9ebf4140c058c1e620e1c1f4336b0dce"
server_key_version: "encryptionkey@0"
I20260808 14:37:55.845783 7463 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260808 14:37:55.848825 7490 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:55.850257 7463 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 14:37:55.850431 7463 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/ts-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/ts-0/wal
uuid: "e6901a1d3eac486498e89de0a1f684f8"
format_stamp: "Formatted at 2026-08-08 14:37:55 on dist-test-slave-twwt"
server_key: "632eb521e52de67c683b61d5725c13de"
server_key_iv: "9ebf4140c058c1e620e1c1f4336b0dce"
server_key_version: "encryptionkey@0"
I20260808 14:37:55.850564 7463 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:37:55.868732 7463 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:37:55.872287 7463 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:37:55.872525 7463 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:37:55.873242 7463 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:37:55.874187 7463 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:37:55.874260 7463 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:55.874344 7463 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:37:55.874392 7463 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:55.884114 7463 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.193:41321
I20260808 14:37:55.884138 7660 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.193:41321 every 8 connection(s)
I20260808 14:37:55.885056 7463 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
I20260808 14:37:55.893632 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 7463
I20260808 14:37:55.893822 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/ts-0/wal/instance
I20260808 14:37:55.894148 11791 external_mini_cluster.cc:1428] Setting key 49049f0bcf07cc5642114bff587639f4
Aug 08 14:37:55 dist-test-slave-twwt krb5kdc[7309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199875, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.193@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:37:55.900022 7433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:55.887039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:48633 (local address 127.11.131.254:34899)
0808 14:37:55.887207 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:55.887212 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:55.888056 (+ 844us) server_negotiation.cc:407] Connection header received
0808 14:37:55.889411 (+ 1355us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:55.889414 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:55.889462 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:55.889537 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:37:55.890745 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:55.891323 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:55.892519 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:55.892815 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:55.892913 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:55.895722 (+ 2809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:37:55.895726 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:37:55.895729 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:37:55.895762 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:37:55.897399 (+ 1637us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:37:55.898125 (+ 726us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:37:55.898130 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:37:55.898135 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:37:55.898244 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:37:55.898649 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:37:55.898654 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:37:55.898656 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:37:55.898979 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:37:55.899093 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:55.899611 (+ 518us) server_negotiation.cc:299] Negotiation successful
0808 14:37:55.899775 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 14:37:55.900756 7663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:55.887438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:34899 (local address 127.11.131.193:48633)
0808 14:37:55.887905 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:55.887949 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 14:37:55.889203 (+ 1254us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:37:55.889708 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:37:55.889716 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:37:55.890089 (+ 373us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:37:55.890580 (+ 491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:55.890594 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:55.891447 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:55.891449 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:55.892373 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:55.892383 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:55.892968 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:55.892971 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:55.893116 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:55.893761 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:37:55.893805 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:37:55.895559 (+ 1754us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:37:55.897529 (+ 1970us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:37:55.897538 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:37:55.897558 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:37:55.897978 (+ 420us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:37:55.898367 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:37:55.898370 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:37:55.898372 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:37:55.898519 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:37:55.899099 (+ 580us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:37:55.899104 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:37:55.899347 (+ 243us) client_negotiation.cc:769] Sending connection context
0808 14:37:55.899517 (+ 170us) client_negotiation.cc:240] Negotiation successful
0808 14:37:55.899787 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":104,"threads_started":1}
I20260808 14:37:55.902136 7661 heartbeater.cc:347] Connected to a master server at 127.11.131.254:34899
I20260808 14:37:55.902462 7661 heartbeater.cc:464] Registering TS with master...
I20260808 14:37:55.903194 7661 heartbeater.cc:511] Master 127.11.131.254:34899 requested a full tablet report, sending...
I20260808 14:37:55.904953 7377 ts_manager.cc:194] Registered new tserver with Master: e6901a1d3eac486498e89de0a1f684f8 (127.11.131.193:41321)
WARNING: no policy specified for kudu/127.11.131.194@KRBTEST.COM; defaulting to no policy
I20260808 14:37:55.906177 7377 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.193@KRBTEST.COM'} at 127.11.131.193:48633
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab.
Entry for principal kudu/127.11.131.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab.
I20260808 14:37:55.926736 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.194:0
--local_ip_for_outbound_sockets=127.11.131.194
--webserver_interface=127.11.131.194
--webserver_port=0
--tserver_master_addrs=127.11.131.254:34899
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab
--principal=kudu/127.11.131.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:39149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:37:56.046684 7666 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:37:56.046976 7666 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:37:56.047073 7666 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:37:56.051239 7666 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:37:56.051314 7666 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:37:56.051397 7666 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.194
I20260808 14:37:56.056893 7666 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:39149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab
--principal=kudu/127.11.131.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.131.194
--webserver_port=0
--tserver_master_addrs=127.11.131.254:34899
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7666
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.194
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:37:56.058007 7666 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:37:56.059137 7666 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:37:56.069344 7679 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:37:56.069360 7683 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:37:56.069414 7666 server_base.cc:1034] running on GCE node
W20260808 14:37:56.069351 7680 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:37:56.070156 7666 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:37:56.070849 7666 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:37:56.072023 7666 hybrid_clock.cc:648] HybridClock initialized: now 1786199876072004 us; error 27 us; skew 500 ppm
Aug 08 14:37:56 dist-test-slave-twwt krb5kdc[7309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199876, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:37:56.074961 7666 init.cc:377] Logged in from keytab as kudu/127.11.131.194@KRBTEST.COM (short username kudu)
I20260808 14:37:56.075855 7666 webserver.cc:460] Webserver started at http://127.11.131.194:46765/ using document root <none> and password file <none>
I20260808 14:37:56.076464 7666 fs_manager.cc:359] Metadata directory not provided
I20260808 14:37:56.076563 7666 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:37:56.076810 7666 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:37:56.078979 7666 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/ts-1/data/instance:
uuid: "b36a68cef9d340cdbb6e65f8e4c591b3"
format_stamp: "Formatted at 2026-08-08 14:37:56 on dist-test-slave-twwt"
server_key: "edc2f991b4202b85d1e8afbc4d65eb31"
server_key_iv: "3146686a983bb0f79796c23467988d88"
server_key_version: "encryptionkey@0"
I20260808 14:37:56.079581 7666 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/ts-1/wal/instance:
uuid: "b36a68cef9d340cdbb6e65f8e4c591b3"
format_stamp: "Formatted at 2026-08-08 14:37:56 on dist-test-slave-twwt"
server_key: "edc2f991b4202b85d1e8afbc4d65eb31"
server_key_iv: "3146686a983bb0f79796c23467988d88"
server_key_version: "encryptionkey@0"
I20260808 14:37:56.083559 7666 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 14:37:56.086041 7692 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:56.087374 7666 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 14:37:56.087514 7666 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/ts-1/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/ts-1/wal
uuid: "b36a68cef9d340cdbb6e65f8e4c591b3"
format_stamp: "Formatted at 2026-08-08 14:37:56 on dist-test-slave-twwt"
server_key: "edc2f991b4202b85d1e8afbc4d65eb31"
server_key_iv: "3146686a983bb0f79796c23467988d88"
server_key_version: "encryptionkey@0"
I20260808 14:37:56.087630 7666 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:37:56.109747 7666 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:37:56.113391 7666 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:37:56.113602 7666 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:37:56.114213 7666 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:37:56.115157 7666 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:37:56.115238 7666 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:56.115337 7666 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:37:56.115381 7666 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:56.124639 7666 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.194:42893
I20260808 14:37:56.124715 7874 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.194:42893 every 8 connection(s)
I20260808 14:37:56.125574 7666 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
I20260808 14:37:56.134773 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 7666
I20260808 14:37:56.134927 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/ts-1/wal/instance
I20260808 14:37:56.135289 11791 external_mini_cluster.cc:1428] Setting key c7e8d3bb9e0a01affbc28596674fc11b
Aug 08 14:37:56 dist-test-slave-twwt krb5kdc[7309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199876, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.194@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:37:56.140689 7433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:56.127538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:45009 (local address 127.11.131.254:34899)
0808 14:37:56.127716 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:56.127721 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:56.128592 (+ 871us) server_negotiation.cc:407] Connection header received
0808 14:37:56.129927 (+ 1335us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:56.129930 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:56.129978 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:56.130055 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:37:56.131339 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:56.131867 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:56.133030 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:56.133248 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:56.133339 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:56.136260 (+ 2921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:37:56.136264 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:37:56.136266 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:37:56.136292 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:37:56.138013 (+ 1721us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:37:56.138737 (+ 724us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:37:56.138740 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:37:56.138741 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:37:56.138826 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:37:56.139379 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:37:56.139385 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:37:56.139387 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:37:56.139670 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:37:56.139796 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:56.140321 (+ 525us) server_negotiation.cc:299] Negotiation successful
0808 14:37:56.140467 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 14:37:56.141463 7878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:56.127966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:34899 (local address 127.11.131.194:45009)
0808 14:37:56.128432 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:56.128478 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 14:37:56.129728 (+ 1250us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:37:56.130255 (+ 527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:37:56.130262 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:37:56.130660 (+ 398us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:37:56.131190 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:56.131204 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:56.131978 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:56.131981 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:56.132916 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:56.132926 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:56.133394 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:56.133397 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:56.133539 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:56.134166 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:37:56.134182 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:37:56.136057 (+ 1875us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:37:56.138143 (+ 2086us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:37:56.138153 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:37:56.138173 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:37:56.138586 (+ 413us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:37:56.138976 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:37:56.138983 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:37:56.138988 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:37:56.139204 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:37:56.139797 (+ 593us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:37:56.139803 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:37:56.140059 (+ 256us) client_negotiation.cc:769] Sending connection context
0808 14:37:56.140217 (+ 158us) client_negotiation.cc:240] Negotiation successful
0808 14:37:56.140509 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":112,"threads_started":1}
I20260808 14:37:56.142856 7876 heartbeater.cc:347] Connected to a master server at 127.11.131.254:34899
I20260808 14:37:56.143157 7876 heartbeater.cc:464] Registering TS with master...
I20260808 14:37:56.143824 7876 heartbeater.cc:511] Master 127.11.131.254:34899 requested a full tablet report, sending...
I20260808 14:37:56.145112 7377 ts_manager.cc:194] Registered new tserver with Master: b36a68cef9d340cdbb6e65f8e4c591b3 (127.11.131.194:42893)
I20260808 14:37:56.145702 7377 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.194@KRBTEST.COM'} at 127.11.131.194:45009
WARNING: no policy specified for kudu/127.11.131.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab.
Entry for principal kudu/127.11.131.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab.
I20260808 14:37:56.169795 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.195:0
--local_ip_for_outbound_sockets=127.11.131.195
--webserver_interface=127.11.131.195
--webserver_port=0
--tserver_master_addrs=127.11.131.254:34899
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab
--principal=kudu/127.11.131.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:39149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:37:56.288583 7881 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:37:56.288897 7881 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:37:56.288977 7881 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:37:56.293138 7881 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:37:56.293231 7881 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:37:56.293325 7881 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.195
I20260808 14:37:56.298682 7881 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:39149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab
--principal=kudu/127.11.131.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.131.195
--webserver_port=0
--tserver_master_addrs=127.11.131.254:34899
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7881
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.195
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:37:56.299824 7881 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:37:56.300899 7881 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:37:56.310927 7888 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:37:56.310963 7886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:37:56.310961 7881 server_base.cc:1034] running on GCE node
W20260808 14:37:56.311203 7891 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:37:56.311601 7881 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:37:56.312247 7881 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:37:56.313446 7881 hybrid_clock.cc:648] HybridClock initialized: now 1786199876313423 us; error 53 us; skew 500 ppm
Aug 08 14:37:56 dist-test-slave-twwt krb5kdc[7309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199876, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:37:56.320748 7881 init.cc:377] Logged in from keytab as kudu/127.11.131.195@KRBTEST.COM (short username kudu)
I20260808 14:37:56.321816 7881 webserver.cc:460] Webserver started at http://127.11.131.195:43363/ using document root <none> and password file <none>
I20260808 14:37:56.322430 7881 fs_manager.cc:359] Metadata directory not provided
I20260808 14:37:56.322533 7881 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:37:56.322811 7881 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:37:56.324947 7881 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/ts-2/data/instance:
uuid: "d95a751eb2a746ce911dc6a627d35937"
format_stamp: "Formatted at 2026-08-08 14:37:56 on dist-test-slave-twwt"
server_key: "e9086a567bc36eecf473c9147ee02a8c"
server_key_iv: "5fc4a0ba9a7b59463d9a8270188e76a8"
server_key_version: "encryptionkey@0"
I20260808 14:37:56.325541 7881 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/ts-2/wal/instance:
uuid: "d95a751eb2a746ce911dc6a627d35937"
format_stamp: "Formatted at 2026-08-08 14:37:56 on dist-test-slave-twwt"
server_key: "e9086a567bc36eecf473c9147ee02a8c"
server_key_iv: "5fc4a0ba9a7b59463d9a8270188e76a8"
server_key_version: "encryptionkey@0"
I20260808 14:37:56.329572 7881 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 14:37:56.332129 7905 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:56.333515 7881 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 14:37:56.333678 7881 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/ts-2/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/ts-2/wal
uuid: "d95a751eb2a746ce911dc6a627d35937"
format_stamp: "Formatted at 2026-08-08 14:37:56 on dist-test-slave-twwt"
server_key: "e9086a567bc36eecf473c9147ee02a8c"
server_key_iv: "5fc4a0ba9a7b59463d9a8270188e76a8"
server_key_version: "encryptionkey@0"
I20260808 14:37:56.333798 7881 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:37:56.354034 7881 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:37:56.357800 7881 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:37:56.358009 7881 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:37:56.358688 7881 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:37:56.359583 7881 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:37:56.359658 7881 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:56.359730 7881 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:37:56.359773 7881 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:56.369222 7881 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.195:33745
I20260808 14:37:56.369244 8078 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.195:33745 every 8 connection(s)
I20260808 14:37:56.370198 7881 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
I20260808 14:37:56.378100 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 7881
I20260808 14:37:56.378304 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/ts-2/wal/instance
I20260808 14:37:56.378670 11791 external_mini_cluster.cc:1428] Setting key c322407c51e944c6de59e33e54ca00a6
Aug 08 14:37:56 dist-test-slave-twwt krb5kdc[7309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199876, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.195@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:37:56.385577 7433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:56.372270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:53317 (local address 127.11.131.254:34899)
0808 14:37:56.372416 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:56.372420 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:56.373315 (+ 895us) server_negotiation.cc:407] Connection header received
0808 14:37:56.374777 (+ 1462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:56.374781 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:56.374843 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:56.374927 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:37:56.376192 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:56.376849 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:56.378207 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:56.378517 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:56.378668 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:56.381503 (+ 2835us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:37:56.381512 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:37:56.381514 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:37:56.381540 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:37:56.383369 (+ 1829us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:37:56.383944 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:37:56.383954 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:37:56.383956 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:37:56.384043 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:37:56.384415 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:37:56.384419 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:37:56.384421 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:37:56.384620 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:37:56.384733 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:56.385268 (+ 535us) server_negotiation.cc:299] Negotiation successful
0808 14:37:56.385411 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 14:37:56.386440 8087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:56.372658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:34899 (local address 127.11.131.195:53317)
0808 14:37:56.373145 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:56.373190 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 14:37:56.374503 (+ 1313us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:37:56.375107 (+ 604us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:37:56.375114 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:37:56.375475 (+ 361us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:37:56.376035 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:56.376050 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:56.376998 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:56.377001 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:56.378032 (+ 1031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:56.378045 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:56.378721 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:56.378726 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:56.378946 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:56.379627 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:37:56.379645 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:37:56.381333 (+ 1688us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:37:56.383502 (+ 2169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:37:56.383509 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:37:56.383527 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:37:56.383821 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:37:56.384143 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:37:56.384146 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:37:56.384148 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:37:56.384310 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:37:56.384733 (+ 423us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:37:56.384741 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:37:56.385024 (+ 283us) client_negotiation.cc:769] Sending connection context
0808 14:37:56.385225 (+ 201us) client_negotiation.cc:240] Negotiation successful
0808 14:37:56.385574 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":117,"threads_started":1}
I20260808 14:37:56.387761 8079 heartbeater.cc:347] Connected to a master server at 127.11.131.254:34899
I20260808 14:37:56.388018 8079 heartbeater.cc:464] Registering TS with master...
I20260808 14:37:56.388506 8079 heartbeater.cc:511] Master 127.11.131.254:34899 requested a full tablet report, sending...
I20260808 14:37:56.389575 7377 ts_manager.cc:194] Registered new tserver with Master: d95a751eb2a746ce911dc6a627d35937 (127.11.131.195:33745)
I20260808 14:37:56.390118 7377 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.195@KRBTEST.COM'} at 127.11.131.195:53317
I20260808 14:37:56.392980 11791 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:37:56.402645 7433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:56.395160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59686 (local address 127.11.131.254:34899)
0808 14:37:56.395309 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:56.395313 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:56.395507 (+ 194us) server_negotiation.cc:407] Connection header received
0808 14:37:56.395595 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:56.395598 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:56.395636 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:56.395703 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:37:56.396397 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:56.396923 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:56.397815 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:56.398082 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:56.398182 (+ 100us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:56.399734 (+ 1552us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:37:56.399737 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:37:56.399739 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:37:56.399762 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:37:56.401031 (+ 1269us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:37:56.401476 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:37:56.401479 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:37:56.401480 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:37:56.401552 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:37:56.401854 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:37:56.401856 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:37:56.401857 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:37:56.402057 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:37:56.402169 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:56.402361 (+ 192us) server_negotiation.cc:299] Negotiation successful
0808 14:37:56.402436 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 14:37:56.405757 7377 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59686:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:37:56.408954 7377 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:37:56.423771 8108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:56.418428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55346 (local address 127.11.131.193:41321)
0808 14:37:56.418846 (+ 418us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:56.418852 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:56.418873 (+ 21us) server_negotiation.cc:407] Connection header received
0808 14:37:56.418944 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:56.418948 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:56.419122 (+ 174us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:56.419511 (+ 389us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:37:56.419643 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:56.420807 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:56.422170 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:56.423027 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:56.423172 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:56.423335 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:56.423518 (+ 183us) server_negotiation.cc:299] Negotiation successful
0808 14:37:56.423615 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":97,"threads_started":1}
I20260808 14:37:56.423758 8104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:56.417939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:41321 (local address 127.0.0.1:55346)
0808 14:37:56.418228 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:56.418245 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:37:56.418335 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:37:56.419255 (+ 920us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:37:56.419258 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:37:56.419272 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:37:56.419359 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:56.419364 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:56.420955 (+ 1591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:56.420958 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:56.422017 (+ 1059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:56.422030 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:56.423162 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:56.423166 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:56.423299 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:56.423343 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 14:37:56.423479 (+ 136us) client_negotiation.cc:240] Negotiation successful
0808 14:37:56.423607 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":206,"mutex_wait_us":128,"thread_start_us":126,"threads_started":1}
I20260808 14:37:56.424163 8099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:56.417565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.195:33745 (local address 127.0.0.1:51542)
0808 14:37:56.418068 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:56.418122 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 14:37:56.418251 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:37:56.419143 (+ 892us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:37:56.419149 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:37:56.419177 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:37:56.419342 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:56.419350 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:56.420927 (+ 1577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:56.420930 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:56.422427 (+ 1497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:56.422439 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:56.423640 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:56.423644 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:56.423853 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:56.423892 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 14:37:56.423969 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 14:37:56.424036 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":320,"mutex_wait_us":132,"thread_start_us":82,"threads_started":1}
I20260808 14:37:56.424515 8106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:56.418322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.194:42893 (local address 127.0.0.1:54620)
0808 14:37:56.418536 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:56.418551 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:37:56.418663 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:37:56.419593 (+ 930us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:37:56.419596 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:37:56.419614 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:37:56.419720 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:56.419729 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:56.420883 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:56.420889 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:56.422428 (+ 1539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:56.422439 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:56.423640 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:56.423644 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:56.424197 (+ 553us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:56.424227 (+ 30us) client_negotiation.cc:769] Sending connection context
0808 14:37:56.424311 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 14:37:56.424396 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"mutex_wait_us":195,"thread_start_us":87,"threads_started":1}
I20260808 14:37:56.424899 8102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:56.417759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51542 (local address 127.11.131.195:33745)
0808 14:37:56.418578 (+ 819us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:56.418598 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:56.418641 (+ 43us) server_negotiation.cc:407] Connection header received
0808 14:37:56.418733 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:56.418740 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:56.418962 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:56.419511 (+ 549us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:37:56.419643 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:56.420807 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:56.422581 (+ 1774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:56.423490 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:56.424436 (+ 946us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:56.424589 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:56.424646 (+ 57us) server_negotiation.cc:299] Negotiation successful
0808 14:37:56.424752 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":698,"thread_start_us":118,"threads_started":1}
I20260808 14:37:56.425217 8109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:56.418796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54620 (local address 127.11.131.194:42893)
0808 14:37:56.419106 (+ 310us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:56.419118 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:56.419142 (+ 24us) server_negotiation.cc:407] Connection header received
0808 14:37:56.419222 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:56.419228 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:56.419429 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:56.419895 (+ 466us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:37:56.420044 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:56.420733 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:56.422582 (+ 1849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:56.423490 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:56.424776 (+ 1286us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:56.424917 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:56.424971 (+ 54us) server_negotiation.cc:299] Negotiation successful
0808 14:37:56.425073 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":209,"thread_start_us":128,"threads_started":1}
I20260808 14:37:56.427201 7562 tablet_service.cc:1467] Processing CreateTablet for tablet 8aec4e8fc2cc44edbcdfb6034f0e7fbe (DEFAULT_TABLE table=test-table [id=9455fb250b024a66bc99f3b62bc88603]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:37:56.427801 7983 tablet_service.cc:1467] Processing CreateTablet for tablet 8aec4e8fc2cc44edbcdfb6034f0e7fbe (DEFAULT_TABLE table=test-table [id=9455fb250b024a66bc99f3b62bc88603]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:37:56.427790 7768 tablet_service.cc:1467] Processing CreateTablet for tablet 8aec4e8fc2cc44edbcdfb6034f0e7fbe (DEFAULT_TABLE table=test-table [id=9455fb250b024a66bc99f3b62bc88603]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:37:56.428375 7562 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8aec4e8fc2cc44edbcdfb6034f0e7fbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:37:56.428854 7768 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8aec4e8fc2cc44edbcdfb6034f0e7fbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:37:56.428854 7983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8aec4e8fc2cc44edbcdfb6034f0e7fbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:37:56.435334 8114 tablet_bootstrap.cc:492] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P e6901a1d3eac486498e89de0a1f684f8: Bootstrap starting.
I20260808 14:37:56.436817 8118 tablet_bootstrap.cc:492] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P d95a751eb2a746ce911dc6a627d35937: Bootstrap starting.
I20260808 14:37:56.436817 8115 tablet_bootstrap.cc:492] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P b36a68cef9d340cdbb6e65f8e4c591b3: Bootstrap starting.
I20260808 14:37:56.437719 8114 tablet_bootstrap.cc:654] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P e6901a1d3eac486498e89de0a1f684f8: Neither blocks nor log segments found. Creating new log.
I20260808 14:37:56.438472 8114 log.cc:824] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P e6901a1d3eac486498e89de0a1f684f8: Log is configured to *not* fsync() on all Append() calls
I20260808 14:37:56.439095 8118 tablet_bootstrap.cc:654] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P d95a751eb2a746ce911dc6a627d35937: Neither blocks nor log segments found. Creating new log.
I20260808 14:37:56.439095 8115 tablet_bootstrap.cc:654] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P b36a68cef9d340cdbb6e65f8e4c591b3: Neither blocks nor log segments found. Creating new log.
I20260808 14:37:56.440446 8118 log.cc:824] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P d95a751eb2a746ce911dc6a627d35937: Log is configured to *not* fsync() on all Append() calls
I20260808 14:37:56.440659 8114 tablet_bootstrap.cc:492] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P e6901a1d3eac486498e89de0a1f684f8: No bootstrap required, opened a new log
I20260808 14:37:56.440733 8115 log.cc:824] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P b36a68cef9d340cdbb6e65f8e4c591b3: Log is configured to *not* fsync() on all Append() calls
I20260808 14:37:56.440984 8114 ts_tablet_manager.cc:1397] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P e6901a1d3eac486498e89de0a1f684f8: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 14:37:56.442286 8118 tablet_bootstrap.cc:492] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P d95a751eb2a746ce911dc6a627d35937: No bootstrap required, opened a new log
I20260808 14:37:56.442492 8118 ts_tablet_manager.cc:1397] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P d95a751eb2a746ce911dc6a627d35937: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 14:37:56.442756 8115 tablet_bootstrap.cc:492] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P b36a68cef9d340cdbb6e65f8e4c591b3: No bootstrap required, opened a new log
I20260808 14:37:56.442981 8115 ts_tablet_manager.cc:1397] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P b36a68cef9d340cdbb6e65f8e4c591b3: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 14:37:56.445389 8118 raft_consensus.cc:348] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P d95a751eb2a746ce911dc6a627d35937 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d95a751eb2a746ce911dc6a627d35937" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 33745 } } peers { permanent_uuid: "b36a68cef9d340cdbb6e65f8e4c591b3" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 42893 } } peers { permanent_uuid: "e6901a1d3eac486498e89de0a1f684f8" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 41321 } }
I20260808 14:37:56.445637 8118 raft_consensus.cc:374] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P d95a751eb2a746ce911dc6a627d35937 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:37:56.445698 8118 raft_consensus.cc:729] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P d95a751eb2a746ce911dc6a627d35937 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d95a751eb2a746ce911dc6a627d35937, State: Initialized, Role: FOLLOWER
I20260808 14:37:56.445647 8114 raft_consensus.cc:348] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P e6901a1d3eac486498e89de0a1f684f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d95a751eb2a746ce911dc6a627d35937" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 33745 } } peers { permanent_uuid: "b36a68cef9d340cdbb6e65f8e4c591b3" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 42893 } } peers { permanent_uuid: "e6901a1d3eac486498e89de0a1f684f8" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 41321 } }
I20260808 14:37:56.445935 8114 raft_consensus.cc:374] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P e6901a1d3eac486498e89de0a1f684f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:37:56.445996 8114 raft_consensus.cc:729] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P e6901a1d3eac486498e89de0a1f684f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6901a1d3eac486498e89de0a1f684f8, State: Initialized, Role: FOLLOWER
I20260808 14:37:56.446252 8118 consensus_queue.cc:260] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P d95a751eb2a746ce911dc6a627d35937 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d95a751eb2a746ce911dc6a627d35937" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 33745 } } peers { permanent_uuid: "b36a68cef9d340cdbb6e65f8e4c591b3" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 42893 } } peers { permanent_uuid: "e6901a1d3eac486498e89de0a1f684f8" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 41321 } }
I20260808 14:37:56.446436 8114 consensus_queue.cc:260] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P e6901a1d3eac486498e89de0a1f684f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d95a751eb2a746ce911dc6a627d35937" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 33745 } } peers { permanent_uuid: "b36a68cef9d340cdbb6e65f8e4c591b3" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 42893 } } peers { permanent_uuid: "e6901a1d3eac486498e89de0a1f684f8" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 41321 } }
I20260808 14:37:56.447399 8118 ts_tablet_manager.cc:1428] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P d95a751eb2a746ce911dc6a627d35937: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260808 14:37:56.447470 8114 ts_tablet_manager.cc:1428] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P e6901a1d3eac486498e89de0a1f684f8: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 14:37:56.447808 7661 heartbeater.cc:503] Master 127.11.131.254:34899 was elected leader, sending a full tablet report...
I20260808 14:37:56.447769 8079 heartbeater.cc:503] Master 127.11.131.254:34899 was elected leader, sending a full tablet report...
I20260808 14:37:56.447928 8115 raft_consensus.cc:348] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P b36a68cef9d340cdbb6e65f8e4c591b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d95a751eb2a746ce911dc6a627d35937" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 33745 } } peers { permanent_uuid: "b36a68cef9d340cdbb6e65f8e4c591b3" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 42893 } } peers { permanent_uuid: "e6901a1d3eac486498e89de0a1f684f8" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 41321 } }
I20260808 14:37:56.448166 8115 raft_consensus.cc:374] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P b36a68cef9d340cdbb6e65f8e4c591b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:37:56.448215 8115 raft_consensus.cc:729] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P b36a68cef9d340cdbb6e65f8e4c591b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b36a68cef9d340cdbb6e65f8e4c591b3, State: Initialized, Role: FOLLOWER
I20260808 14:37:56.448613 8115 consensus_queue.cc:260] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P b36a68cef9d340cdbb6e65f8e4c591b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d95a751eb2a746ce911dc6a627d35937" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 33745 } } peers { permanent_uuid: "b36a68cef9d340cdbb6e65f8e4c591b3" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 42893 } } peers { permanent_uuid: "e6901a1d3eac486498e89de0a1f684f8" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 41321 } }
I20260808 14:37:56.449571 8115 ts_tablet_manager.cc:1428] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P b36a68cef9d340cdbb6e65f8e4c591b3: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260808 14:37:56.450244 7876 heartbeater.cc:503] Master 127.11.131.254:34899 was elected leader, sending a full tablet report...
I20260808 14:37:56.598179 8124 raft_consensus.cc:482] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P e6901a1d3eac486498e89de0a1f684f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:37:56.598424 8124 raft_consensus.cc:504] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P e6901a1d3eac486498e89de0a1f684f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d95a751eb2a746ce911dc6a627d35937" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 33745 } } peers { permanent_uuid: "b36a68cef9d340cdbb6e65f8e4c591b3" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 42893 } } peers { permanent_uuid: "e6901a1d3eac486498e89de0a1f684f8" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 41321 } }
I20260808 14:37:56.599732 8124 leader_election.cc:288] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P e6901a1d3eac486498e89de0a1f684f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d95a751eb2a746ce911dc6a627d35937 (127.11.131.195:33745), b36a68cef9d340cdbb6e65f8e4c591b3 (127.11.131.194:42893)
I20260808 14:37:56.602766 8126 raft_consensus.cc:482] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P b36a68cef9d340cdbb6e65f8e4c591b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:37:56.602973 8126 raft_consensus.cc:504] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P b36a68cef9d340cdbb6e65f8e4c591b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d95a751eb2a746ce911dc6a627d35937" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 33745 } } peers { permanent_uuid: "b36a68cef9d340cdbb6e65f8e4c591b3" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 42893 } } peers { permanent_uuid: "e6901a1d3eac486498e89de0a1f684f8" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 41321 } }
I20260808 14:37:56.604439 8126 leader_election.cc:288] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P b36a68cef9d340cdbb6e65f8e4c591b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d95a751eb2a746ce911dc6a627d35937 (127.11.131.195:33745), e6901a1d3eac486498e89de0a1f684f8 (127.11.131.193:41321)
I20260808 14:37:56.604687 8102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:56.600109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:51619 (local address 127.11.131.195:33745)
0808 14:37:56.600251 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:56.600256 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:56.600415 (+ 159us) server_negotiation.cc:407] Connection header received
0808 14:37:56.600612 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:56.600617 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:56.600679 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:56.600743 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:37:56.601254 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:56.601907 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:56.603498 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:56.604028 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:56.604166 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:56.604225 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:56.604452 (+ 227us) server_negotiation.cc:299] Negotiation successful
0808 14:37:56.604547 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 14:37:56.605073 8109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:56.600615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:42197 (local address 127.11.131.194:42893)
0808 14:37:56.600741 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:56.600745 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:56.600993 (+ 248us) server_negotiation.cc:407] Connection header received
0808 14:37:56.601154 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:56.601157 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:56.601233 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:56.601313 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:37:56.601614 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:56.602182 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:56.603733 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:56.604301 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:56.604421 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:56.604483 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:56.604862 (+ 379us) server_negotiation.cc:299] Negotiation successful
0808 14:37:56.604959 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 14:37:56.605144 8127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:56.599980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.195:33745 (local address 127.11.131.193:51619)
0808 14:37:56.600312 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:56.600329 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:37:56.600453 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:37:56.600908 (+ 455us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:37:56.600910 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:37:56.600928 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:37:56.601131 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:56.601139 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:56.602019 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:56.602022 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:56.603361 (+ 1339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:56.603372 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:56.604167 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:56.604171 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:56.604270 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:56.604293 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 14:37:56.604855 (+ 562us) client_negotiation.cc:240] Negotiation successful
0808 14:37:56.604942 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"mutex_wait_us":33,"thread_start_us":145,"threads_started":1}
I20260808 14:37:56.605469 8128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:56.600450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.194:42893 (local address 127.11.131.193:42197)
0808 14:37:56.600858 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:56.600872 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:37:56.601030 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:37:56.601350 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:37:56.601353 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:37:56.601373 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:37:56.601495 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:56.601501 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:56.602296 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:56.602299 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:56.603585 (+ 1286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:56.603599 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:56.604553 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:56.604559 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:56.604698 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:56.604722 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 14:37:56.605196 (+ 474us) client_negotiation.cc:240] Negotiation successful
0808 14:37:56.605293 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":331,"mutex_wait_us":118,"spinlock_wait_cycles":896,"thread_start_us":124,"threads_started":1}
I20260808 14:37:56.605877 8013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8aec4e8fc2cc44edbcdfb6034f0e7fbe" candidate_uuid: "e6901a1d3eac486498e89de0a1f684f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d95a751eb2a746ce911dc6a627d35937" is_pre_election: true
I20260808 14:37:56.606199 8013 raft_consensus.cc:2454] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P d95a751eb2a746ce911dc6a627d35937 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6901a1d3eac486498e89de0a1f684f8 in term 0.
I20260808 14:37:56.606207 7800 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8aec4e8fc2cc44edbcdfb6034f0e7fbe" candidate_uuid: "e6901a1d3eac486498e89de0a1f684f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b36a68cef9d340cdbb6e65f8e4c591b3" is_pre_election: true
I20260808 14:37:56.606403 7800 raft_consensus.cc:2454] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P b36a68cef9d340cdbb6e65f8e4c591b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6901a1d3eac486498e89de0a1f684f8 in term 0.
I20260808 14:37:56.606889 7494 leader_election.cc:302] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P e6901a1d3eac486498e89de0a1f684f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b36a68cef9d340cdbb6e65f8e4c591b3, e6901a1d3eac486498e89de0a1f684f8; no voters:
I20260808 14:37:56.607281 8124 raft_consensus.cc:2781] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P e6901a1d3eac486498e89de0a1f684f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:37:56.607366 8124 raft_consensus.cc:482] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P e6901a1d3eac486498e89de0a1f684f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:37:56.607410 8124 raft_consensus.cc:3037] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P e6901a1d3eac486498e89de0a1f684f8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:37:56.608795 8124 raft_consensus.cc:504] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P e6901a1d3eac486498e89de0a1f684f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d95a751eb2a746ce911dc6a627d35937" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 33745 } } peers { permanent_uuid: "b36a68cef9d340cdbb6e65f8e4c591b3" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 42893 } } peers { permanent_uuid: "e6901a1d3eac486498e89de0a1f684f8" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 41321 } }
I20260808 14:37:56.609157 8124 leader_election.cc:288] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P e6901a1d3eac486498e89de0a1f684f8 [CANDIDATE]: Term 1 election: Requested vote from peers d95a751eb2a746ce911dc6a627d35937 (127.11.131.195:33745), b36a68cef9d340cdbb6e65f8e4c591b3 (127.11.131.194:42893)
I20260808 14:37:56.609205 7878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:56.604587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.195:33745 (local address 127.11.131.194:43349)
0808 14:37:56.604727 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:56.604743 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:37:56.604827 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:37:56.605930 (+ 1103us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:37:56.605933 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:37:56.605953 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:37:56.606059 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:56.606065 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:56.607000 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:56.607003 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:56.607961 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:56.607970 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:56.608763 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:56.608766 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:56.608890 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:56.608934 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 14:37:56.609007 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 14:37:56.609078 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":64}
I20260808 14:37:56.609510 8013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8aec4e8fc2cc44edbcdfb6034f0e7fbe" candidate_uuid: "e6901a1d3eac486498e89de0a1f684f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d95a751eb2a746ce911dc6a627d35937"
I20260808 14:37:56.609622 7800 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8aec4e8fc2cc44edbcdfb6034f0e7fbe" candidate_uuid: "e6901a1d3eac486498e89de0a1f684f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b36a68cef9d340cdbb6e65f8e4c591b3"
I20260808 14:37:56.609654 8013 raft_consensus.cc:3037] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P d95a751eb2a746ce911dc6a627d35937 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:37:56.609709 8102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:56.605282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:43349 (local address 127.11.131.195:33745)
0808 14:37:56.605471 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:56.605476 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:56.605489 (+ 13us) server_negotiation.cc:407] Connection header received
0808 14:37:56.605527 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:56.605530 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:56.605572 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:56.605649 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:37:56.606223 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:56.606873 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:56.608085 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:56.608638 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:56.608768 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:56.608816 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:56.609437 (+ 621us) server_negotiation.cc:299] Negotiation successful
0808 14:37:56.609504 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118}
I20260808 14:37:56.609732 7800 raft_consensus.cc:3037] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P b36a68cef9d340cdbb6e65f8e4c591b3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:37:56.610013 8011 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8aec4e8fc2cc44edbcdfb6034f0e7fbe" candidate_uuid: "b36a68cef9d340cdbb6e65f8e4c591b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d95a751eb2a746ce911dc6a627d35937" is_pre_election: true
I20260808 14:37:56.610968 8108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:56.606670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:44561 (local address 127.11.131.193:41321)
0808 14:37:56.606828 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:56.606832 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:56.606844 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:37:56.606882 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:56.606887 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:56.606931 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:56.607004 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:37:56.607512 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:56.608167 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:56.609664 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:56.610215 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:56.610302 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:56.610359 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:56.610784 (+ 425us) server_negotiation.cc:299] Negotiation successful
0808 14:37:56.610858 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 14:37:56.611039 8013 raft_consensus.cc:2454] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P d95a751eb2a746ce911dc6a627d35937 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6901a1d3eac486498e89de0a1f684f8 in term 1.
I20260808 14:37:56.611039 7800 raft_consensus.cc:2454] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P b36a68cef9d340cdbb6e65f8e4c591b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6901a1d3eac486498e89de0a1f684f8 in term 1.
I20260808 14:37:56.611307 7494 leader_election.cc:302] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P e6901a1d3eac486498e89de0a1f684f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d95a751eb2a746ce911dc6a627d35937, e6901a1d3eac486498e89de0a1f684f8; no voters:
I20260808 14:37:56.611362 8129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:56.604912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:41321 (local address 127.11.131.194:44561)
0808 14:37:56.605213 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:56.605226 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:37:56.605328 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:37:56.607218 (+ 1890us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:37:56.607221 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:37:56.607241 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:37:56.607362 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:56.607370 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:56.608307 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:56.608310 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:56.609517 (+ 1207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:56.609529 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:56.610466 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:56.610472 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:56.610576 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:56.610656 (+ 80us) client_negotiation.cc:769] Sending connection context
0808 14:37:56.611120 (+ 464us) client_negotiation.cc:240] Negotiation successful
0808 14:37:56.611205 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":92,"threads_started":1}
I20260808 14:37:56.611697 8124 raft_consensus.cc:2781] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P e6901a1d3eac486498e89de0a1f684f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:37:56.611969 8124 raft_consensus.cc:686] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P e6901a1d3eac486498e89de0a1f684f8 [term 1 LEADER]: Becoming Leader. State: Replica: e6901a1d3eac486498e89de0a1f684f8, State: Running, Role: LEADER
I20260808 14:37:56.611944 7590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8aec4e8fc2cc44edbcdfb6034f0e7fbe" candidate_uuid: "b36a68cef9d340cdbb6e65f8e4c591b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6901a1d3eac486498e89de0a1f684f8" is_pre_election: true
I20260808 14:37:56.612329 8124 consensus_queue.cc:237] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P e6901a1d3eac486498e89de0a1f684f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d95a751eb2a746ce911dc6a627d35937" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 33745 } } peers { permanent_uuid: "b36a68cef9d340cdbb6e65f8e4c591b3" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 42893 } } peers { permanent_uuid: "e6901a1d3eac486498e89de0a1f684f8" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 41321 } }
I20260808 14:37:56.612555 7694 leader_election.cc:302] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P b36a68cef9d340cdbb6e65f8e4c591b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b36a68cef9d340cdbb6e65f8e4c591b3; no voters: d95a751eb2a746ce911dc6a627d35937, e6901a1d3eac486498e89de0a1f684f8
I20260808 14:37:56.612857 8126 raft_consensus.cc:2726] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P b36a68cef9d340cdbb6e65f8e4c591b3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260808 14:37:56.615715 7377 catalog_manager.cc:5495] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P e6901a1d3eac486498e89de0a1f684f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to e6901a1d3eac486498e89de0a1f684f8 (127.11.131.193). New cstate: current_term: 1 leader_uuid: "e6901a1d3eac486498e89de0a1f684f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d95a751eb2a746ce911dc6a627d35937" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 33745 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b36a68cef9d340cdbb6e65f8e4c591b3" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 42893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6901a1d3eac486498e89de0a1f684f8" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 41321 } health_report { overall_health: HEALTHY } } }
W20260808 14:37:56.621201 8083 tablet.cc:2369] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P d95a751eb2a746ce911dc6a627d35937: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:37:56.626823 7877 tablet.cc:2369] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P b36a68cef9d340cdbb6e65f8e4c591b3: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:37:56.636520 7662 tablet.cc:2369] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P e6901a1d3eac486498e89de0a1f684f8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:37:56.663045 8108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:56.659557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55352 (local address 127.11.131.193:41321)
0808 14:37:56.659693 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:56.659696 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:56.659710 (+ 14us) server_negotiation.cc:407] Connection header received
0808 14:37:56.659870 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:56.659872 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:56.659934 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:56.660027 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:37:56.660252 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:56.660751 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:56.661590 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:56.661822 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:56.661898 (+ 76us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:56.662202 (+ 304us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:37:56.662678 (+ 476us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:37:56.662833 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:56.662896 (+ 63us) server_negotiation.cc:299] Negotiation successful
0808 14:37:56.662930 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 14:37:56.669150 8013 raft_consensus.cc:1261] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P d95a751eb2a746ce911dc6a627d35937 [term 1 FOLLOWER]: Refusing update from remote peer e6901a1d3eac486498e89de0a1f684f8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:37:56.669157 7800 raft_consensus.cc:1261] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P b36a68cef9d340cdbb6e65f8e4c591b3 [term 1 FOLLOWER]: Refusing update from remote peer e6901a1d3eac486498e89de0a1f684f8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:37:56.669859 8130 consensus_queue.cc:1035] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P e6901a1d3eac486498e89de0a1f684f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d95a751eb2a746ce911dc6a627d35937" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 33745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:37:56.670050 8124 consensus_queue.cc:1035] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P e6901a1d3eac486498e89de0a1f684f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b36a68cef9d340cdbb6e65f8e4c591b3" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 42893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:37:56.677197 8138 mvcc.cc:205] Tried to move back new op lower bound from 7316274694829322240 to 7316274694607224832. Current Snapshot: MvccSnapshot[applied={T|T < 7316274694829322240}]
I20260808 14:37:56.678783 8137 mvcc.cc:205] Tried to move back new op lower bound from 7316274694829322240 to 7316274694607224832. Current Snapshot: MvccSnapshot[applied={T|T < 7316274694829322240}]
I20260808 14:37:56.685740 7375 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59686:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:37:56.685920 7375 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59686:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:37:56.688427 7375 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7cc948bbfb66439c950cb50e2b998d40: Sending DeleteTablet for 3 replicas of tablet 8aec4e8fc2cc44edbcdfb6034f0e7fbe
I20260808 14:37:56.689193 7562 tablet_service.cc:1514] Processing DeleteTablet for tablet 8aec4e8fc2cc44edbcdfb6034f0e7fbe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:37:56 UTC) from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:55346
I20260808 14:37:56.689237 7768 tablet_service.cc:1514] Processing DeleteTablet for tablet 8aec4e8fc2cc44edbcdfb6034f0e7fbe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:37:56 UTC) from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:54620
I20260808 14:37:56.689247 7983 tablet_service.cc:1514] Processing DeleteTablet for tablet 8aec4e8fc2cc44edbcdfb6034f0e7fbe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:37:56 UTC) from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:51542
I20260808 14:37:56.689702 8151 tablet_replica.cc:330] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P e6901a1d3eac486498e89de0a1f684f8: stopping tablet replica
I20260808 14:37:56.689831 8152 tablet_replica.cc:330] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P d95a751eb2a746ce911dc6a627d35937: stopping tablet replica
I20260808 14:37:56.690037 8151 raft_consensus.cc:2229] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P e6901a1d3eac486498e89de0a1f684f8 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:37:56.690248 8152 raft_consensus.cc:2229] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P d95a751eb2a746ce911dc6a627d35937 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:37:56.690433 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 7463
I20260808 14:37:56.690455 8151 raft_consensus.cc:2258] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P e6901a1d3eac486498e89de0a1f684f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:37:56.690702 8152 raft_consensus.cc:2258] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P d95a751eb2a746ce911dc6a627d35937 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:37:56.694207 8152 ts_tablet_manager.cc:1905] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P d95a751eb2a746ce911dc6a627d35937: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:37:56.697257 8152 ts_tablet_manager.cc:1918] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P d95a751eb2a746ce911dc6a627d35937: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:37:56.697387 8152 log.cc:1196] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P d95a751eb2a746ce911dc6a627d35937: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/ts-2/wal/wals/8aec4e8fc2cc44edbcdfb6034f0e7fbe
I20260808 14:37:56.697628 8148 tablet_replica.cc:330] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P b36a68cef9d340cdbb6e65f8e4c591b3: stopping tablet replica
I20260808 14:37:56.697751 8152 ts_tablet_manager.cc:1939] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P d95a751eb2a746ce911dc6a627d35937: Deleting consensus metadata
I20260808 14:37:56.697995 8148 raft_consensus.cc:2229] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P b36a68cef9d340cdbb6e65f8e4c591b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:37:56.698340 8148 raft_consensus.cc:2258] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P b36a68cef9d340cdbb6e65f8e4c591b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:37:56.699095 7357 catalog_manager.cc:4841] TS d95a751eb2a746ce911dc6a627d35937 (127.11.131.195:33745): tablet 8aec4e8fc2cc44edbcdfb6034f0e7fbe (table test-table [id=9455fb250b024a66bc99f3b62bc88603]) successfully deleted
I20260808 14:37:56.699925 8148 ts_tablet_manager.cc:1905] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P b36a68cef9d340cdbb6e65f8e4c591b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:37:56.704022 8148 ts_tablet_manager.cc:1918] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P b36a68cef9d340cdbb6e65f8e4c591b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:37:56.704140 8148 log.cc:1196] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P b36a68cef9d340cdbb6e65f8e4c591b3: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786199615258783-11791-0/minicluster-data/ts-1/wal/wals/8aec4e8fc2cc44edbcdfb6034f0e7fbe
I20260808 14:37:56.704521 8148 ts_tablet_manager.cc:1939] T 8aec4e8fc2cc44edbcdfb6034f0e7fbe P b36a68cef9d340cdbb6e65f8e4c591b3: Deleting consensus metadata
W20260808 14:37:56.705276 7353 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.131.193:41321 (error 108)
I20260808 14:37:56.705420 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 7666
I20260808 14:37:56.712731 8106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:56.712335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:41321 (local address 127.0.0.1:55366)
0808 14:37:56.712537 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:56.712609 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.193:41321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107}
W20260808 14:37:56.712916 7353 catalog_manager.cc:4584] TS e6901a1d3eac486498e89de0a1f684f8 (127.11.131.193:41321): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8aec4e8fc2cc44edbcdfb6034f0e7fbe: Network error: Client connection negotiation failed: client connection to 127.11.131.193:41321: connect: Connection refused (error 111)
I20260808 14:37:56.726608 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 7881
I20260808 14:37:56.727129 8106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:56.726775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.194:42893 (local address 127.0.0.1:54630)
0808 14:37:56.726948 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:56.727019 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.194:42893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260808 14:37:56.739316 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 7330
2026-08-08T14:37:56Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2736 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-08T14:37:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:37:56Z Disabled control of system clock
I20260808 14:37:56.780063 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:42351
--webserver_interface=127.11.131.254
--webserver_port=0
--builtin_ntp_servers=127.11.131.212:39141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:42351
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 14:37:56.897555 8160 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:37:56.897845 8160 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:37:56.897883 8160 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:37:56.901989 8160 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:37:56.902058 8160 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:37:56.902074 8160 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:37:56.902092 8160 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:37:56.902107 8160 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:37:56.906889 8160 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:39141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:42351
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:42351
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.131.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8160
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:37:56.908006 8160 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:37:56.909464 8160 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:37:56.919023 8172 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:37:56.919000 8174 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:37:56.919008 8170 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:37:56.919412 8160 server_base.cc:1034] running on GCE node
I20260808 14:37:56.920059 8160 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:37:56.921252 8160 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:37:56.922458 8160 hybrid_clock.cc:648] HybridClock initialized: now 1786199876922427 us; error 48 us; skew 500 ppm
I20260808 14:37:56.929212 8160 webserver.cc:460] Webserver started at http://127.11.131.254:35199/ using document root <none> and password file <none>
I20260808 14:37:56.929894 8160 fs_manager.cc:359] Metadata directory not provided
I20260808 14:37:56.929996 8160 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:37:56.930250 8160 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:37:56.932576 8160 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/master-0/data/instance:
uuid: "838b214b2d134725a2651eb1920fe3e4"
format_stamp: "Formatted at 2026-08-08 14:37:56 on dist-test-slave-twwt"
server_key: "99a37759d05e29495e321c85435325d9"
server_key_iv: "76551267dc34ccdfe71d4c3d658bee1a"
server_key_version: "encryptionkey@0"
I20260808 14:37:56.933211 8160 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/master-0/wal/instance:
uuid: "838b214b2d134725a2651eb1920fe3e4"
format_stamp: "Formatted at 2026-08-08 14:37:56 on dist-test-slave-twwt"
server_key: "99a37759d05e29495e321c85435325d9"
server_key_iv: "76551267dc34ccdfe71d4c3d658bee1a"
server_key_version: "encryptionkey@0"
I20260808 14:37:56.937165 8160 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260808 14:37:56.939854 8184 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:56.941190 8160 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 14:37:56.941339 8160 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "838b214b2d134725a2651eb1920fe3e4"
format_stamp: "Formatted at 2026-08-08 14:37:56 on dist-test-slave-twwt"
server_key: "99a37759d05e29495e321c85435325d9"
server_key_iv: "76551267dc34ccdfe71d4c3d658bee1a"
server_key_version: "encryptionkey@0"
I20260808 14:37:56.941457 8160 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:37:56.970448 8160 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:37:56.971290 8160 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:37:56.971520 8160 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:37:56.979350 8160 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.254:42351
I20260808 14:37:56.979394 8258 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.254:42351 every 8 connection(s)
I20260808 14:37:56.980365 8160 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:37:56.983877 8259 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:37:56.987196 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 8160
I20260808 14:37:56.987368 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/master-0/wal/instance
I20260808 14:37:56.987680 11791 external_mini_cluster.cc:1428] Setting key b3895d73fa740363741836af69790ff3
I20260808 14:37:56.990598 8259 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 838b214b2d134725a2651eb1920fe3e4: Bootstrap starting.
I20260808 14:37:56.992942 8259 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 838b214b2d134725a2651eb1920fe3e4: Neither blocks nor log segments found. Creating new log.
I20260808 14:37:56.993743 8259 log.cc:824] T 00000000000000000000000000000000 P 838b214b2d134725a2651eb1920fe3e4: Log is configured to *not* fsync() on all Append() calls
I20260808 14:37:56.995898 8259 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 838b214b2d134725a2651eb1920fe3e4: No bootstrap required, opened a new log
I20260808 14:37:56.997709 8265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:56.989475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48302 (local address 127.11.131.254:42351)
0808 14:37:56.990197 (+ 722us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:56.990213 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:56.990252 (+ 39us) server_negotiation.cc:407] Connection header received
0808 14:37:56.991041 (+ 789us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:56.991062 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:56.991474 (+ 412us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:56.991858 (+ 384us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:37:56.992310 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:56.993368 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:56.994305 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:56.994853 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:56.995027 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:56.995917 (+ 890us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:37:56.995922 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:37:56.995936 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:37:56.996388 (+ 452us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:37:56.996448 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:37:56.996469 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:37:56.996579 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:56.996737 (+ 158us) server_negotiation.cc:299] Negotiation successful
0808 14:37:56.997006 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":152,"threads_started":1}
I20260808 14:37:57.000056 8259 raft_consensus.cc:348] T 00000000000000000000000000000000 P 838b214b2d134725a2651eb1920fe3e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "838b214b2d134725a2651eb1920fe3e4" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 42351 } }
I20260808 14:37:57.000340 8259 raft_consensus.cc:374] T 00000000000000000000000000000000 P 838b214b2d134725a2651eb1920fe3e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:37:57.000434 8259 raft_consensus.cc:729] T 00000000000000000000000000000000 P 838b214b2d134725a2651eb1920fe3e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 838b214b2d134725a2651eb1920fe3e4, State: Initialized, Role: FOLLOWER
I20260808 14:37:57.000924 8259 consensus_queue.cc:260] T 00000000000000000000000000000000 P 838b214b2d134725a2651eb1920fe3e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "838b214b2d134725a2651eb1920fe3e4" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 42351 } }
I20260808 14:37:57.001082 8259 raft_consensus.cc:388] T 00000000000000000000000000000000 P 838b214b2d134725a2651eb1920fe3e4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:37:57.001166 8259 raft_consensus.cc:482] T 00000000000000000000000000000000 P 838b214b2d134725a2651eb1920fe3e4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:37:57.001267 8259 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 838b214b2d134725a2651eb1920fe3e4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:37:57.002228 8259 raft_consensus.cc:504] T 00000000000000000000000000000000 P 838b214b2d134725a2651eb1920fe3e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "838b214b2d134725a2651eb1920fe3e4" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 42351 } }
I20260808 14:37:57.002588 8259 leader_election.cc:302] T 00000000000000000000000000000000 P 838b214b2d134725a2651eb1920fe3e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 838b214b2d134725a2651eb1920fe3e4; no voters:
I20260808 14:37:57.002981 8259 leader_election.cc:288] T 00000000000000000000000000000000 P 838b214b2d134725a2651eb1920fe3e4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:37:57.003154 8267 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 838b214b2d134725a2651eb1920fe3e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:37:57.003723 8267 raft_consensus.cc:686] T 00000000000000000000000000000000 P 838b214b2d134725a2651eb1920fe3e4 [term 1 LEADER]: Becoming Leader. State: Replica: 838b214b2d134725a2651eb1920fe3e4, State: Running, Role: LEADER
I20260808 14:37:57.004052 8267 consensus_queue.cc:237] T 00000000000000000000000000000000 P 838b214b2d134725a2651eb1920fe3e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "838b214b2d134725a2651eb1920fe3e4" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 42351 } }
I20260808 14:37:57.004410 8259 sys_catalog.cc:564] T 00000000000000000000000000000000 P 838b214b2d134725a2651eb1920fe3e4 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:37:57.005614 8272 sys_catalog.cc:455] T 00000000000000000000000000000000 P 838b214b2d134725a2651eb1920fe3e4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 838b214b2d134725a2651eb1920fe3e4. Latest consensus state: current_term: 1 leader_uuid: "838b214b2d134725a2651eb1920fe3e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "838b214b2d134725a2651eb1920fe3e4" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 42351 } } }
I20260808 14:37:57.005746 8272 sys_catalog.cc:458] T 00000000000000000000000000000000 P 838b214b2d134725a2651eb1920fe3e4 [sys.catalog]: This master's current role is: LEADER
I20260808 14:37:57.006150 8268 sys_catalog.cc:455] T 00000000000000000000000000000000 P 838b214b2d134725a2651eb1920fe3e4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "838b214b2d134725a2651eb1920fe3e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "838b214b2d134725a2651eb1920fe3e4" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 42351 } } }
I20260808 14:37:57.006244 8268 sys_catalog.cc:458] T 00000000000000000000000000000000 P 838b214b2d134725a2651eb1920fe3e4 [sys.catalog]: This master's current role is: LEADER
I20260808 14:37:57.006800 8285 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:37:57.009693 8285 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:37:57.015023 8285 catalog_manager.cc:1347] Generated new cluster ID: a4d8682833dd40beb2a8c9977d055bfa
I20260808 14:37:57.015158 8285 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:37:57.033519 8285 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:37:57.034528 8285 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:37:57.039515 8285 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 838b214b2d134725a2651eb1920fe3e4: Generated new TSK 0
I20260808 14:37:57.040370 8285 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:37:57.052968 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.193:0
--local_ip_for_outbound_sockets=127.11.131.193
--webserver_interface=127.11.131.193
--webserver_port=0
--tserver_master_addrs=127.11.131.254:42351
--builtin_ntp_servers=127.11.131.212:39141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 14:37:57.187744 8301 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:37:57.188017 8301 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:37:57.188062 8301 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:37:57.192101 8301 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:37:57.192155 8301 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:37:57.192250 8301 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.193
I20260808 14:37:57.197072 8301 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:39141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.131.193
--webserver_port=0
--tserver_master_addrs=127.11.131.254:42351
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8301
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.193
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:37:57.198235 8301 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:37:57.199710 8301 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:37:57.209795 8308 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:37:57.209883 8312 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:37:57.209802 8309 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:37:57.209875 8301 server_base.cc:1034] running on GCE node
I20260808 14:37:57.210533 8301 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:37:57.211390 8301 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:37:57.212565 8301 hybrid_clock.cc:648] HybridClock initialized: now 1786199877212541 us; error 42 us; skew 500 ppm
I20260808 14:37:57.214498 8301 webserver.cc:460] Webserver started at http://127.11.131.193:44601/ using document root <none> and password file <none>
I20260808 14:37:57.215114 8301 fs_manager.cc:359] Metadata directory not provided
I20260808 14:37:57.215211 8301 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:37:57.215457 8301 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:37:57.217515 8301 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/ts-0/data/instance:
uuid: "b97dfd826a9b40de96220cc9222ff645"
format_stamp: "Formatted at 2026-08-08 14:37:57 on dist-test-slave-twwt"
server_key: "616531d17ac9586df92a8320df00db22"
server_key_iv: "6be4f94cc2258136e8efc97d86a5343a"
server_key_version: "encryptionkey@0"
I20260808 14:37:57.218102 8301 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/ts-0/wal/instance:
uuid: "b97dfd826a9b40de96220cc9222ff645"
format_stamp: "Formatted at 2026-08-08 14:37:57 on dist-test-slave-twwt"
server_key: "616531d17ac9586df92a8320df00db22"
server_key_iv: "6be4f94cc2258136e8efc97d86a5343a"
server_key_version: "encryptionkey@0"
I20260808 14:37:57.221879 8301 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 14:37:57.224677 8322 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:57.225912 8301 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 14:37:57.226052 8301 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/ts-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/ts-0/wal
uuid: "b97dfd826a9b40de96220cc9222ff645"
format_stamp: "Formatted at 2026-08-08 14:37:57 on dist-test-slave-twwt"
server_key: "616531d17ac9586df92a8320df00db22"
server_key_iv: "6be4f94cc2258136e8efc97d86a5343a"
server_key_version: "encryptionkey@0"
I20260808 14:37:57.226171 8301 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:37:57.247159 8301 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:37:57.247936 8301 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:37:57.248160 8301 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:37:57.248842 8301 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:37:57.249898 8301 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:37:57.249974 8301 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:57.250048 8301 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:37:57.250092 8301 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:57.259759 8301 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.193:35357
I20260808 14:37:57.259792 8491 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.193:35357 every 8 connection(s)
I20260808 14:37:57.260766 8301 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
I20260808 14:37:57.262015 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 8301
I20260808 14:37:57.262164 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/ts-0/wal/instance
I20260808 14:37:57.262537 11791 external_mini_cluster.cc:1428] Setting key 4b4f1bfb50e37247d300a90af52af108
I20260808 14:37:57.264741 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.194:0
--local_ip_for_outbound_sockets=127.11.131.194
--webserver_interface=127.11.131.194
--webserver_port=0
--tserver_master_addrs=127.11.131.254:42351
--builtin_ntp_servers=127.11.131.212:39141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 14:37:57.270980 8265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:57.262792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:35963 (local address 127.11.131.254:42351)
0808 14:37:57.262960 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:57.262966 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:57.264370 (+ 1404us) server_negotiation.cc:407] Connection header received
0808 14:37:57.265971 (+ 1601us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:57.265975 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:57.266030 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:57.266110 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:37:57.267094 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:57.267636 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:57.268814 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:57.269082 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:57.269197 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:57.270419 (+ 1222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:37:57.270427 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:37:57.270429 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:37:57.270441 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:37:57.270460 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:37:57.270468 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:37:57.270548 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:57.270767 (+ 219us) server_negotiation.cc:299] Negotiation successful
0808 14:37:57.270837 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 14:37:57.271884 8499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:57.263339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:42351 (local address 127.11.131.193:35963)
0808 14:37:57.264197 (+ 858us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:57.264255 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0808 14:37:57.265740 (+ 1485us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:37:57.266285 (+ 545us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:37:57.266293 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:37:57.266386 (+ 93us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:37:57.266952 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:57.266965 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:57.267784 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:57.267788 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:57.268670 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:57.268680 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:57.269246 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:57.269250 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:57.269465 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:57.270129 (+ 664us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:37:57.270131 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:37:57.270172 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:37:57.270246 (+ 74us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:37:57.270550 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:37:57.270562 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:37:57.270570 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 14:37:57.270751 (+ 181us) client_negotiation.cc:240] Negotiation successful
0808 14:37:57.271035 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":127,"threads_started":1}
I20260808 14:37:57.273175 8492 heartbeater.cc:347] Connected to a master server at 127.11.131.254:42351
I20260808 14:37:57.273435 8492 heartbeater.cc:464] Registering TS with master...
I20260808 14:37:57.273973 8492 heartbeater.cc:511] Master 127.11.131.254:42351 requested a full tablet report, sending...
I20260808 14:37:57.275563 8211 ts_manager.cc:194] Registered new tserver with Master: b97dfd826a9b40de96220cc9222ff645 (127.11.131.193:35357)
I20260808 14:37:57.276710 8211 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.131.193:35963
W20260808 14:37:57.383728 8502 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:37:57.384081 8502 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:37:57.384155 8502 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:37:57.388804 8502 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:37:57.388904 8502 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:37:57.389008 8502 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.194
I20260808 14:37:57.393970 8502 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:39141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.131.194
--webserver_port=0
--tserver_master_addrs=127.11.131.254:42351
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8502
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.194
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:37:57.395275 8502 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:37:57.396749 8502 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:37:57.406949 8510 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:37:57.407064 8502 server_base.cc:1034] running on GCE node
W20260808 14:37:57.407001 8509 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:37:57.407009 8512 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:37:57.407689 8502 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:37:57.408385 8502 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:37:57.409565 8502 hybrid_clock.cc:648] HybridClock initialized: now 1786199877409542 us; error 34 us; skew 500 ppm
I20260808 14:37:57.411827 8502 webserver.cc:460] Webserver started at http://127.11.131.194:43681/ using document root <none> and password file <none>
I20260808 14:37:57.412468 8502 fs_manager.cc:359] Metadata directory not provided
I20260808 14:37:57.412535 8502 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:37:57.412786 8502 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:37:57.415094 8502 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/ts-1/data/instance:
uuid: "11cdb733c70344a78d891c8324ba5fb1"
format_stamp: "Formatted at 2026-08-08 14:37:57 on dist-test-slave-twwt"
server_key: "54ab0b6885a68ae59738c350985e1093"
server_key_iv: "e852b666897c81f303aabc0edaf5efb0"
server_key_version: "encryptionkey@0"
I20260808 14:37:57.415707 8502 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/ts-1/wal/instance:
uuid: "11cdb733c70344a78d891c8324ba5fb1"
format_stamp: "Formatted at 2026-08-08 14:37:57 on dist-test-slave-twwt"
server_key: "54ab0b6885a68ae59738c350985e1093"
server_key_iv: "e852b666897c81f303aabc0edaf5efb0"
server_key_version: "encryptionkey@0"
I20260808 14:37:57.419823 8502 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 14:37:57.422597 8519 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:57.424050 8502 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:37:57.424192 8502 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/ts-1/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/ts-1/wal
uuid: "11cdb733c70344a78d891c8324ba5fb1"
format_stamp: "Formatted at 2026-08-08 14:37:57 on dist-test-slave-twwt"
server_key: "54ab0b6885a68ae59738c350985e1093"
server_key_iv: "e852b666897c81f303aabc0edaf5efb0"
server_key_version: "encryptionkey@0"
I20260808 14:37:57.424322 8502 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:37:57.450215 8502 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:37:57.451187 8502 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:37:57.451404 8502 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:37:57.452101 8502 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:37:57.453166 8502 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:37:57.453263 8502 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:57.453325 8502 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:37:57.453363 8502 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:57.463191 8502 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.194:33749
I20260808 14:37:57.463227 8692 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.194:33749 every 8 connection(s)
I20260808 14:37:57.464263 8502 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
I20260808 14:37:57.472863 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 8502
I20260808 14:37:57.473030 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/ts-1/wal/instance
I20260808 14:37:57.473449 11791 external_mini_cluster.cc:1428] Setting key 7e812142af8ca0cfbd12e97ab2743ab9
I20260808 14:37:57.474572 8265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:57.466442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:46761 (local address 127.11.131.254:42351)
0808 14:37:57.466669 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:57.466679 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:57.467762 (+ 1083us) server_negotiation.cc:407] Connection header received
0808 14:37:57.469391 (+ 1629us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:57.469393 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:57.469443 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:57.469521 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:37:57.470561 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:57.471156 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:57.472361 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:57.472574 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:57.472656 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:57.474066 (+ 1410us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:37:57.474069 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:37:57.474071 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:37:57.474084 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:37:57.474125 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:37:57.474137 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:37:57.474209 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:57.474405 (+ 196us) server_negotiation.cc:299] Negotiation successful
0808 14:37:57.474460 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 14:37:57.475678 8698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:57.466909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:42351 (local address 127.11.131.194:46761)
0808 14:37:57.467610 (+ 701us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:57.467653 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 14:37:57.469175 (+ 1522us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:37:57.469700 (+ 525us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:37:57.469707 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:37:57.469797 (+ 90us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:37:57.470414 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:57.470430 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:57.471309 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:57.471313 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:57.472242 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:57.472253 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:57.472789 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:57.472794 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:57.473019 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:57.473734 (+ 715us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:37:57.473736 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:37:57.473792 (+ 56us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:37:57.473880 (+ 88us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:37:57.474228 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:37:57.474237 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:37:57.474243 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 14:37:57.474398 (+ 155us) client_negotiation.cc:240] Negotiation successful
0808 14:37:57.474729 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":117,"threads_started":1}
I20260808 14:37:57.475715 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.195:0
--local_ip_for_outbound_sockets=127.11.131.195
--webserver_interface=127.11.131.195
--webserver_port=0
--tserver_master_addrs=127.11.131.254:42351
--builtin_ntp_servers=127.11.131.212:39141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 14:37:57.476897 8694 heartbeater.cc:347] Connected to a master server at 127.11.131.254:42351
I20260808 14:37:57.477218 8694 heartbeater.cc:464] Registering TS with master...
I20260808 14:37:57.477928 8694 heartbeater.cc:511] Master 127.11.131.254:42351 requested a full tablet report, sending...
I20260808 14:37:57.479131 8211 ts_manager.cc:194] Registered new tserver with Master: 11cdb733c70344a78d891c8324ba5fb1 (127.11.131.194:33749)
I20260808 14:37:57.479734 8211 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.131.194:46761
W20260808 14:37:57.595863 8700 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:37:57.596194 8700 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:37:57.596287 8700 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:37:57.600322 8700 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:37:57.600409 8700 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:37:57.600498 8700 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.195
I20260808 14:37:57.605770 8700 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:39141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.131.195
--webserver_port=0
--tserver_master_addrs=127.11.131.254:42351
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8700
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.195
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:37:57.607064 8700 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:37:57.608469 8700 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:37:57.618330 8713 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:37:57.618314 8714 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:37:57.618359 8718 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:37:57.618701 8700 server_base.cc:1034] running on GCE node
I20260808 14:37:57.619136 8700 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:37:57.619753 8700 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:37:57.620945 8700 hybrid_clock.cc:648] HybridClock initialized: now 1786199877620906 us; error 49 us; skew 500 ppm
I20260808 14:37:57.623015 8700 webserver.cc:460] Webserver started at http://127.11.131.195:43167/ using document root <none> and password file <none>
I20260808 14:37:57.623636 8700 fs_manager.cc:359] Metadata directory not provided
I20260808 14:37:57.623701 8700 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:37:57.623945 8700 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:37:57.626041 8700 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/ts-2/data/instance:
uuid: "c997877fda6b48299100c2e2eac5b16b"
format_stamp: "Formatted at 2026-08-08 14:37:57 on dist-test-slave-twwt"
server_key: "e3ca53306eed7f5f5c073af857e06c5a"
server_key_iv: "303f9f7bba809a95e39f9db795fe09a8"
server_key_version: "encryptionkey@0"
I20260808 14:37:57.626677 8700 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/ts-2/wal/instance:
uuid: "c997877fda6b48299100c2e2eac5b16b"
format_stamp: "Formatted at 2026-08-08 14:37:57 on dist-test-slave-twwt"
server_key: "e3ca53306eed7f5f5c073af857e06c5a"
server_key_iv: "303f9f7bba809a95e39f9db795fe09a8"
server_key_version: "encryptionkey@0"
I20260808 14:37:57.630892 8700 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 14:37:57.633646 8726 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:57.635030 8700 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:37:57.635190 8700 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/ts-2/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/ts-2/wal
uuid: "c997877fda6b48299100c2e2eac5b16b"
format_stamp: "Formatted at 2026-08-08 14:37:57 on dist-test-slave-twwt"
server_key: "e3ca53306eed7f5f5c073af857e06c5a"
server_key_iv: "303f9f7bba809a95e39f9db795fe09a8"
server_key_version: "encryptionkey@0"
I20260808 14:37:57.635310 8700 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:37:57.665175 8700 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:37:57.665956 8700 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:37:57.666169 8700 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:37:57.666898 8700 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:37:57.667907 8700 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:37:57.667987 8700 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:57.668062 8700 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:37:57.668116 8700 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:57.677688 8700 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.195:41045
I20260808 14:37:57.677740 8906 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.195:41045 every 8 connection(s)
I20260808 14:37:57.678663 8700 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
I20260808 14:37:57.684367 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 8700
I20260808 14:37:57.684473 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/ts-2/wal/instance
I20260808 14:37:57.684792 11791 external_mini_cluster.cc:1428] Setting key c9e0791a44c75575762d10d27dca4670
I20260808 14:37:57.688881 8265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:57.680606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:33889 (local address 127.11.131.254:42351)
0808 14:37:57.680786 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:57.680791 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:57.681928 (+ 1137us) server_negotiation.cc:407] Connection header received
0808 14:37:57.683543 (+ 1615us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:57.683546 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:57.683596 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:57.683672 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:37:57.684739 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:57.685408 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:57.686902 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:57.687250 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:57.687339 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:57.688436 (+ 1097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:37:57.688439 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:37:57.688441 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:37:57.688453 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:37:57.688471 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:37:57.688479 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:37:57.688537 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:57.688691 (+ 154us) server_negotiation.cc:299] Negotiation successful
0808 14:37:57.688742 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 14:37:57.689766 8910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:57.681032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:42351 (local address 127.11.131.195:33889)
0808 14:37:57.681767 (+ 735us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:57.681810 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 14:37:57.683324 (+ 1514us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:37:57.683888 (+ 564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:37:57.683894 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:37:57.683978 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:37:57.684590 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:57.684607 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:57.685576 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:57.685579 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:57.686785 (+ 1206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:57.686796 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:57.687397 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:57.687400 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:57.687552 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:57.688165 (+ 613us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:37:57.688166 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:37:57.688207 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:37:57.688273 (+ 66us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:37:57.688558 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:37:57.688566 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:37:57.688571 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:37:57.688668 (+ 97us) client_negotiation.cc:240] Negotiation successful
0808 14:37:57.688893 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":120,"threads_started":1}
I20260808 14:37:57.690999 8907 heartbeater.cc:347] Connected to a master server at 127.11.131.254:42351
I20260808 14:37:57.691253 8907 heartbeater.cc:464] Registering TS with master...
I20260808 14:37:57.691788 8907 heartbeater.cc:511] Master 127.11.131.254:42351 requested a full tablet report, sending...
I20260808 14:37:57.692857 8211 ts_manager.cc:194] Registered new tserver with Master: c997877fda6b48299100c2e2eac5b16b (127.11.131.195:41045)
I20260808 14:37:57.693384 8211 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.131.195:33889
I20260808 14:37:57.698797 11791 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:37:57.704396 8265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:57.700781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48312 (local address 127.11.131.254:42351)
0808 14:37:57.700898 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:57.700901 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:57.701109 (+ 208us) server_negotiation.cc:407] Connection header received
0808 14:37:57.701195 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:57.701197 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:57.701232 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:57.701295 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:37:57.701537 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:57.702002 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:57.702848 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:57.703046 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:57.703122 (+ 76us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:57.703981 (+ 859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:37:57.703987 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:37:57.703991 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:37:57.704005 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:37:57.704028 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:37:57.704036 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:37:57.704173 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:57.704250 (+ 77us) server_negotiation.cc:299] Negotiation successful
0808 14:37:57.704280 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 14:37:57.707501 8211 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48312:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:37:57.710497 8211 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:37:57.724790 8925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:57.718777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:35357 (local address 127.0.0.1:59260)
0808 14:37:57.719671 (+ 894us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:57.719686 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:37:57.719856 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:37:57.720445 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:37:57.720448 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:37:57.720462 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:37:57.720710 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:57.720717 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:57.722112 (+ 1395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:57.722116 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:57.723474 (+ 1358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:57.723487 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:57.724233 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:57.724237 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:57.724343 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:57.724381 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 14:37:57.724507 (+ 126us) client_negotiation.cc:240] Negotiation successful
0808 14:37:57.724644 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":824,"mutex_wait_us":238,"thread_start_us":123,"threads_started":1}
I20260808 14:37:57.724851 8926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:57.718945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59260 (local address 127.11.131.193:35357)
0808 14:37:57.719526 (+ 581us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:57.719539 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:57.719777 (+ 238us) server_negotiation.cc:407] Connection header received
0808 14:37:57.719997 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:57.720003 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:57.720168 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:57.720276 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:37:57.720830 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:57.721988 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:57.723587 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:57.724100 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:57.724245 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:57.724446 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:57.724573 (+ 127us) server_negotiation.cc:299] Negotiation successful
0808 14:37:57.724688 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":462,"thread_start_us":101,"threads_started":1}
I20260808 14:37:57.725138 8922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:57.718572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.194:33749 (local address 127.0.0.1:35102)
0808 14:37:57.719406 (+ 834us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:57.719456 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 14:37:57.719597 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:37:57.720362 (+ 765us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:37:57.720368 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:37:57.720395 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:37:57.720589 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:57.720597 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:57.721802 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:57.721806 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:57.723574 (+ 1768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:57.723584 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:57.724742 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:57.724746 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:57.724831 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:57.724859 (+ 28us) client_negotiation.cc:769] Sending connection context
0808 14:37:57.724940 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 14:37:57.725005 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":652,"mutex_wait_us":203,"thread_start_us":114,"threads_started":1}
I20260808 14:37:57.725621 8924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:57.718741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35102 (local address 127.11.131.194:33749)
0808 14:37:57.719401 (+ 660us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:57.719414 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:57.719559 (+ 145us) server_negotiation.cc:407] Connection header received
0808 14:37:57.719813 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:57.719819 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:57.720024 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:57.720163 (+ 139us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:37:57.720724 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:57.721688 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:57.723695 (+ 2007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:57.724345 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:57.724486 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:57.724675 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:57.725364 (+ 689us) server_negotiation.cc:299] Negotiation successful
0808 14:37:57.725463 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":521,"thread_start_us":135,"threads_started":1}
I20260808 14:37:57.726249 8928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:57.719689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.195:41045 (local address 127.0.0.1:34582)
0808 14:37:57.720107 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:57.720120 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:37:57.720211 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:37:57.721077 (+ 866us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:37:57.721080 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:37:57.721100 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:37:57.721179 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:57.721185 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:57.722419 (+ 1234us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:57.722423 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:57.724532 (+ 2109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:57.724541 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:57.725587 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:57.725590 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:57.725930 (+ 340us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:57.725951 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 14:37:57.726048 (+ 97us) client_negotiation.cc:240] Negotiation successful
0808 14:37:57.726119 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":359,"mutex_wait_us":965,"thread_start_us":105,"threads_started":1}
I20260808 14:37:57.726359 8929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:57.719878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34582 (local address 127.11.131.195:41045)
0808 14:37:57.720582 (+ 704us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:57.720594 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:57.720623 (+ 29us) server_negotiation.cc:407] Connection header received
0808 14:37:57.720717 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:57.720722 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:57.720920 (+ 198us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:57.721079 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:37:57.721272 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:57.722303 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:57.724657 (+ 2354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:57.725454 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:57.725596 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:57.725771 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:57.726083 (+ 312us) server_negotiation.cc:299] Negotiation successful
0808 14:37:57.726176 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":600,"thread_start_us":155,"threads_started":1}
I20260808 14:37:57.728292 8400 tablet_service.cc:1467] Processing CreateTablet for tablet 582beca1f016468f82a9393f600cf858 (DEFAULT_TABLE table=test-table [id=890d2e58c764407590338086b7246a31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:37:57.728598 8594 tablet_service.cc:1467] Processing CreateTablet for tablet 582beca1f016468f82a9393f600cf858 (DEFAULT_TABLE table=test-table [id=890d2e58c764407590338086b7246a31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:37:57.728979 8806 tablet_service.cc:1467] Processing CreateTablet for tablet 582beca1f016468f82a9393f600cf858 (DEFAULT_TABLE table=test-table [id=890d2e58c764407590338086b7246a31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:37:57.729498 8400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 582beca1f016468f82a9393f600cf858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:37:57.729507 8594 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 582beca1f016468f82a9393f600cf858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:37:57.730028 8806 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 582beca1f016468f82a9393f600cf858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:37:57.736577 8934 tablet_bootstrap.cc:492] T 582beca1f016468f82a9393f600cf858 P c997877fda6b48299100c2e2eac5b16b: Bootstrap starting.
I20260808 14:37:57.737733 8940 tablet_bootstrap.cc:492] T 582beca1f016468f82a9393f600cf858 P b97dfd826a9b40de96220cc9222ff645: Bootstrap starting.
I20260808 14:37:57.737920 8937 tablet_bootstrap.cc:492] T 582beca1f016468f82a9393f600cf858 P 11cdb733c70344a78d891c8324ba5fb1: Bootstrap starting.
I20260808 14:37:57.738917 8934 tablet_bootstrap.cc:654] T 582beca1f016468f82a9393f600cf858 P c997877fda6b48299100c2e2eac5b16b: Neither blocks nor log segments found. Creating new log.
I20260808 14:37:57.739732 8934 log.cc:824] T 582beca1f016468f82a9393f600cf858 P c997877fda6b48299100c2e2eac5b16b: Log is configured to *not* fsync() on all Append() calls
I20260808 14:37:57.739997 8937 tablet_bootstrap.cc:654] T 582beca1f016468f82a9393f600cf858 P 11cdb733c70344a78d891c8324ba5fb1: Neither blocks nor log segments found. Creating new log.
I20260808 14:37:57.739998 8940 tablet_bootstrap.cc:654] T 582beca1f016468f82a9393f600cf858 P b97dfd826a9b40de96220cc9222ff645: Neither blocks nor log segments found. Creating new log.
I20260808 14:37:57.740880 8940 log.cc:824] T 582beca1f016468f82a9393f600cf858 P b97dfd826a9b40de96220cc9222ff645: Log is configured to *not* fsync() on all Append() calls
I20260808 14:37:57.740880 8937 log.cc:824] T 582beca1f016468f82a9393f600cf858 P 11cdb733c70344a78d891c8324ba5fb1: Log is configured to *not* fsync() on all Append() calls
I20260808 14:37:57.741907 8934 tablet_bootstrap.cc:492] T 582beca1f016468f82a9393f600cf858 P c997877fda6b48299100c2e2eac5b16b: No bootstrap required, opened a new log
I20260808 14:37:57.742125 8934 ts_tablet_manager.cc:1397] T 582beca1f016468f82a9393f600cf858 P c997877fda6b48299100c2e2eac5b16b: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 14:37:57.742864 8937 tablet_bootstrap.cc:492] T 582beca1f016468f82a9393f600cf858 P 11cdb733c70344a78d891c8324ba5fb1: No bootstrap required, opened a new log
I20260808 14:37:57.743067 8937 ts_tablet_manager.cc:1397] T 582beca1f016468f82a9393f600cf858 P 11cdb733c70344a78d891c8324ba5fb1: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 14:37:57.743366 8940 tablet_bootstrap.cc:492] T 582beca1f016468f82a9393f600cf858 P b97dfd826a9b40de96220cc9222ff645: No bootstrap required, opened a new log
I20260808 14:37:57.743577 8940 ts_tablet_manager.cc:1397] T 582beca1f016468f82a9393f600cf858 P b97dfd826a9b40de96220cc9222ff645: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.004s
I20260808 14:37:57.746481 8937 raft_consensus.cc:348] T 582beca1f016468f82a9393f600cf858 P 11cdb733c70344a78d891c8324ba5fb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11cdb733c70344a78d891c8324ba5fb1" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 33749 } } peers { permanent_uuid: "b97dfd826a9b40de96220cc9222ff645" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35357 } } peers { permanent_uuid: "c997877fda6b48299100c2e2eac5b16b" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41045 } }
I20260808 14:37:57.746774 8937 raft_consensus.cc:374] T 582beca1f016468f82a9393f600cf858 P 11cdb733c70344a78d891c8324ba5fb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:37:57.746832 8937 raft_consensus.cc:729] T 582beca1f016468f82a9393f600cf858 P 11cdb733c70344a78d891c8324ba5fb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11cdb733c70344a78d891c8324ba5fb1, State: Initialized, Role: FOLLOWER
I20260808 14:37:57.746681 8934 raft_consensus.cc:348] T 582beca1f016468f82a9393f600cf858 P c997877fda6b48299100c2e2eac5b16b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11cdb733c70344a78d891c8324ba5fb1" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 33749 } } peers { permanent_uuid: "b97dfd826a9b40de96220cc9222ff645" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35357 } } peers { permanent_uuid: "c997877fda6b48299100c2e2eac5b16b" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41045 } }
I20260808 14:37:57.746937 8934 raft_consensus.cc:374] T 582beca1f016468f82a9393f600cf858 P c997877fda6b48299100c2e2eac5b16b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:37:57.747007 8934 raft_consensus.cc:729] T 582beca1f016468f82a9393f600cf858 P c997877fda6b48299100c2e2eac5b16b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c997877fda6b48299100c2e2eac5b16b, State: Initialized, Role: FOLLOWER
I20260808 14:37:57.747335 8937 consensus_queue.cc:260] T 582beca1f016468f82a9393f600cf858 P 11cdb733c70344a78d891c8324ba5fb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11cdb733c70344a78d891c8324ba5fb1" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 33749 } } peers { permanent_uuid: "b97dfd826a9b40de96220cc9222ff645" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35357 } } peers { permanent_uuid: "c997877fda6b48299100c2e2eac5b16b" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41045 } }
I20260808 14:37:57.747458 8934 consensus_queue.cc:260] T 582beca1f016468f82a9393f600cf858 P c997877fda6b48299100c2e2eac5b16b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11cdb733c70344a78d891c8324ba5fb1" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 33749 } } peers { permanent_uuid: "b97dfd826a9b40de96220cc9222ff645" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35357 } } peers { permanent_uuid: "c997877fda6b48299100c2e2eac5b16b" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41045 } }
I20260808 14:37:57.748001 8694 heartbeater.cc:503] Master 127.11.131.254:42351 was elected leader, sending a full tablet report...
I20260808 14:37:57.747903 8940 raft_consensus.cc:348] T 582beca1f016468f82a9393f600cf858 P b97dfd826a9b40de96220cc9222ff645 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11cdb733c70344a78d891c8324ba5fb1" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 33749 } } peers { permanent_uuid: "b97dfd826a9b40de96220cc9222ff645" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35357 } } peers { permanent_uuid: "c997877fda6b48299100c2e2eac5b16b" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41045 } }
I20260808 14:37:57.748129 8940 raft_consensus.cc:374] T 582beca1f016468f82a9393f600cf858 P b97dfd826a9b40de96220cc9222ff645 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:37:57.748176 8940 raft_consensus.cc:729] T 582beca1f016468f82a9393f600cf858 P b97dfd826a9b40de96220cc9222ff645 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b97dfd826a9b40de96220cc9222ff645, State: Initialized, Role: FOLLOWER
I20260808 14:37:57.748359 8937 ts_tablet_manager.cc:1428] T 582beca1f016468f82a9393f600cf858 P 11cdb733c70344a78d891c8324ba5fb1: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260808 14:37:57.748463 8934 ts_tablet_manager.cc:1428] T 582beca1f016468f82a9393f600cf858 P c997877fda6b48299100c2e2eac5b16b: Time spent starting tablet: real 0.006s user 0.004s sys 0.004s
I20260808 14:37:57.748618 8940 consensus_queue.cc:260] T 582beca1f016468f82a9393f600cf858 P b97dfd826a9b40de96220cc9222ff645 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11cdb733c70344a78d891c8324ba5fb1" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 33749 } } peers { permanent_uuid: "b97dfd826a9b40de96220cc9222ff645" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35357 } } peers { permanent_uuid: "c997877fda6b48299100c2e2eac5b16b" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41045 } }
I20260808 14:37:57.749269 8492 heartbeater.cc:503] Master 127.11.131.254:42351 was elected leader, sending a full tablet report...
I20260808 14:37:57.749300 8907 heartbeater.cc:503] Master 127.11.131.254:42351 was elected leader, sending a full tablet report...
I20260808 14:37:57.752092 8940 ts_tablet_manager.cc:1428] T 582beca1f016468f82a9393f600cf858 P b97dfd826a9b40de96220cc9222ff645: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
W20260808 14:37:57.761914 8495 tablet.cc:2369] T 582beca1f016468f82a9393f600cf858 P b97dfd826a9b40de96220cc9222ff645: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:37:57.929683 8909 tablet.cc:2369] T 582beca1f016468f82a9393f600cf858 P c997877fda6b48299100c2e2eac5b16b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 14:37:57.965580 8696 tablet.cc:2369] T 582beca1f016468f82a9393f600cf858 P 11cdb733c70344a78d891c8324ba5fb1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:37:58.048511 8954 raft_consensus.cc:482] T 582beca1f016468f82a9393f600cf858 P c997877fda6b48299100c2e2eac5b16b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:37:58.048753 8954 raft_consensus.cc:504] T 582beca1f016468f82a9393f600cf858 P c997877fda6b48299100c2e2eac5b16b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11cdb733c70344a78d891c8324ba5fb1" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 33749 } } peers { permanent_uuid: "b97dfd826a9b40de96220cc9222ff645" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35357 } } peers { permanent_uuid: "c997877fda6b48299100c2e2eac5b16b" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41045 } }
I20260808 14:37:58.050069 8954 leader_election.cc:288] T 582beca1f016468f82a9393f600cf858 P c997877fda6b48299100c2e2eac5b16b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11cdb733c70344a78d891c8324ba5fb1 (127.11.131.194:33749), b97dfd826a9b40de96220cc9222ff645 (127.11.131.193:35357)
I20260808 14:37:58.055379 8924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:58.050530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:42193 (local address 127.11.131.194:33749)
0808 14:37:58.050739 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:58.050743 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:58.050756 (+ 13us) server_negotiation.cc:407] Connection header received
0808 14:37:58.050836 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:58.050839 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:58.050917 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:58.051005 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:37:58.051374 (+ 369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:58.052166 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:58.054241 (+ 2075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:58.054837 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:58.054940 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:58.054983 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:58.055200 (+ 217us) server_negotiation.cc:299] Negotiation successful
0808 14:37:58.055256 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125}
I20260808 14:37:58.055402 8910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:58.050294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.194:33749 (local address 127.11.131.195:42193)
0808 14:37:58.050433 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:58.050453 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 14:37:58.050557 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:37:58.051025 (+ 468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:37:58.051027 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:37:58.051042 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:37:58.051232 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:58.051241 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:58.052286 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:58.052290 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:58.054086 (+ 1796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:58.054098 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:58.054965 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:58.054969 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:58.055075 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:58.055099 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 14:37:58.055177 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 14:37:58.055257 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44,"mutex_wait_us":270}
I20260808 14:37:58.055549 8926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:58.050474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:43255 (local address 127.11.131.193:35357)
0808 14:37:58.050600 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:58.050630 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:58.050834 (+ 204us) server_negotiation.cc:407] Connection header received
0808 14:37:58.050943 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:58.050949 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:58.051011 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:58.051084 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:37:58.051400 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:58.052166 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:58.054248 (+ 2082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:58.054865 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:58.054995 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:58.055047 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:58.055346 (+ 299us) server_negotiation.cc:299] Negotiation successful
0808 14:37:58.055420 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 14:37:58.055884 8958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:58.050372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:35357 (local address 127.11.131.195:43255)
0808 14:37:58.050748 (+ 376us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:58.050758 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 14:37:58.050845 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:37:58.051105 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:37:58.051108 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:37:58.051120 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:37:58.051290 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:58.051298 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:58.052286 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:58.052290 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:58.054086 (+ 1796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:37:58.054098 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:37:58.055100 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:37:58.055102 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:37:58.055204 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:58.055223 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 14:37:58.055670 (+ 447us) client_negotiation.cc:240] Negotiation successful
0808 14:37:58.055737 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":321,"mutex_wait_us":291,"thread_start_us":118,"threads_started":1}
I20260808 14:37:58.056116 8626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "582beca1f016468f82a9393f600cf858" candidate_uuid: "c997877fda6b48299100c2e2eac5b16b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11cdb733c70344a78d891c8324ba5fb1" is_pre_election: true
I20260808 14:37:58.056442 8626 raft_consensus.cc:2454] T 582beca1f016468f82a9393f600cf858 P 11cdb733c70344a78d891c8324ba5fb1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c997877fda6b48299100c2e2eac5b16b in term 0.
I20260808 14:37:58.056478 8422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "582beca1f016468f82a9393f600cf858" candidate_uuid: "c997877fda6b48299100c2e2eac5b16b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b97dfd826a9b40de96220cc9222ff645" is_pre_election: true
I20260808 14:37:58.056702 8422 raft_consensus.cc:2454] T 582beca1f016468f82a9393f600cf858 P b97dfd826a9b40de96220cc9222ff645 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c997877fda6b48299100c2e2eac5b16b in term 0.
I20260808 14:37:58.057014 8733 leader_election.cc:302] T 582beca1f016468f82a9393f600cf858 P c997877fda6b48299100c2e2eac5b16b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11cdb733c70344a78d891c8324ba5fb1, c997877fda6b48299100c2e2eac5b16b; no voters:
I20260808 14:37:58.057297 8954 raft_consensus.cc:2781] T 582beca1f016468f82a9393f600cf858 P c997877fda6b48299100c2e2eac5b16b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:37:58.057401 8954 raft_consensus.cc:482] T 582beca1f016468f82a9393f600cf858 P c997877fda6b48299100c2e2eac5b16b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:37:58.057446 8954 raft_consensus.cc:3037] T 582beca1f016468f82a9393f600cf858 P c997877fda6b48299100c2e2eac5b16b [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:37:58.058497 8954 raft_consensus.cc:504] T 582beca1f016468f82a9393f600cf858 P c997877fda6b48299100c2e2eac5b16b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11cdb733c70344a78d891c8324ba5fb1" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 33749 } } peers { permanent_uuid: "b97dfd826a9b40de96220cc9222ff645" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35357 } } peers { permanent_uuid: "c997877fda6b48299100c2e2eac5b16b" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41045 } }
I20260808 14:37:58.058926 8954 leader_election.cc:288] T 582beca1f016468f82a9393f600cf858 P c997877fda6b48299100c2e2eac5b16b [CANDIDATE]: Term 1 election: Requested vote from peers 11cdb733c70344a78d891c8324ba5fb1 (127.11.131.194:33749), b97dfd826a9b40de96220cc9222ff645 (127.11.131.193:35357)
I20260808 14:37:58.059262 8626 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "582beca1f016468f82a9393f600cf858" candidate_uuid: "c997877fda6b48299100c2e2eac5b16b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11cdb733c70344a78d891c8324ba5fb1"
I20260808 14:37:58.059392 8422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "582beca1f016468f82a9393f600cf858" candidate_uuid: "c997877fda6b48299100c2e2eac5b16b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b97dfd826a9b40de96220cc9222ff645"
I20260808 14:37:58.059413 8626 raft_consensus.cc:3037] T 582beca1f016468f82a9393f600cf858 P 11cdb733c70344a78d891c8324ba5fb1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:37:58.059538 8422 raft_consensus.cc:3037] T 582beca1f016468f82a9393f600cf858 P b97dfd826a9b40de96220cc9222ff645 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:37:58.060552 8626 raft_consensus.cc:2454] T 582beca1f016468f82a9393f600cf858 P 11cdb733c70344a78d891c8324ba5fb1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c997877fda6b48299100c2e2eac5b16b in term 1.
I20260808 14:37:58.060726 8422 raft_consensus.cc:2454] T 582beca1f016468f82a9393f600cf858 P b97dfd826a9b40de96220cc9222ff645 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c997877fda6b48299100c2e2eac5b16b in term 1.
I20260808 14:37:58.060885 8733 leader_election.cc:302] T 582beca1f016468f82a9393f600cf858 P c997877fda6b48299100c2e2eac5b16b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11cdb733c70344a78d891c8324ba5fb1, c997877fda6b48299100c2e2eac5b16b; no voters:
I20260808 14:37:58.061080 8954 raft_consensus.cc:2781] T 582beca1f016468f82a9393f600cf858 P c997877fda6b48299100c2e2eac5b16b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:37:58.061306 8954 raft_consensus.cc:686] T 582beca1f016468f82a9393f600cf858 P c997877fda6b48299100c2e2eac5b16b [term 1 LEADER]: Becoming Leader. State: Replica: c997877fda6b48299100c2e2eac5b16b, State: Running, Role: LEADER
I20260808 14:37:58.061654 8954 consensus_queue.cc:237] T 582beca1f016468f82a9393f600cf858 P c997877fda6b48299100c2e2eac5b16b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11cdb733c70344a78d891c8324ba5fb1" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 33749 } } peers { permanent_uuid: "b97dfd826a9b40de96220cc9222ff645" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35357 } } peers { permanent_uuid: "c997877fda6b48299100c2e2eac5b16b" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41045 } }
I20260808 14:37:58.064999 8211 catalog_manager.cc:5495] T 582beca1f016468f82a9393f600cf858 P c997877fda6b48299100c2e2eac5b16b reported cstate change: term changed from 0 to 1, leader changed from <none> to c997877fda6b48299100c2e2eac5b16b (127.11.131.195). New cstate: current_term: 1 leader_uuid: "c997877fda6b48299100c2e2eac5b16b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11cdb733c70344a78d891c8324ba5fb1" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 33749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97dfd826a9b40de96220cc9222ff645" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c997877fda6b48299100c2e2eac5b16b" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 41045 } health_report { overall_health: HEALTHY } } }
I20260808 14:37:58.093926 8929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:58.090187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34590 (local address 127.11.131.195:41045)
0808 14:37:58.090361 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:58.090367 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:58.090383 (+ 16us) server_negotiation.cc:407] Connection header received
0808 14:37:58.090459 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:58.090462 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:58.090519 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:58.090663 (+ 144us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:37:58.090941 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:58.091451 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:58.092340 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:58.092570 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:58.092696 (+ 126us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:58.093028 (+ 332us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:37:58.093467 (+ 439us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:37:58.093638 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:58.093736 (+ 98us) server_negotiation.cc:299] Negotiation successful
0808 14:37:58.093776 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 14:37:58.100210 8626 raft_consensus.cc:1261] T 582beca1f016468f82a9393f600cf858 P 11cdb733c70344a78d891c8324ba5fb1 [term 1 FOLLOWER]: Refusing update from remote peer c997877fda6b48299100c2e2eac5b16b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:37:58.100267 8422 raft_consensus.cc:1261] T 582beca1f016468f82a9393f600cf858 P b97dfd826a9b40de96220cc9222ff645 [term 1 FOLLOWER]: Refusing update from remote peer c997877fda6b48299100c2e2eac5b16b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:37:58.101006 8959 consensus_queue.cc:1035] T 582beca1f016468f82a9393f600cf858 P c997877fda6b48299100c2e2eac5b16b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97dfd826a9b40de96220cc9222ff645" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 35357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:37:58.101184 8954 consensus_queue.cc:1035] T 582beca1f016468f82a9393f600cf858 P c997877fda6b48299100c2e2eac5b16b [LEADER]: Connected to new peer: Peer: permanent_uuid: "11cdb733c70344a78d891c8324ba5fb1" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 33749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:37:58.110277 8963 mvcc.cc:205] Tried to move back new op lower bound from 7316274700690300928 to 7316274700543447040. Current Snapshot: MvccSnapshot[applied={T|T < 7316274700690300928}]
I20260808 14:37:58.117655 8211 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48312:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:37:58.117826 8211 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48312:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:37:58.120158 8211 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 838b214b2d134725a2651eb1920fe3e4: Sending DeleteTablet for 3 replicas of tablet 582beca1f016468f82a9393f600cf858
I20260808 14:37:58.120991 8594 tablet_service.cc:1514] Processing DeleteTablet for tablet 582beca1f016468f82a9393f600cf858 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:37:58 UTC) from {username='slave'} at 127.0.0.1:35102
I20260808 14:37:58.121124 8806 tablet_service.cc:1514] Processing DeleteTablet for tablet 582beca1f016468f82a9393f600cf858 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:37:58 UTC) from {username='slave'} at 127.0.0.1:34582
I20260808 14:37:58.121512 8976 tablet_replica.cc:330] T 582beca1f016468f82a9393f600cf858 P 11cdb733c70344a78d891c8324ba5fb1: stopping tablet replica
I20260808 14:37:58.121527 8400 tablet_service.cc:1514] Processing DeleteTablet for tablet 582beca1f016468f82a9393f600cf858 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:37:58 UTC) from {username='slave'} at 127.0.0.1:59260
I20260808 14:37:58.121881 8976 raft_consensus.cc:2229] T 582beca1f016468f82a9393f600cf858 P 11cdb733c70344a78d891c8324ba5fb1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:37:58.122046 8978 tablet_replica.cc:330] T 582beca1f016468f82a9393f600cf858 P b97dfd826a9b40de96220cc9222ff645: stopping tablet replica
I20260808 14:37:58.122227 8976 raft_consensus.cc:2258] T 582beca1f016468f82a9393f600cf858 P 11cdb733c70344a78d891c8324ba5fb1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:37:58.122507 8978 raft_consensus.cc:2229] T 582beca1f016468f82a9393f600cf858 P b97dfd826a9b40de96220cc9222ff645 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:37:58.122572 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 8301
I20260808 14:37:58.131488 8976 ts_tablet_manager.cc:1905] T 582beca1f016468f82a9393f600cf858 P 11cdb733c70344a78d891c8324ba5fb1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:37:58.134023 8976 ts_tablet_manager.cc:1918] T 582beca1f016468f82a9393f600cf858 P 11cdb733c70344a78d891c8324ba5fb1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:37:58.134155 8976 log.cc:1196] T 582beca1f016468f82a9393f600cf858 P 11cdb733c70344a78d891c8324ba5fb1: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/ts-1/wal/wals/582beca1f016468f82a9393f600cf858
I20260808 14:37:58.134496 8976 ts_tablet_manager.cc:1939] T 582beca1f016468f82a9393f600cf858 P 11cdb733c70344a78d891c8324ba5fb1: Deleting consensus metadata
I20260808 14:37:58.135778 8977 tablet_replica.cc:330] T 582beca1f016468f82a9393f600cf858 P c997877fda6b48299100c2e2eac5b16b: stopping tablet replica
I20260808 14:37:58.135844 8188 catalog_manager.cc:4841] TS 11cdb733c70344a78d891c8324ba5fb1 (127.11.131.194:33749): tablet 582beca1f016468f82a9393f600cf858 (table test-table [id=890d2e58c764407590338086b7246a31]) successfully deleted
I20260808 14:37:58.136159 8977 raft_consensus.cc:2229] T 582beca1f016468f82a9393f600cf858 P c997877fda6b48299100c2e2eac5b16b [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:37:58.136582 8977 raft_consensus.cc:2258] T 582beca1f016468f82a9393f600cf858 P c997877fda6b48299100c2e2eac5b16b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260808 14:37:58.137935 8185 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.131.193:35357 (error 108)
I20260808 14:37:58.137993 8977 ts_tablet_manager.cc:1905] T 582beca1f016468f82a9393f600cf858 P c997877fda6b48299100c2e2eac5b16b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:37:58.139140 8928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:58.138791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:35357 (local address 127.0.0.1:59274)
0808 14:37:58.138958 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 14:37:58.139039 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.193:35357: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260808 14:37:58.139164 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 8502
W20260808 14:37:58.148535 8185 catalog_manager.cc:4584] TS b97dfd826a9b40de96220cc9222ff645 (127.11.131.193:35357): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 582beca1f016468f82a9393f600cf858: Network error: Client connection negotiation failed: client connection to 127.11.131.193:35357: connect: Connection refused (error 111)
I20260808 14:37:58.148800 8977 ts_tablet_manager.cc:1918] T 582beca1f016468f82a9393f600cf858 P c997877fda6b48299100c2e2eac5b16b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:37:58.148934 8977 log.cc:1196] T 582beca1f016468f82a9393f600cf858 P c997877fda6b48299100c2e2eac5b16b: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786199615258783-11791-0/minicluster-data/ts-2/wal/wals/582beca1f016468f82a9393f600cf858
I20260808 14:37:58.149293 8977 ts_tablet_manager.cc:1939] T 582beca1f016468f82a9393f600cf858 P c997877fda6b48299100c2e2eac5b16b: Deleting consensus metadata
I20260808 14:37:58.150844 8185 catalog_manager.cc:4841] TS c997877fda6b48299100c2e2eac5b16b (127.11.131.195:41045): tablet 582beca1f016468f82a9393f600cf858 (table test-table [id=890d2e58c764407590338086b7246a31]) successfully deleted
I20260808 14:37:58.155997 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 8700
I20260808 14:37:58.167877 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 8160
2026-08-08T14:37:58Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (1428 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:37:58 dist-test-slave-twwt krb5kdc[8987](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:37:58 dist-test-slave-twwt krb5kdc[8987](info): set up 2 sockets
Aug 08 14:37:58 dist-test-slave-twwt krb5kdc[8987](info): commencing operation
krb5kdc: starting...
W20260808 14:37:59.428287 11791 mini_kdc.cc:121] Time spent starting KDC: real 1.230s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Aug 08 14:37:59 dist-test-slave-twwt krb5kdc[8987](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199879, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:37:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:37:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.131.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
I20260808 14:37:59.563081 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:33829
--webserver_interface=127.11.131.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:36703
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:33829
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:37:59.679808 9010 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:37:59.680123 9010 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:37:59.680198 9010 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:37:59.684198 9010 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:37:59.684294 9010 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:37:59.684329 9010 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:37:59.684372 9010 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:37:59.684403 9010 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:37:59.689695 9010 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:36703
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:33829
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:33829
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.131.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9010
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:37:59.690851 9010 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:37:59.691936 9010 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:37:59.701208 9019 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:37:59.701189 9017 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:37:59.701201 9016 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:37:59.701453 9010 server_base.cc:1034] running on GCE node
I20260808 14:37:59.702199 9010 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:37:59.703416 9010 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:37:59.704581 9010 hybrid_clock.cc:648] HybridClock initialized: now 1786199879704557 us; error 30 us; skew 500 ppm
Aug 08 14:37:59 dist-test-slave-twwt krb5kdc[8987](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199879, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:37:59.707592 9010 init.cc:377] Logged in from keytab as kudu/127.11.131.254@KRBTEST.COM (short username kudu)
I20260808 14:37:59.708546 9010 webserver.cc:460] Webserver started at http://127.11.131.254:42303/ using document root <none> and password file <none>
I20260808 14:37:59.709138 9010 fs_manager.cc:359] Metadata directory not provided
I20260808 14:37:59.709231 9010 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:37:59.709483 9010 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:37:59.711652 9010 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/master-0/data/instance:
uuid: "1dfeac3e44ca41a5a9ed46388d2c4b8a"
format_stamp: "Formatted at 2026-08-08 14:37:59 on dist-test-slave-twwt"
server_key: "246bd897c2429bb36d67e957d5ac9573"
server_key_iv: "68917f811ce1369761599c36d1453728"
server_key_version: "encryptionkey@0"
I20260808 14:37:59.712248 9010 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/master-0/wal/instance:
uuid: "1dfeac3e44ca41a5a9ed46388d2c4b8a"
format_stamp: "Formatted at 2026-08-08 14:37:59 on dist-test-slave-twwt"
server_key: "246bd897c2429bb36d67e957d5ac9573"
server_key_iv: "68917f811ce1369761599c36d1453728"
server_key_version: "encryptionkey@0"
I20260808 14:37:59.716104 9010 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 14:37:59.718578 9029 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:59.719950 9010 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 14:37:59.720090 9010 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "1dfeac3e44ca41a5a9ed46388d2c4b8a"
format_stamp: "Formatted at 2026-08-08 14:37:59 on dist-test-slave-twwt"
server_key: "246bd897c2429bb36d67e957d5ac9573"
server_key_iv: "68917f811ce1369761599c36d1453728"
server_key_version: "encryptionkey@0"
I20260808 14:37:59.720203 9010 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:37:59.736318 9010 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:37:59.739997 9010 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:37:59.740221 9010 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:37:59.748020 9010 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.254:33829
I20260808 14:37:59.748046 9108 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.254:33829 every 8 connection(s)
I20260808 14:37:59.749168 9010 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:37:59.750984 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 9010
I20260808 14:37:59.751153 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/master-0/wal/instance
I20260808 14:37:59.751459 11791 external_mini_cluster.cc:1428] Setting key 0e41f2bde868b199474dc37dff86bf59
I20260808 14:37:59.752408 9109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:37:59.759104 9109 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1dfeac3e44ca41a5a9ed46388d2c4b8a: Bootstrap starting.
Aug 08 14:37:59 dist-test-slave-twwt krb5kdc[8987](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199879, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:37:59.761941 9109 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1dfeac3e44ca41a5a9ed46388d2c4b8a: Neither blocks nor log segments found. Creating new log.
I20260808 14:37:59.762924 9109 log.cc:824] T 00000000000000000000000000000000 P 1dfeac3e44ca41a5a9ed46388d2c4b8a: Log is configured to *not* fsync() on all Append() calls
I20260808 14:37:59.766557 9109 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1dfeac3e44ca41a5a9ed46388d2c4b8a: No bootstrap required, opened a new log
I20260808 14:37:59.767930 9114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:37:59.752959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59150 (local address 127.11.131.254:33829)
0808 14:37:59.753435 (+ 476us) server_negotiation.cc:206] Beginning negotiation
0808 14:37:59.753451 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 14:37:59.753489 (+ 38us) server_negotiation.cc:407] Connection header received
0808 14:37:59.754135 (+ 646us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:37:59.754151 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:37:59.754489 (+ 338us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:37:59.754887 (+ 398us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:37:59.755728 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:59.756896 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:59.758185 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:37:59.759016 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:37:59.759197 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:37:59.762445 (+ 3248us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:37:59.762451 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:37:59.762469 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:37:59.762506 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:37:59.764600 (+ 2094us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:37:59.765109 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:37:59.765115 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:37:59.765122 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:37:59.765268 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:37:59.765535 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:37:59.765538 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:37:59.765539 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:37:59.766150 (+ 611us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:37:59.766387 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0808 14:37:59.766563 (+ 176us) server_negotiation.cc:299] Negotiation successful
0808 14:37:59.766927 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":328,"thread_start_us":164,"threads_started":1}
I20260808 14:37:59.770606 9109 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1dfeac3e44ca41a5a9ed46388d2c4b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1dfeac3e44ca41a5a9ed46388d2c4b8a" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 33829 } }
I20260808 14:37:59.770936 9109 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1dfeac3e44ca41a5a9ed46388d2c4b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:37:59.771039 9109 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1dfeac3e44ca41a5a9ed46388d2c4b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dfeac3e44ca41a5a9ed46388d2c4b8a, State: Initialized, Role: FOLLOWER
I20260808 14:37:59.771479 9109 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1dfeac3e44ca41a5a9ed46388d2c4b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1dfeac3e44ca41a5a9ed46388d2c4b8a" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 33829 } }
I20260808 14:37:59.771608 9109 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1dfeac3e44ca41a5a9ed46388d2c4b8a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:37:59.771697 9109 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1dfeac3e44ca41a5a9ed46388d2c4b8a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:37:59.771803 9109 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1dfeac3e44ca41a5a9ed46388d2c4b8a [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:37:59.772822 9109 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1dfeac3e44ca41a5a9ed46388d2c4b8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1dfeac3e44ca41a5a9ed46388d2c4b8a" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 33829 } }
I20260808 14:37:59.773207 9109 leader_election.cc:302] T 00000000000000000000000000000000 P 1dfeac3e44ca41a5a9ed46388d2c4b8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1dfeac3e44ca41a5a9ed46388d2c4b8a; no voters:
I20260808 14:37:59.773547 9109 leader_election.cc:288] T 00000000000000000000000000000000 P 1dfeac3e44ca41a5a9ed46388d2c4b8a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:37:59.773727 9117 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1dfeac3e44ca41a5a9ed46388d2c4b8a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:37:59.774000 9117 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1dfeac3e44ca41a5a9ed46388d2c4b8a [term 1 LEADER]: Becoming Leader. State: Replica: 1dfeac3e44ca41a5a9ed46388d2c4b8a, State: Running, Role: LEADER
I20260808 14:37:59.774340 9117 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1dfeac3e44ca41a5a9ed46388d2c4b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1dfeac3e44ca41a5a9ed46388d2c4b8a" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 33829 } }
I20260808 14:37:59.774924 9109 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1dfeac3e44ca41a5a9ed46388d2c4b8a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:37:59.776286 9118 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1dfeac3e44ca41a5a9ed46388d2c4b8a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1dfeac3e44ca41a5a9ed46388d2c4b8a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1dfeac3e44ca41a5a9ed46388d2c4b8a" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 33829 } } }
I20260808 14:37:59.776396 9118 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1dfeac3e44ca41a5a9ed46388d2c4b8a [sys.catalog]: This master's current role is: LEADER
I20260808 14:37:59.777264 9132 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:37:59.776079 9120 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1dfeac3e44ca41a5a9ed46388d2c4b8a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1dfeac3e44ca41a5a9ed46388d2c4b8a. Latest consensus state: current_term: 1 leader_uuid: "1dfeac3e44ca41a5a9ed46388d2c4b8a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1dfeac3e44ca41a5a9ed46388d2c4b8a" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 33829 } } }
I20260808 14:37:59.777717 9120 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1dfeac3e44ca41a5a9ed46388d2c4b8a [sys.catalog]: This master's current role is: LEADER
I20260808 14:37:59.780656 9132 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:37:59.786547 9132 catalog_manager.cc:1347] Generated new cluster ID: 0559d472a1a343fc9e166068e522cfc9
I20260808 14:37:59.786671 9132 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:37:59.794029 9132 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:37:59.795094 9132 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:37:59.799516 9132 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1dfeac3e44ca41a5a9ed46388d2c4b8a: Generated new TSK 0
I20260808 14:37:59.800295 9132 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.131.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab.
Entry for principal kudu/127.11.131.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab.
I20260808 14:37:59.831725 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.193:0
--local_ip_for_outbound_sockets=127.11.131.193
--webserver_interface=127.11.131.193
--webserver_port=0
--tserver_master_addrs=127.11.131.254:33829
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab
--principal=kudu/127.11.131.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:36703
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:37:59.958087 9156 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:37:59.958397 9156 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:37:59.958467 9156 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:37:59.962469 9156 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:37:59.962525 9156 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:37:59.962582 9156 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.193
I20260808 14:37:59.967903 9156 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:36703
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.193.keytab
--principal=kudu/127.11.131.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.131.193
--webserver_port=0
--tserver_master_addrs=127.11.131.254:33829
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9156
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.193
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:37:59.969070 9156 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:37:59.970094 9156 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:37:59.980736 9163 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:37:59.980870 9156 server_base.cc:1034] running on GCE node
W20260808 14:37:59.980751 9164 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:37:59.980755 9166 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:37:59.981467 9156 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:37:59.982143 9156 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:37:59.983350 9156 hybrid_clock.cc:648] HybridClock initialized: now 1786199879983332 us; error 27 us; skew 500 ppm
Aug 08 14:37:59 dist-test-slave-twwt krb5kdc[8987](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199879, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:37:59.986178 9156 init.cc:377] Logged in from keytab as kudu/127.11.131.193@KRBTEST.COM (short username kudu)
I20260808 14:37:59.987131 9156 webserver.cc:460] Webserver started at http://127.11.131.193:41949/ using document root <none> and password file <none>
I20260808 14:37:59.987715 9156 fs_manager.cc:359] Metadata directory not provided
I20260808 14:37:59.987808 9156 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:37:59.988051 9156 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:37:59.990198 9156 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/ts-0/data/instance:
uuid: "a5eba0a96de24afb8370b557327d6b05"
format_stamp: "Formatted at 2026-08-08 14:37:59 on dist-test-slave-twwt"
server_key: "af8ccb8b30699651c54cdb4f7e50b663"
server_key_iv: "775aec5da433823f33f79e22170cdedf"
server_key_version: "encryptionkey@0"
I20260808 14:37:59.990864 9156 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/ts-0/wal/instance:
uuid: "a5eba0a96de24afb8370b557327d6b05"
format_stamp: "Formatted at 2026-08-08 14:37:59 on dist-test-slave-twwt"
server_key: "af8ccb8b30699651c54cdb4f7e50b663"
server_key_iv: "775aec5da433823f33f79e22170cdedf"
server_key_version: "encryptionkey@0"
I20260808 14:37:59.995078 9156 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 14:37:59.997591 9174 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:37:59.998903 9156 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 14:37:59.999063 9156 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/ts-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/ts-0/wal
uuid: "a5eba0a96de24afb8370b557327d6b05"
format_stamp: "Formatted at 2026-08-08 14:37:59 on dist-test-slave-twwt"
server_key: "af8ccb8b30699651c54cdb4f7e50b663"
server_key_iv: "775aec5da433823f33f79e22170cdedf"
server_key_version: "encryptionkey@0"
I20260808 14:37:59.999209 9156 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:00.014950 9156 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:00.018735 9156 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:00.018966 9156 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:00.019749 9156 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:38:00.020704 9156 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:38:00.020782 9156 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:00.020862 9156 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:38:00.020907 9156 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:00.030751 9156 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.193:34613
I20260808 14:38:00.030829 9345 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.193:34613 every 8 connection(s)
I20260808 14:38:00.031927 9156 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
I20260808 14:38:00.040030 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 9156
I20260808 14:38:00.040187 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/ts-0/wal/instance
I20260808 14:38:00.040575 11791 external_mini_cluster.cc:1428] Setting key 85a6e1a11a43bc7bef66f165547a9c49
Aug 08 14:38:00 dist-test-slave-twwt krb5kdc[8987](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199879, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.193@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:38:00.047739 9114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:00.034034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:53737 (local address 127.11.131.254:33829)
0808 14:38:00.034196 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:00.034200 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:00.035109 (+ 909us) server_negotiation.cc:407] Connection header received
0808 14:38:00.036540 (+ 1431us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:00.036543 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:00.036602 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:00.036685 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:00.037936 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:00.038480 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:00.039690 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:00.040102 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:00.040226 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:00.043337 (+ 3111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:00.043344 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:00.043350 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:00.043386 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:00.045128 (+ 1742us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:00.045812 (+ 684us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:00.045814 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:00.045843 (+ 29us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:00.045920 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:00.046371 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:00.046374 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:00.046375 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:00.046555 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:00.046686 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:00.047285 (+ 599us) server_negotiation.cc:299] Negotiation successful
0808 14:38:00.047458 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 14:38:00.048501 9349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:00.034419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:33829 (local address 127.11.131.193:53737)
0808 14:38:00.034950 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:00.034997 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:00.036307 (+ 1310us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:00.036866 (+ 559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:00.036874 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:00.037233 (+ 359us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:38:00.037764 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:00.037788 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:00.038640 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:00.038643 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:00.039557 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:00.039567 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:00.040353 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:00.040358 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:00.040534 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:00.041248 (+ 714us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:38:00.041271 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:38:00.043155 (+ 1884us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:38:00.045253 (+ 2098us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:00.045263 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:00.045293 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:00.045698 (+ 405us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:00.046018 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:00.046023 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:00.046026 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:00.046238 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:00.046686 (+ 448us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:38:00.046692 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:38:00.046999 (+ 307us) client_negotiation.cc:769] Sending connection context
0808 14:38:00.047207 (+ 208us) client_negotiation.cc:240] Negotiation successful
0808 14:38:00.047508 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":176,"threads_started":1}
I20260808 14:38:00.049783 9346 heartbeater.cc:347] Connected to a master server at 127.11.131.254:33829
I20260808 14:38:00.050086 9346 heartbeater.cc:464] Registering TS with master...
I20260808 14:38:00.050818 9346 heartbeater.cc:511] Master 127.11.131.254:33829 requested a full tablet report, sending...
I20260808 14:38:00.052575 9049 ts_manager.cc:194] Registered new tserver with Master: a5eba0a96de24afb8370b557327d6b05 (127.11.131.193:34613)
WARNING: no policy specified for kudu/127.11.131.194@KRBTEST.COM; defaulting to no policy
I20260808 14:38:00.053815 9049 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.193@KRBTEST.COM'} at 127.11.131.193:53737
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab.
Entry for principal kudu/127.11.131.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab.
I20260808 14:38:00.073642 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.194:0
--local_ip_for_outbound_sockets=127.11.131.194
--webserver_interface=127.11.131.194
--webserver_port=0
--tserver_master_addrs=127.11.131.254:33829
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab
--principal=kudu/127.11.131.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:36703
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:38:00.193543 9353 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:00.193853 9353 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:00.193946 9353 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:00.198047 9353 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:00.198107 9353 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:00.198199 9353 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.194
I20260808 14:38:00.203847 9353 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:36703
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.194.keytab
--principal=kudu/127.11.131.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.131.194
--webserver_port=0
--tserver_master_addrs=127.11.131.254:33829
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9353
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.194
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:38:00.204968 9353 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:00.206065 9353 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:00.216347 9360 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:00.216372 9362 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:00.216358 9366 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:00.216600 9353 server_base.cc:1034] running on GCE node
I20260808 14:38:00.217109 9353 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:00.217751 9353 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:00.218915 9353 hybrid_clock.cc:648] HybridClock initialized: now 1786199880218899 us; error 27 us; skew 500 ppm
Aug 08 14:38:00 dist-test-slave-twwt krb5kdc[8987](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199880, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:00.221913 9353 init.cc:377] Logged in from keytab as kudu/127.11.131.194@KRBTEST.COM (short username kudu)
I20260808 14:38:00.223047 9353 webserver.cc:460] Webserver started at http://127.11.131.194:33701/ using document root <none> and password file <none>
I20260808 14:38:00.223651 9353 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:00.223716 9353 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:00.223994 9353 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:38:00.226184 9353 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/ts-1/data/instance:
uuid: "5c9ba770d7234b43bace0523acb8ea89"
format_stamp: "Formatted at 2026-08-08 14:38:00 on dist-test-slave-twwt"
server_key: "252dc73edaa1cb64a904862dcad999cd"
server_key_iv: "b167f4910e1be87a8b59392d1736571d"
server_key_version: "encryptionkey@0"
I20260808 14:38:00.226845 9353 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/ts-1/wal/instance:
uuid: "5c9ba770d7234b43bace0523acb8ea89"
format_stamp: "Formatted at 2026-08-08 14:38:00 on dist-test-slave-twwt"
server_key: "252dc73edaa1cb64a904862dcad999cd"
server_key_iv: "b167f4910e1be87a8b59392d1736571d"
server_key_version: "encryptionkey@0"
I20260808 14:38:00.230762 9353 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 14:38:00.233278 9379 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:00.234539 9353 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 14:38:00.234707 9353 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/ts-1/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/ts-1/wal
uuid: "5c9ba770d7234b43bace0523acb8ea89"
format_stamp: "Formatted at 2026-08-08 14:38:00 on dist-test-slave-twwt"
server_key: "252dc73edaa1cb64a904862dcad999cd"
server_key_iv: "b167f4910e1be87a8b59392d1736571d"
server_key_version: "encryptionkey@0"
I20260808 14:38:00.234838 9353 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:00.249701 9353 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:00.253006 9353 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:00.253233 9353 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:00.253876 9353 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:38:00.254817 9353 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:38:00.254887 9353 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:00.254979 9353 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:38:00.255030 9353 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:00.264776 9353 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.194:33689
I20260808 14:38:00.264806 9555 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.194:33689 every 8 connection(s)
I20260808 14:38:00.265754 9353 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
I20260808 14:38:00.272058 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 9353
I20260808 14:38:00.272217 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/ts-1/wal/instance
I20260808 14:38:00.272590 11791 external_mini_cluster.cc:1428] Setting key 0f07ed14f08be14e832eac07e0f3b3e7
Aug 08 14:38:00 dist-test-slave-twwt krb5kdc[8987](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199880, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.194@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:38:00.281159 9114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:00.267720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:57169 (local address 127.11.131.254:33829)
0808 14:38:00.267893 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:00.267898 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:00.268751 (+ 853us) server_negotiation.cc:407] Connection header received
0808 14:38:00.270094 (+ 1343us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:00.270097 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:00.270145 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:00.270221 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:00.271623 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:00.272265 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:00.273767 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:00.274101 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:00.274212 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:00.277275 (+ 3063us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:00.277279 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:00.277282 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:00.277316 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:00.278994 (+ 1678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:00.279550 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:00.279554 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:00.279556 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:00.279647 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:00.280012 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:00.280017 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:00.280019 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:00.280214 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:00.280324 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:00.280839 (+ 515us) server_negotiation.cc:299] Negotiation successful
0808 14:38:00.280977 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 14:38:00.281987 9561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:00.268134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:33829 (local address 127.11.131.194:57169)
0808 14:38:00.268592 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:00.268636 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:00.269893 (+ 1257us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:00.270407 (+ 514us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:00.270414 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:00.270845 (+ 431us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:38:00.271462 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:00.271477 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:00.272442 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:00.272447 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:00.273639 (+ 1192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:00.273650 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:00.274280 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:00.274285 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:00.274485 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:00.275200 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:38:00.275226 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:38:00.277107 (+ 1881us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:38:00.279135 (+ 2028us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:00.279141 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:00.279157 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:00.279442 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:00.279746 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:00.279750 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:00.279752 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:00.279909 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:00.280323 (+ 414us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:38:00.280330 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:38:00.280598 (+ 268us) client_negotiation.cc:769] Sending connection context
0808 14:38:00.280798 (+ 200us) client_negotiation.cc:240] Negotiation successful
0808 14:38:00.281147 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":121,"threads_started":1}
I20260808 14:38:00.283275 9556 heartbeater.cc:347] Connected to a master server at 127.11.131.254:33829
I20260808 14:38:00.283555 9556 heartbeater.cc:464] Registering TS with master...
I20260808 14:38:00.284091 9556 heartbeater.cc:511] Master 127.11.131.254:33829 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.11.131.195@KRBTEST.COM; defaulting to no policy
I20260808 14:38:00.285229 9049 ts_manager.cc:194] Registered new tserver with Master: 5c9ba770d7234b43bace0523acb8ea89 (127.11.131.194:33689)
I20260808 14:38:00.285832 9049 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.194@KRBTEST.COM'} at 127.11.131.194:57169
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab.
Entry for principal kudu/127.11.131.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab.
I20260808 14:38:00.307092 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.195:0
--local_ip_for_outbound_sockets=127.11.131.195
--webserver_interface=127.11.131.195
--webserver_port=0
--tserver_master_addrs=127.11.131.254:33829
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab
--principal=kudu/127.11.131.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:36703
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:38:00.429859 9564 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:00.430116 9564 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:00.430158 9564 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:00.434561 9564 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:00.434643 9564 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:00.434705 9564 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.195
I20260808 14:38:00.440126 9564 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:36703
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.195.keytab
--principal=kudu/127.11.131.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.131.195
--webserver_port=0
--tserver_master_addrs=127.11.131.254:33829
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9564
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.195
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:38:00.441144 9564 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:00.442198 9564 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:00.452649 9574 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:00.452679 9579 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:00.452806 9564 server_base.cc:1034] running on GCE node
W20260808 14:38:00.452723 9573 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:00.453413 9564 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:00.454098 9564 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:00.455288 9564 hybrid_clock.cc:648] HybridClock initialized: now 1786199880455271 us; error 26 us; skew 500 ppm
Aug 08 14:38:00 dist-test-slave-twwt krb5kdc[8987](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199880, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:00.458077 9564 init.cc:377] Logged in from keytab as kudu/127.11.131.195@KRBTEST.COM (short username kudu)
I20260808 14:38:00.459086 9564 webserver.cc:460] Webserver started at http://127.11.131.195:41119/ using document root <none> and password file <none>
I20260808 14:38:00.459743 9564 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:00.459836 9564 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:00.460059 9564 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:38:00.462126 9564 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/ts-2/data/instance:
uuid: "ef80d67733f342a7b49b5bcdd28facf1"
format_stamp: "Formatted at 2026-08-08 14:38:00 on dist-test-slave-twwt"
server_key: "5fa90527712527d7c6d97217b0e74daf"
server_key_iv: "f6325889f573319f83e2968b6b16f3a8"
server_key_version: "encryptionkey@0"
I20260808 14:38:00.462777 9564 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/ts-2/wal/instance:
uuid: "ef80d67733f342a7b49b5bcdd28facf1"
format_stamp: "Formatted at 2026-08-08 14:38:00 on dist-test-slave-twwt"
server_key: "5fa90527712527d7c6d97217b0e74daf"
server_key_iv: "f6325889f573319f83e2968b6b16f3a8"
server_key_version: "encryptionkey@0"
I20260808 14:38:00.466557 9564 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:38:00.468933 9592 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:00.470197 9564 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 14:38:00.470345 9564 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/ts-2/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/ts-2/wal
uuid: "ef80d67733f342a7b49b5bcdd28facf1"
format_stamp: "Formatted at 2026-08-08 14:38:00 on dist-test-slave-twwt"
server_key: "5fa90527712527d7c6d97217b0e74daf"
server_key_iv: "f6325889f573319f83e2968b6b16f3a8"
server_key_version: "encryptionkey@0"
I20260808 14:38:00.470460 9564 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:00.495621 9564 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:00.498873 9564 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:00.499089 9564 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:00.499795 9564 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:38:00.500679 9564 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:38:00.500751 9564 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:00.500821 9564 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:38:00.500872 9564 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:00.510442 9564 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.195:36879
I20260808 14:38:00.510478 9766 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.195:36879 every 8 connection(s)
I20260808 14:38:00.511505 9564 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
I20260808 14:38:00.515810 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 9564
I20260808 14:38:00.515987 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/ts-2/wal/instance
I20260808 14:38:00.516283 11791 external_mini_cluster.cc:1428] Setting key 75832f0d5b0f0dfdecf3583d9acd6785
Aug 08 14:38:00 dist-test-slave-twwt krb5kdc[8987](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199880, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.195@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:38:00.526161 9114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:00.513367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:42195 (local address 127.11.131.254:33829)
0808 14:38:00.513513 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:00.513516 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:00.514322 (+ 806us) server_negotiation.cc:407] Connection header received
0808 14:38:00.515785 (+ 1463us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:00.515789 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:00.515852 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:00.515963 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:00.517581 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:00.518120 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:00.519464 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:00.519692 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:00.519807 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:00.522399 (+ 2592us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:00.522403 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:00.522407 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:00.522438 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:00.523998 (+ 1560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:00.524526 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:00.524531 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:00.524532 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:00.524640 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:00.525031 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:00.525036 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:00.525037 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:00.525235 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:00.525346 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:00.525864 (+ 518us) server_negotiation.cc:299] Negotiation successful
0808 14:38:00.525995 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 14:38:00.527098 9771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:00.513688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:33829 (local address 127.11.131.195:42195)
0808 14:38:00.514146 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:00.514190 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:00.515554 (+ 1364us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:00.516153 (+ 599us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:00.516161 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:00.516591 (+ 430us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:38:00.517429 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:00.517447 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:00.518254 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:00.518259 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:00.519330 (+ 1071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:00.519340 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:00.519849 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:00.519853 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:00.520047 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:00.520676 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:38:00.520693 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:38:00.522232 (+ 1539us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:38:00.524127 (+ 1895us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:00.524133 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:00.524149 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:00.524415 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:00.524786 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:00.524790 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:00.524792 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:00.524929 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:00.525347 (+ 418us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:38:00.525354 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:38:00.525620 (+ 266us) client_negotiation.cc:769] Sending connection context
0808 14:38:00.525822 (+ 202us) client_negotiation.cc:240] Negotiation successful
0808 14:38:00.526166 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":114,"threads_started":1}
I20260808 14:38:00.528330 9767 heartbeater.cc:347] Connected to a master server at 127.11.131.254:33829
I20260808 14:38:00.528568 9767 heartbeater.cc:464] Registering TS with master...
I20260808 14:38:00.529127 9767 heartbeater.cc:511] Master 127.11.131.254:33829 requested a full tablet report, sending...
I20260808 14:38:00.530293 9051 ts_manager.cc:194] Registered new tserver with Master: ef80d67733f342a7b49b5bcdd28facf1 (127.11.131.195:36879)
I20260808 14:38:00.530952 9051 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.131.195@KRBTEST.COM'} at 127.11.131.195:42195
I20260808 14:38:00.542282 11791 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:38:00.551689 9114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:00.544344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59166 (local address 127.11.131.254:33829)
0808 14:38:00.544473 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:00.544476 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:00.544617 (+ 141us) server_negotiation.cc:407] Connection header received
0808 14:38:00.544724 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:00.544726 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:00.544765 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:00.544832 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:00.545530 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:00.546050 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:00.546933 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:00.547151 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:00.547257 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:00.548614 (+ 1357us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:00.548618 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:00.548620 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:00.548644 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:00.550167 (+ 1523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:00.550557 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:00.550560 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:00.550561 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:00.550698 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:00.550956 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:00.550958 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:00.550959 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:00.551173 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:00.551290 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:00.551461 (+ 171us) server_negotiation.cc:299] Negotiation successful
0808 14:38:00.551566 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 14:38:00.555171 9051 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59166:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:38:00.558454 9051 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:38:00.573858 9793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:00.567720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:34613 (local address 127.0.0.1:43180)
0808 14:38:00.568415 (+ 695us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:00.568428 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:00.568515 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:00.569621 (+ 1106us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:00.569623 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:00.569642 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:38:00.569728 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:00.569733 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:00.571152 (+ 1419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:00.571155 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:00.572337 (+ 1182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:00.572345 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:00.573241 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:00.573245 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:00.573362 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:00.573409 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 14:38:00.573549 (+ 140us) client_negotiation.cc:240] Negotiation successful
0808 14:38:00.573679 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":616,"mutex_wait_us":51,"thread_start_us":101,"threads_started":1}
I20260808 14:38:00.573904 9792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:00.567667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.195:36879 (local address 127.0.0.1:44628)
0808 14:38:00.568043 (+ 376us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:00.568091 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:00.568216 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:00.569283 (+ 1067us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:00.569291 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:00.569317 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:38:00.569468 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:00.569476 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:00.570783 (+ 1307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:00.570786 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:00.572185 (+ 1399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:00.572196 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:00.573548 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:00.573551 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:00.573634 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:00.573662 (+ 28us) client_negotiation.cc:769] Sending connection context
0808 14:38:00.573720 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 14:38:00.573786 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":201,"mutex_wait_us":30,"thread_start_us":120,"threads_started":1}
I20260808 14:38:00.574043 9794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:00.567805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44628 (local address 127.11.131.195:36879)
0808 14:38:00.568557 (+ 752us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:00.568572 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:00.568598 (+ 26us) server_negotiation.cc:407] Connection header received
0808 14:38:00.568684 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:00.568690 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:00.568921 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:00.569082 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:38:00.569611 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:00.570591 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:00.572330 (+ 1739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:00.573399 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:00.573552 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:00.573717 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:00.573785 (+ 68us) server_negotiation.cc:299] Negotiation successful
0808 14:38:00.573886 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":642,"thread_start_us":185,"threads_started":1}
I20260808 14:38:00.574579 9799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:00.568529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43180 (local address 127.11.131.193:34613)
0808 14:38:00.569181 (+ 652us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:00.569188 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:00.569211 (+ 23us) server_negotiation.cc:407] Connection header received
0808 14:38:00.569292 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:00.569297 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:00.569494 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:00.569649 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:38:00.569870 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:00.571029 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:00.572458 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:00.573111 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:00.573254 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:00.573402 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:00.574304 (+ 902us) server_negotiation.cc:299] Negotiation successful
0808 14:38:00.574426 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":537,"thread_start_us":100,"threads_started":1}
I20260808 14:38:00.574885 9797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:00.568498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.194:33689 (local address 127.0.0.1:51782)
0808 14:38:00.568763 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:00.568813 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:00.568897 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:00.569896 (+ 999us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:00.569899 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:00.569916 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:38:00.570014 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:00.570019 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:00.571359 (+ 1340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:00.571362 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:00.572470 (+ 1108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:00.572483 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:00.574348 (+ 1865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:00.574357 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:00.574475 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:00.574504 (+ 29us) client_negotiation.cc:769] Sending connection context
0808 14:38:00.574613 (+ 109us) client_negotiation.cc:240] Negotiation successful
0808 14:38:00.574754 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":206,"mutex_wait_us":25,"thread_start_us":115,"threads_started":1}
I20260808 14:38:00.574934 9801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:00.568954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51782 (local address 127.11.131.194:33689)
0808 14:38:00.569481 (+ 527us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:00.569492 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:00.569512 (+ 20us) server_negotiation.cc:407] Connection header received
0808 14:38:00.569588 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:00.569596 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:00.569761 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:00.569930 (+ 169us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:38:00.570132 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:00.571219 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:00.572609 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:00.573658 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:00.573787 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:00.573906 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:00.574694 (+ 788us) server_negotiation.cc:299] Negotiation successful
0808 14:38:00.574799 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":435,"thread_start_us":159,"threads_started":1}
I20260808 14:38:00.577711 9249 tablet_service.cc:1467] Processing CreateTablet for tablet 0506176d652842f38b77f1d86fa6ad4b (DEFAULT_TABLE table=test-table [id=8aaba6ca6f2f43cb91e95055fd1202ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:38:00.577705 9666 tablet_service.cc:1467] Processing CreateTablet for tablet 0506176d652842f38b77f1d86fa6ad4b (DEFAULT_TABLE table=test-table [id=8aaba6ca6f2f43cb91e95055fd1202ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:38:00.579006 9666 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0506176d652842f38b77f1d86fa6ad4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:38:00.579006 9249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0506176d652842f38b77f1d86fa6ad4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:38:00.585184 9465 tablet_service.cc:1467] Processing CreateTablet for tablet 0506176d652842f38b77f1d86fa6ad4b (DEFAULT_TABLE table=test-table [id=8aaba6ca6f2f43cb91e95055fd1202ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:38:00.586432 9465 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0506176d652842f38b77f1d86fa6ad4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:38:00.587260 9802 tablet_bootstrap.cc:492] T 0506176d652842f38b77f1d86fa6ad4b P a5eba0a96de24afb8370b557327d6b05: Bootstrap starting.
I20260808 14:38:00.589823 9802 tablet_bootstrap.cc:654] T 0506176d652842f38b77f1d86fa6ad4b P a5eba0a96de24afb8370b557327d6b05: Neither blocks nor log segments found. Creating new log.
I20260808 14:38:00.590857 9802 log.cc:824] T 0506176d652842f38b77f1d86fa6ad4b P a5eba0a96de24afb8370b557327d6b05: Log is configured to *not* fsync() on all Append() calls
I20260808 14:38:00.591310 9804 tablet_bootstrap.cc:492] T 0506176d652842f38b77f1d86fa6ad4b P ef80d67733f342a7b49b5bcdd28facf1: Bootstrap starting.
I20260808 14:38:00.592972 9802 tablet_bootstrap.cc:492] T 0506176d652842f38b77f1d86fa6ad4b P a5eba0a96de24afb8370b557327d6b05: No bootstrap required, opened a new log
I20260808 14:38:00.593199 9802 ts_tablet_manager.cc:1397] T 0506176d652842f38b77f1d86fa6ad4b P a5eba0a96de24afb8370b557327d6b05: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260808 14:38:00.593633 9804 tablet_bootstrap.cc:654] T 0506176d652842f38b77f1d86fa6ad4b P ef80d67733f342a7b49b5bcdd28facf1: Neither blocks nor log segments found. Creating new log.
I20260808 14:38:00.594018 9807 tablet_bootstrap.cc:492] T 0506176d652842f38b77f1d86fa6ad4b P 5c9ba770d7234b43bace0523acb8ea89: Bootstrap starting.
I20260808 14:38:00.595055 9804 log.cc:824] T 0506176d652842f38b77f1d86fa6ad4b P ef80d67733f342a7b49b5bcdd28facf1: Log is configured to *not* fsync() on all Append() calls
I20260808 14:38:00.596253 9807 tablet_bootstrap.cc:654] T 0506176d652842f38b77f1d86fa6ad4b P 5c9ba770d7234b43bace0523acb8ea89: Neither blocks nor log segments found. Creating new log.
I20260808 14:38:00.597548 9807 log.cc:824] T 0506176d652842f38b77f1d86fa6ad4b P 5c9ba770d7234b43bace0523acb8ea89: Log is configured to *not* fsync() on all Append() calls
I20260808 14:38:00.597708 9804 tablet_bootstrap.cc:492] T 0506176d652842f38b77f1d86fa6ad4b P ef80d67733f342a7b49b5bcdd28facf1: No bootstrap required, opened a new log
I20260808 14:38:00.597494 9802 raft_consensus.cc:348] T 0506176d652842f38b77f1d86fa6ad4b P a5eba0a96de24afb8370b557327d6b05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef80d67733f342a7b49b5bcdd28facf1" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 36879 } } peers { permanent_uuid: "a5eba0a96de24afb8370b557327d6b05" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 34613 } } peers { permanent_uuid: "5c9ba770d7234b43bace0523acb8ea89" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 33689 } }
I20260808 14:38:00.597803 9802 raft_consensus.cc:374] T 0506176d652842f38b77f1d86fa6ad4b P a5eba0a96de24afb8370b557327d6b05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:38:00.597864 9802 raft_consensus.cc:729] T 0506176d652842f38b77f1d86fa6ad4b P a5eba0a96de24afb8370b557327d6b05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5eba0a96de24afb8370b557327d6b05, State: Initialized, Role: FOLLOWER
I20260808 14:38:00.597910 9804 ts_tablet_manager.cc:1397] T 0506176d652842f38b77f1d86fa6ad4b P ef80d67733f342a7b49b5bcdd28facf1: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260808 14:38:00.598373 9802 consensus_queue.cc:260] T 0506176d652842f38b77f1d86fa6ad4b P a5eba0a96de24afb8370b557327d6b05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef80d67733f342a7b49b5bcdd28facf1" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 36879 } } peers { permanent_uuid: "a5eba0a96de24afb8370b557327d6b05" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 34613 } } peers { permanent_uuid: "5c9ba770d7234b43bace0523acb8ea89" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 33689 } }
I20260808 14:38:00.599162 9346 heartbeater.cc:503] Master 127.11.131.254:33829 was elected leader, sending a full tablet report...
I20260808 14:38:00.599733 9807 tablet_bootstrap.cc:492] T 0506176d652842f38b77f1d86fa6ad4b P 5c9ba770d7234b43bace0523acb8ea89: No bootstrap required, opened a new log
I20260808 14:38:00.599931 9807 ts_tablet_manager.cc:1397] T 0506176d652842f38b77f1d86fa6ad4b P 5c9ba770d7234b43bace0523acb8ea89: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 14:38:00.600652 9802 ts_tablet_manager.cc:1428] T 0506176d652842f38b77f1d86fa6ad4b P a5eba0a96de24afb8370b557327d6b05: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260808 14:38:00.600979 9812 raft_consensus.cc:482] T 0506176d652842f38b77f1d86fa6ad4b P a5eba0a96de24afb8370b557327d6b05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:38:00.601155 9812 raft_consensus.cc:504] T 0506176d652842f38b77f1d86fa6ad4b P a5eba0a96de24afb8370b557327d6b05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef80d67733f342a7b49b5bcdd28facf1" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 36879 } } peers { permanent_uuid: "a5eba0a96de24afb8370b557327d6b05" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 34613 } } peers { permanent_uuid: "5c9ba770d7234b43bace0523acb8ea89" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 33689 } }
I20260808 14:38:00.601864 9804 raft_consensus.cc:348] T 0506176d652842f38b77f1d86fa6ad4b P ef80d67733f342a7b49b5bcdd28facf1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef80d67733f342a7b49b5bcdd28facf1" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 36879 } } peers { permanent_uuid: "a5eba0a96de24afb8370b557327d6b05" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 34613 } } peers { permanent_uuid: "5c9ba770d7234b43bace0523acb8ea89" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 33689 } }
I20260808 14:38:00.602159 9804 raft_consensus.cc:374] T 0506176d652842f38b77f1d86fa6ad4b P ef80d67733f342a7b49b5bcdd28facf1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:38:00.602229 9804 raft_consensus.cc:729] T 0506176d652842f38b77f1d86fa6ad4b P ef80d67733f342a7b49b5bcdd28facf1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef80d67733f342a7b49b5bcdd28facf1, State: Initialized, Role: FOLLOWER
I20260808 14:38:00.602694 9804 consensus_queue.cc:260] T 0506176d652842f38b77f1d86fa6ad4b P ef80d67733f342a7b49b5bcdd28facf1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef80d67733f342a7b49b5bcdd28facf1" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 36879 } } peers { permanent_uuid: "a5eba0a96de24afb8370b557327d6b05" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 34613 } } peers { permanent_uuid: "5c9ba770d7234b43bace0523acb8ea89" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 33689 } }
I20260808 14:38:00.603876 9812 leader_election.cc:288] T 0506176d652842f38b77f1d86fa6ad4b P a5eba0a96de24afb8370b557327d6b05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef80d67733f342a7b49b5bcdd28facf1 (127.11.131.195:36879), 5c9ba770d7234b43bace0523acb8ea89 (127.11.131.194:33689)
I20260808 14:38:00.603960 9804 ts_tablet_manager.cc:1428] T 0506176d652842f38b77f1d86fa6ad4b P ef80d67733f342a7b49b5bcdd28facf1: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 14:38:00.603916 9807 raft_consensus.cc:348] T 0506176d652842f38b77f1d86fa6ad4b P 5c9ba770d7234b43bace0523acb8ea89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef80d67733f342a7b49b5bcdd28facf1" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 36879 } } peers { permanent_uuid: "a5eba0a96de24afb8370b557327d6b05" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 34613 } } peers { permanent_uuid: "5c9ba770d7234b43bace0523acb8ea89" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 33689 } }
I20260808 14:38:00.604192 9807 raft_consensus.cc:374] T 0506176d652842f38b77f1d86fa6ad4b P 5c9ba770d7234b43bace0523acb8ea89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:38:00.604259 9807 raft_consensus.cc:729] T 0506176d652842f38b77f1d86fa6ad4b P 5c9ba770d7234b43bace0523acb8ea89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c9ba770d7234b43bace0523acb8ea89, State: Initialized, Role: FOLLOWER
I20260808 14:38:00.604317 9767 heartbeater.cc:503] Master 127.11.131.254:33829 was elected leader, sending a full tablet report...
I20260808 14:38:00.604652 9807 consensus_queue.cc:260] T 0506176d652842f38b77f1d86fa6ad4b P 5c9ba770d7234b43bace0523acb8ea89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef80d67733f342a7b49b5bcdd28facf1" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 36879 } } peers { permanent_uuid: "a5eba0a96de24afb8370b557327d6b05" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 34613 } } peers { permanent_uuid: "5c9ba770d7234b43bace0523acb8ea89" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 33689 } }
I20260808 14:38:00.605306 9556 heartbeater.cc:503] Master 127.11.131.254:33829 was elected leader, sending a full tablet report...
I20260808 14:38:00.606045 9807 ts_tablet_manager.cc:1428] T 0506176d652842f38b77f1d86fa6ad4b P 5c9ba770d7234b43bace0523acb8ea89: Time spent starting tablet: real 0.006s user 0.003s sys 0.004s
I20260808 14:38:00.609566 9794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:00.602856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:35241 (local address 127.11.131.195:36879)
0808 14:38:00.602983 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:00.602988 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:00.605559 (+ 2571us) server_negotiation.cc:407] Connection header received
0808 14:38:00.605755 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:00.605758 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:00.605805 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:00.605854 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:38:00.606326 (+ 472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:00.607032 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:00.608323 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:00.608938 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:00.609071 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:00.609125 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:00.609374 (+ 249us) server_negotiation.cc:299] Negotiation successful
0808 14:38:00.609444 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 14:38:00.609601 9816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:00.602771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.195:36879 (local address 127.11.131.193:35241)
0808 14:38:00.605466 (+ 2695us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:00.605482 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:00.605632 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:00.606020 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:00.606023 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:00.606041 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:38:00.606180 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:00.606187 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:00.607180 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:00.607187 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:00.608187 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:00.608197 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:00.609065 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:00.609069 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:00.609188 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:00.609249 (+ 61us) client_negotiation.cc:769] Sending connection context
0808 14:38:00.609354 (+ 105us) client_negotiation.cc:240] Negotiation successful
0808 14:38:00.609429 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2624,"mutex_wait_us":42,"thread_start_us":91,"threads_started":1}
I20260808 14:38:00.610677 9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0506176d652842f38b77f1d86fa6ad4b" candidate_uuid: "a5eba0a96de24afb8370b557327d6b05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef80d67733f342a7b49b5bcdd28facf1" is_pre_election: true
I20260808 14:38:00.610961 9702 raft_consensus.cc:2454] T 0506176d652842f38b77f1d86fa6ad4b P ef80d67733f342a7b49b5bcdd28facf1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5eba0a96de24afb8370b557327d6b05 in term 0.
I20260808 14:38:00.611537 9176 leader_election.cc:302] T 0506176d652842f38b77f1d86fa6ad4b P a5eba0a96de24afb8370b557327d6b05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5eba0a96de24afb8370b557327d6b05, ef80d67733f342a7b49b5bcdd28facf1; no voters:
I20260808 14:38:00.611832 9812 raft_consensus.cc:2781] T 0506176d652842f38b77f1d86fa6ad4b P a5eba0a96de24afb8370b557327d6b05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:38:00.611933 9812 raft_consensus.cc:482] T 0506176d652842f38b77f1d86fa6ad4b P a5eba0a96de24afb8370b557327d6b05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:38:00.611994 9812 raft_consensus.cc:3037] T 0506176d652842f38b77f1d86fa6ad4b P a5eba0a96de24afb8370b557327d6b05 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:38:00.612663 9801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:00.603734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:42013 (local address 127.11.131.194:33689)
0808 14:38:00.603843 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:00.603847 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:00.608504 (+ 4657us) server_negotiation.cc:407] Connection header received
0808 14:38:00.608843 (+ 339us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:00.608846 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:00.608896 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:00.608947 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:38:00.609438 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:00.610128 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:00.611559 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:00.612157 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:00.612258 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:00.612299 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:00.612515 (+ 216us) server_negotiation.cc:299] Negotiation successful
0808 14:38:00.612574 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 14:38:00.612967 9813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:00.603257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.194:33689 (local address 127.11.131.193:42013)
0808 14:38:00.608415 (+ 5158us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:00.608426 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:00.608534 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:00.609116 (+ 582us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:00.609119 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:00.609137 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:38:00.609308 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:00.609316 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:00.610449 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:00.610451 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:00.611424 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:00.611434 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:00.612278 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:00.612282 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:00.612385 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:00.612411 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 14:38:00.612491 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 14:38:00.612560 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5101,"mutex_wait_us":1,"thread_start_us":125,"threads_started":1}
I20260808 14:38:00.613481 9812 raft_consensus.cc:504] T 0506176d652842f38b77f1d86fa6ad4b P a5eba0a96de24afb8370b557327d6b05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef80d67733f342a7b49b5bcdd28facf1" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 36879 } } peers { permanent_uuid: "a5eba0a96de24afb8370b557327d6b05" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 34613 } } peers { permanent_uuid: "5c9ba770d7234b43bace0523acb8ea89" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 33689 } }
I20260808 14:38:00.613552 9489 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0506176d652842f38b77f1d86fa6ad4b" candidate_uuid: "a5eba0a96de24afb8370b557327d6b05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c9ba770d7234b43bace0523acb8ea89" is_pre_election: true
I20260808 14:38:00.613811 9489 raft_consensus.cc:2454] T 0506176d652842f38b77f1d86fa6ad4b P 5c9ba770d7234b43bace0523acb8ea89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5eba0a96de24afb8370b557327d6b05 in term 0.
I20260808 14:38:00.614019 9812 leader_election.cc:288] T 0506176d652842f38b77f1d86fa6ad4b P a5eba0a96de24afb8370b557327d6b05 [CANDIDATE]: Term 1 election: Requested vote from peers ef80d67733f342a7b49b5bcdd28facf1 (127.11.131.195:36879), 5c9ba770d7234b43bace0523acb8ea89 (127.11.131.194:33689)
I20260808 14:38:00.614264 9489 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0506176d652842f38b77f1d86fa6ad4b" candidate_uuid: "a5eba0a96de24afb8370b557327d6b05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c9ba770d7234b43bace0523acb8ea89"
I20260808 14:38:00.614398 9489 raft_consensus.cc:3037] T 0506176d652842f38b77f1d86fa6ad4b P 5c9ba770d7234b43bace0523acb8ea89 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:38:00.614765 9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0506176d652842f38b77f1d86fa6ad4b" candidate_uuid: "a5eba0a96de24afb8370b557327d6b05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef80d67733f342a7b49b5bcdd28facf1"
I20260808 14:38:00.614897 9702 raft_consensus.cc:3037] T 0506176d652842f38b77f1d86fa6ad4b P ef80d67733f342a7b49b5bcdd28facf1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:38:00.615782 9489 raft_consensus.cc:2454] T 0506176d652842f38b77f1d86fa6ad4b P 5c9ba770d7234b43bace0523acb8ea89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5eba0a96de24afb8370b557327d6b05 in term 1.
I20260808 14:38:00.616113 9175 leader_election.cc:302] T 0506176d652842f38b77f1d86fa6ad4b P a5eba0a96de24afb8370b557327d6b05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c9ba770d7234b43bace0523acb8ea89, a5eba0a96de24afb8370b557327d6b05; no voters:
I20260808 14:38:00.616289 9812 raft_consensus.cc:2781] T 0506176d652842f38b77f1d86fa6ad4b P a5eba0a96de24afb8370b557327d6b05 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:38:00.616302 9702 raft_consensus.cc:2454] T 0506176d652842f38b77f1d86fa6ad4b P ef80d67733f342a7b49b5bcdd28facf1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5eba0a96de24afb8370b557327d6b05 in term 1.
I20260808 14:38:00.616580 9812 raft_consensus.cc:686] T 0506176d652842f38b77f1d86fa6ad4b P a5eba0a96de24afb8370b557327d6b05 [term 1 LEADER]: Becoming Leader. State: Replica: a5eba0a96de24afb8370b557327d6b05, State: Running, Role: LEADER
I20260808 14:38:00.616958 9812 consensus_queue.cc:237] T 0506176d652842f38b77f1d86fa6ad4b P a5eba0a96de24afb8370b557327d6b05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef80d67733f342a7b49b5bcdd28facf1" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 36879 } } peers { permanent_uuid: "a5eba0a96de24afb8370b557327d6b05" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 34613 } } peers { permanent_uuid: "5c9ba770d7234b43bace0523acb8ea89" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 33689 } }
I20260808 14:38:00.619729 9049 catalog_manager.cc:5495] T 0506176d652842f38b77f1d86fa6ad4b P a5eba0a96de24afb8370b557327d6b05 reported cstate change: term changed from 0 to 1, leader changed from <none> to a5eba0a96de24afb8370b557327d6b05 (127.11.131.193). New cstate: current_term: 1 leader_uuid: "a5eba0a96de24afb8370b557327d6b05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef80d67733f342a7b49b5bcdd28facf1" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 36879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5eba0a96de24afb8370b557327d6b05" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 34613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c9ba770d7234b43bace0523acb8ea89" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 33689 } health_report { overall_health: UNKNOWN } } }
I20260808 14:38:00.638065 9799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:00.634371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43192 (local address 127.11.131.193:34613)
0808 14:38:00.634520 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:00.634525 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:00.634541 (+ 16us) server_negotiation.cc:407] Connection header received
0808 14:38:00.634702 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:00.634704 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:00.634764 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:00.634881 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:38:00.635154 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:00.635668 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:00.636552 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:00.636767 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:00.636879 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:00.637200 (+ 321us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:38:00.637634 (+ 434us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:38:00.637769 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:00.637850 (+ 81us) server_negotiation.cc:299] Negotiation successful
0808 14:38:00.637908 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 14:38:00.644555 9702 raft_consensus.cc:1261] T 0506176d652842f38b77f1d86fa6ad4b P ef80d67733f342a7b49b5bcdd28facf1 [term 1 FOLLOWER]: Refusing update from remote peer a5eba0a96de24afb8370b557327d6b05: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:38:00.644556 9489 raft_consensus.cc:1261] T 0506176d652842f38b77f1d86fa6ad4b P 5c9ba770d7234b43bace0523acb8ea89 [term 1 FOLLOWER]: Refusing update from remote peer a5eba0a96de24afb8370b557327d6b05: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:38:00.645341 9819 consensus_queue.cc:1035] T 0506176d652842f38b77f1d86fa6ad4b P a5eba0a96de24afb8370b557327d6b05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef80d67733f342a7b49b5bcdd28facf1" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 36879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:38:00.645536 9812 consensus_queue.cc:1035] T 0506176d652842f38b77f1d86fa6ad4b P a5eba0a96de24afb8370b557327d6b05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c9ba770d7234b43bace0523acb8ea89" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 33689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:38:00.654309 9829 mvcc.cc:205] Tried to move back new op lower bound from 7316274711112314880 to 7316274711009488896. Current Snapshot: MvccSnapshot[applied={T|T < 7316274711112314880}]
I20260808 14:38:00.657203 9828 mvcc.cc:205] Tried to move back new op lower bound from 7316274711112314880 to 7316274711009488896. Current Snapshot: MvccSnapshot[applied={T|T < 7316274711112314880 or (T in {7316274711112314880})}]
I20260808 14:38:00.662211 9051 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59166:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:38:00.662417 9051 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59166:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:38:00.665179 9051 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1dfeac3e44ca41a5a9ed46388d2c4b8a: Sending DeleteTablet for 3 replicas of tablet 0506176d652842f38b77f1d86fa6ad4b
I20260808 14:38:00.666147 9249 tablet_service.cc:1514] Processing DeleteTablet for tablet 0506176d652842f38b77f1d86fa6ad4b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:38:00 UTC) from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:43180
I20260808 14:38:00.666177 9666 tablet_service.cc:1514] Processing DeleteTablet for tablet 0506176d652842f38b77f1d86fa6ad4b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:38:00 UTC) from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:44628
I20260808 14:38:00.666373 9465 tablet_service.cc:1514] Processing DeleteTablet for tablet 0506176d652842f38b77f1d86fa6ad4b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:38:00 UTC) from {username='kudu', principal='kudu/127.11.131.254@KRBTEST.COM'} at 127.0.0.1:51782
I20260808 14:38:00.666862 9848 tablet_replica.cc:330] T 0506176d652842f38b77f1d86fa6ad4b P 5c9ba770d7234b43bace0523acb8ea89: stopping tablet replica
I20260808 14:38:00.666954 9847 tablet_replica.cc:330] T 0506176d652842f38b77f1d86fa6ad4b P ef80d67733f342a7b49b5bcdd28facf1: stopping tablet replica
I20260808 14:38:00.667309 9847 raft_consensus.cc:2229] T 0506176d652842f38b77f1d86fa6ad4b P ef80d67733f342a7b49b5bcdd28facf1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:38:00.667325 9848 raft_consensus.cc:2229] T 0506176d652842f38b77f1d86fa6ad4b P 5c9ba770d7234b43bace0523acb8ea89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:38:00.667676 9847 raft_consensus.cc:2258] T 0506176d652842f38b77f1d86fa6ad4b P ef80d67733f342a7b49b5bcdd28facf1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:38:00.667763 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 9156
I20260808 14:38:00.672715 9847 ts_tablet_manager.cc:1905] T 0506176d652842f38b77f1d86fa6ad4b P ef80d67733f342a7b49b5bcdd28facf1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:38:00.675203 9848 raft_consensus.cc:2258] T 0506176d652842f38b77f1d86fa6ad4b P 5c9ba770d7234b43bace0523acb8ea89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:38:00.676060 9847 ts_tablet_manager.cc:1918] T 0506176d652842f38b77f1d86fa6ad4b P ef80d67733f342a7b49b5bcdd28facf1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:38:00.676174 9847 log.cc:1196] T 0506176d652842f38b77f1d86fa6ad4b P ef80d67733f342a7b49b5bcdd28facf1: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/ts-2/wal/wals/0506176d652842f38b77f1d86fa6ad4b
I20260808 14:38:00.676532 9847 ts_tablet_manager.cc:1939] T 0506176d652842f38b77f1d86fa6ad4b P ef80d67733f342a7b49b5bcdd28facf1: Deleting consensus metadata
I20260808 14:38:00.678159 9032 catalog_manager.cc:4841] TS ef80d67733f342a7b49b5bcdd28facf1 (127.11.131.195:36879): tablet 0506176d652842f38b77f1d86fa6ad4b (table test-table [id=8aaba6ca6f2f43cb91e95055fd1202ac]) successfully deleted
I20260808 14:38:00.678779 9848 ts_tablet_manager.cc:1905] T 0506176d652842f38b77f1d86fa6ad4b P 5c9ba770d7234b43bace0523acb8ea89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:38:00.681883 9848 ts_tablet_manager.cc:1918] T 0506176d652842f38b77f1d86fa6ad4b P 5c9ba770d7234b43bace0523acb8ea89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:38:00.681978 9848 log.cc:1196] T 0506176d652842f38b77f1d86fa6ad4b P 5c9ba770d7234b43bace0523acb8ea89: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786199615258783-11791-0/minicluster-data/ts-1/wal/wals/0506176d652842f38b77f1d86fa6ad4b
I20260808 14:38:00.682430 9848 ts_tablet_manager.cc:1939] T 0506176d652842f38b77f1d86fa6ad4b P 5c9ba770d7234b43bace0523acb8ea89: Deleting consensus metadata
I20260808 14:38:00.683696 9030 catalog_manager.cc:4841] TS 5c9ba770d7234b43bace0523acb8ea89 (127.11.131.194:33689): tablet 0506176d652842f38b77f1d86fa6ad4b (table test-table [id=8aaba6ca6f2f43cb91e95055fd1202ac]) successfully deleted
W20260808 14:38:00.686084 9035 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.131.193:34613 (error 108)
I20260808 14:38:00.687153 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 9353
I20260808 14:38:00.687407 9797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:00.687007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:34613 (local address 127.0.0.1:43208)
0808 14:38:00.687176 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:00.687291 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.193:34613: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260808 14:38:00.695390 9035 catalog_manager.cc:4584] TS a5eba0a96de24afb8370b557327d6b05 (127.11.131.193:34613): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0506176d652842f38b77f1d86fa6ad4b: Network error: Client connection negotiation failed: client connection to 127.11.131.193:34613: connect: Connection refused (error 111)
I20260808 14:38:00.704957 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 9564
I20260808 14:38:00.719959 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 9010
2026-08-08T14:38:00Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2553 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-08T14:38:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:38:00Z Disabled control of system clock
I20260808 14:38:00.764215 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:39867
--webserver_interface=127.11.131.254
--webserver_port=0
--builtin_ntp_servers=127.11.131.212:44509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:39867
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 14:38:00.881424 9858 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:00.881729 9858 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:00.881767 9858 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:00.885984 9858 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:38:00.886073 9858 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:00.886089 9858 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:00.886111 9858 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:38:00.886125 9858 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:38:00.891232 9858 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:44509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:39867
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:39867
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.131.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9858
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:38:00.892542 9858 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:00.894129 9858 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:00.902971 9868 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:00.903087 9858 server_base.cc:1034] running on GCE node
W20260808 14:38:00.902995 9867 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:00.902983 9871 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:00.903869 9858 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:00.904990 9858 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:00.906186 9858 hybrid_clock.cc:648] HybridClock initialized: now 1786199880906164 us; error 31 us; skew 500 ppm
I20260808 14:38:00.908193 9858 webserver.cc:460] Webserver started at http://127.11.131.254:40507/ using document root <none> and password file <none>
I20260808 14:38:00.908836 9858 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:00.908938 9858 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:00.909183 9858 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:38:00.911361 9858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/master-0/data/instance:
uuid: "b90d7a89255748468dbbbe59780a6b26"
format_stamp: "Formatted at 2026-08-08 14:38:00 on dist-test-slave-twwt"
server_key: "e2c18616d0525cff914e5f5d22358f94"
server_key_iv: "019ac560057521aa1d4807cf8812728f"
server_key_version: "encryptionkey@0"
I20260808 14:38:00.911948 9858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/master-0/wal/instance:
uuid: "b90d7a89255748468dbbbe59780a6b26"
format_stamp: "Formatted at 2026-08-08 14:38:00 on dist-test-slave-twwt"
server_key: "e2c18616d0525cff914e5f5d22358f94"
server_key_iv: "019ac560057521aa1d4807cf8812728f"
server_key_version: "encryptionkey@0"
I20260808 14:38:00.915735 9858 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 14:38:00.918135 9880 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:00.919597 9858 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 14:38:00.919765 9858 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "b90d7a89255748468dbbbe59780a6b26"
format_stamp: "Formatted at 2026-08-08 14:38:00 on dist-test-slave-twwt"
server_key: "e2c18616d0525cff914e5f5d22358f94"
server_key_iv: "019ac560057521aa1d4807cf8812728f"
server_key_version: "encryptionkey@0"
I20260808 14:38:00.919895 9858 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:00.930913 9858 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:00.931639 9858 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:00.931845 9858 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:00.939438 9858 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.254:39867
I20260808 14:38:00.939456 9976 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.254:39867 every 8 connection(s)
I20260808 14:38:00.940475 9858 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:38:00.941187 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 9858
I20260808 14:38:00.941383 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/master-0/wal/instance
I20260808 14:38:00.941817 11791 external_mini_cluster.cc:1428] Setting key c8ebac3cfa7876d5bb647577081fa5be
I20260808 14:38:00.944695 9977 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:38:00.951226 9977 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b90d7a89255748468dbbbe59780a6b26: Bootstrap starting.
I20260808 14:38:00.951843 9981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:00.943535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55228 (local address 127.11.131.254:39867)
0808 14:38:00.944269 (+ 734us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:00.944294 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:00.944331 (+ 37us) server_negotiation.cc:407] Connection header received
0808 14:38:00.945058 (+ 727us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:00.945078 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:00.945524 (+ 446us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:00.945880 (+ 356us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:00.946334 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:00.947419 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:00.948324 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:00.948806 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:00.948989 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:00.949922 (+ 933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:00.949927 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:00.949940 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:38:00.950401 (+ 461us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:00.950458 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:38:00.950478 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:00.950593 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:00.950734 (+ 141us) server_negotiation.cc:299] Negotiation successful
0808 14:38:00.951001 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":374,"thread_start_us":200,"threads_started":1}
I20260808 14:38:00.953739 9977 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b90d7a89255748468dbbbe59780a6b26: Neither blocks nor log segments found. Creating new log.
I20260808 14:38:00.954588 9977 log.cc:824] T 00000000000000000000000000000000 P b90d7a89255748468dbbbe59780a6b26: Log is configured to *not* fsync() on all Append() calls
I20260808 14:38:00.956638 9977 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b90d7a89255748468dbbbe59780a6b26: No bootstrap required, opened a new log
I20260808 14:38:00.960532 9977 raft_consensus.cc:348] T 00000000000000000000000000000000 P b90d7a89255748468dbbbe59780a6b26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b90d7a89255748468dbbbe59780a6b26" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 39867 } }
I20260808 14:38:00.960814 9977 raft_consensus.cc:374] T 00000000000000000000000000000000 P b90d7a89255748468dbbbe59780a6b26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:38:00.960888 9977 raft_consensus.cc:729] T 00000000000000000000000000000000 P b90d7a89255748468dbbbe59780a6b26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b90d7a89255748468dbbbe59780a6b26, State: Initialized, Role: FOLLOWER
I20260808 14:38:00.961378 9977 consensus_queue.cc:260] T 00000000000000000000000000000000 P b90d7a89255748468dbbbe59780a6b26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b90d7a89255748468dbbbe59780a6b26" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 39867 } }
I20260808 14:38:00.961517 9977 raft_consensus.cc:388] T 00000000000000000000000000000000 P b90d7a89255748468dbbbe59780a6b26 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:38:00.961620 9977 raft_consensus.cc:482] T 00000000000000000000000000000000 P b90d7a89255748468dbbbe59780a6b26 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:38:00.961752 9977 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b90d7a89255748468dbbbe59780a6b26 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:38:00.962833 9977 raft_consensus.cc:504] T 00000000000000000000000000000000 P b90d7a89255748468dbbbe59780a6b26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b90d7a89255748468dbbbe59780a6b26" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 39867 } }
I20260808 14:38:00.963227 9977 leader_election.cc:302] T 00000000000000000000000000000000 P b90d7a89255748468dbbbe59780a6b26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b90d7a89255748468dbbbe59780a6b26; no voters:
I20260808 14:38:00.963574 9977 leader_election.cc:288] T 00000000000000000000000000000000 P b90d7a89255748468dbbbe59780a6b26 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:38:00.963676 9985 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b90d7a89255748468dbbbe59780a6b26 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:38:00.963999 9985 raft_consensus.cc:686] T 00000000000000000000000000000000 P b90d7a89255748468dbbbe59780a6b26 [term 1 LEADER]: Becoming Leader. State: Replica: b90d7a89255748468dbbbe59780a6b26, State: Running, Role: LEADER
I20260808 14:38:00.964318 9985 consensus_queue.cc:237] T 00000000000000000000000000000000 P b90d7a89255748468dbbbe59780a6b26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b90d7a89255748468dbbbe59780a6b26" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 39867 } }
I20260808 14:38:00.965024 9977 sys_catalog.cc:564] T 00000000000000000000000000000000 P b90d7a89255748468dbbbe59780a6b26 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:38:00.966042 9986 sys_catalog.cc:455] T 00000000000000000000000000000000 P b90d7a89255748468dbbbe59780a6b26 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b90d7a89255748468dbbbe59780a6b26" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b90d7a89255748468dbbbe59780a6b26" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 39867 } } }
I20260808 14:38:00.966176 9986 sys_catalog.cc:458] T 00000000000000000000000000000000 P b90d7a89255748468dbbbe59780a6b26 [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:00.966562 9998 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:38:00.966528 9987 sys_catalog.cc:455] T 00000000000000000000000000000000 P b90d7a89255748468dbbbe59780a6b26 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b90d7a89255748468dbbbe59780a6b26. Latest consensus state: current_term: 1 leader_uuid: "b90d7a89255748468dbbbe59780a6b26" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b90d7a89255748468dbbbe59780a6b26" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 39867 } } }
I20260808 14:38:00.966758 9987 sys_catalog.cc:458] T 00000000000000000000000000000000 P b90d7a89255748468dbbbe59780a6b26 [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:00.969841 9998 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:38:00.976455 9998 catalog_manager.cc:1347] Generated new cluster ID: 8fd8d6897123430d8be419be0fe86b8a
I20260808 14:38:00.976554 9998 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:38:00.983337 9998 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:38:00.984290 9998 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:38:00.990792 9998 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b90d7a89255748468dbbbe59780a6b26: Generated new TSK 0
I20260808 14:38:00.991529 9998 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:38:01.000268 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.193:0
--local_ip_for_outbound_sockets=127.11.131.193
--webserver_interface=127.11.131.193
--webserver_port=0
--tserver_master_addrs=127.11.131.254:39867
--builtin_ntp_servers=127.11.131.212:44509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 14:38:01.121265 10014 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:01.121531 10014 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:01.121570 10014 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:01.125908 10014 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:01.125968 10014 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:01.126052 10014 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.193
I20260808 14:38:01.130980 10014 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:44509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.131.193
--webserver_port=0
--tserver_master_addrs=127.11.131.254:39867
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10014
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.193
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:38:01.132169 10014 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:01.133659 10014 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:01.143522 10024 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:01.143522 10022 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:01.143543 10028 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:01.144282 10014 server_base.cc:1034] running on GCE node
I20260808 14:38:01.144757 10014 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:01.145464 10014 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:01.146683 10014 hybrid_clock.cc:648] HybridClock initialized: now 1786199881146662 us; error 29 us; skew 500 ppm
I20260808 14:38:01.148696 10014 webserver.cc:460] Webserver started at http://127.11.131.193:34687/ using document root <none> and password file <none>
I20260808 14:38:01.149334 10014 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:01.149434 10014 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:01.149681 10014 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:38:01.151970 10014 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/ts-0/data/instance:
uuid: "13b5aec9e8b24d7b8deecd30a35b60ad"
format_stamp: "Formatted at 2026-08-08 14:38:01 on dist-test-slave-twwt"
server_key: "4f7cb035b01a13b09de442ae2cc49456"
server_key_iv: "9f3bdbcac322c347d575fc088afe8e12"
server_key_version: "encryptionkey@0"
I20260808 14:38:01.152582 10014 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/ts-0/wal/instance:
uuid: "13b5aec9e8b24d7b8deecd30a35b60ad"
format_stamp: "Formatted at 2026-08-08 14:38:01 on dist-test-slave-twwt"
server_key: "4f7cb035b01a13b09de442ae2cc49456"
server_key_iv: "9f3bdbcac322c347d575fc088afe8e12"
server_key_version: "encryptionkey@0"
I20260808 14:38:01.156703 10014 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 14:38:01.159571 10036 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:01.160986 10014 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 14:38:01.161170 10014 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/ts-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/ts-0/wal
uuid: "13b5aec9e8b24d7b8deecd30a35b60ad"
format_stamp: "Formatted at 2026-08-08 14:38:01 on dist-test-slave-twwt"
server_key: "4f7cb035b01a13b09de442ae2cc49456"
server_key_iv: "9f3bdbcac322c347d575fc088afe8e12"
server_key_version: "encryptionkey@0"
I20260808 14:38:01.161351 10014 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:01.179749 10014 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:01.180518 10014 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:01.180737 10014 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:01.181380 10014 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:38:01.182417 10014 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:38:01.182492 10014 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:01.182569 10014 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:38:01.182611 10014 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:01.192118 10014 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.193:44507
I20260808 14:38:01.192138 10220 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.193:44507 every 8 connection(s)
I20260808 14:38:01.193141 10014 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/ts-0/data/info.pb
I20260808 14:38:01.198894 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 10014
I20260808 14:38:01.199052 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/ts-0/wal/instance
I20260808 14:38:01.199334 11791 external_mini_cluster.cc:1428] Setting key 65569a1f9a30399ab7ce688406eebe7c
I20260808 14:38:01.201620 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.194:0
--local_ip_for_outbound_sockets=127.11.131.194
--webserver_interface=127.11.131.194
--webserver_port=0
--tserver_master_addrs=127.11.131.254:39867
--builtin_ntp_servers=127.11.131.212:44509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 14:38:01.205130 9981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:01.195405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.193:44229 (local address 127.11.131.254:39867)
0808 14:38:01.195589 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:01.195593 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:01.197001 (+ 1408us) server_negotiation.cc:407] Connection header received
0808 14:38:01.198809 (+ 1808us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:01.198813 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:01.198906 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:01.199004 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:01.200114 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:01.200852 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:01.202693 (+ 1841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:01.202959 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:01.203049 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:01.204479 (+ 1430us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:01.204484 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:01.204489 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:38:01.204509 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:01.204538 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:38:01.204550 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:01.204636 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:01.204834 (+ 198us) server_negotiation.cc:299] Negotiation successful
0808 14:38:01.204934 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260808 14:38:01.206020 10225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:01.195823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:39867 (local address 127.11.131.193:44229)
0808 14:38:01.196797 (+ 974us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:01.196879 (+ 82us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:01.198422 (+ 1543us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:01.199208 (+ 786us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:01.199217 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:01.199304 (+ 87us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:38:01.199896 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:01.199917 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:01.201015 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:01.201018 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:01.202497 (+ 1479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:01.202514 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:01.203133 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:01.203140 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:01.203395 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:01.204161 (+ 766us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:38:01.204162 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:38:01.204209 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:38:01.204286 (+ 77us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:38:01.204653 (+ 367us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:38:01.204663 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:38:01.204668 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 14:38:01.204783 (+ 115us) client_negotiation.cc:240] Negotiation successful
0808 14:38:01.205058 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":114,"threads_started":1}
I20260808 14:38:01.207507 10222 heartbeater.cc:347] Connected to a master server at 127.11.131.254:39867
I20260808 14:38:01.207806 10222 heartbeater.cc:464] Registering TS with master...
I20260808 14:38:01.208421 10222 heartbeater.cc:511] Master 127.11.131.254:39867 requested a full tablet report, sending...
I20260808 14:38:01.210153 9904 ts_manager.cc:194] Registered new tserver with Master: 13b5aec9e8b24d7b8deecd30a35b60ad (127.11.131.193:44507)
I20260808 14:38:01.211553 9904 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.131.193:44229
W20260808 14:38:01.320837 10228 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:01.321102 10228 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:01.321142 10228 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:01.325321 10228 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:01.325387 10228 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:01.325444 10228 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.194
I20260808 14:38:01.330204 10228 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:44509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.131.194
--webserver_port=0
--tserver_master_addrs=127.11.131.254:39867
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10228
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.194
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:38:01.331348 10228 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:01.332760 10228 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:01.343007 10236 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:01.343061 10238 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:01.343081 10235 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:01.343250 10228 server_base.cc:1034] running on GCE node
I20260808 14:38:01.343858 10228 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:01.344576 10228 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:01.345824 10228 hybrid_clock.cc:648] HybridClock initialized: now 1786199881345787 us; error 45 us; skew 500 ppm
I20260808 14:38:01.347973 10228 webserver.cc:460] Webserver started at http://127.11.131.194:39513/ using document root <none> and password file <none>
I20260808 14:38:01.348923 10228 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:01.349035 10228 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:01.349294 10228 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:38:01.351570 10228 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/ts-1/data/instance:
uuid: "06f12aa58517491fb63322a78ec3ad74"
format_stamp: "Formatted at 2026-08-08 14:38:01 on dist-test-slave-twwt"
server_key: "450f213e2bdb98f0ee17c3430d4d3aae"
server_key_iv: "2c79e37bf4958973e9584b67c05357ba"
server_key_version: "encryptionkey@0"
I20260808 14:38:01.352162 10228 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/ts-1/wal/instance:
uuid: "06f12aa58517491fb63322a78ec3ad74"
format_stamp: "Formatted at 2026-08-08 14:38:01 on dist-test-slave-twwt"
server_key: "450f213e2bdb98f0ee17c3430d4d3aae"
server_key_iv: "2c79e37bf4958973e9584b67c05357ba"
server_key_version: "encryptionkey@0"
I20260808 14:38:01.356061 10228 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 14:38:01.358887 10251 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:01.360301 10228 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:38:01.360448 10228 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/ts-1/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/ts-1/wal
uuid: "06f12aa58517491fb63322a78ec3ad74"
format_stamp: "Formatted at 2026-08-08 14:38:01 on dist-test-slave-twwt"
server_key: "450f213e2bdb98f0ee17c3430d4d3aae"
server_key_iv: "2c79e37bf4958973e9584b67c05357ba"
server_key_version: "encryptionkey@0"
I20260808 14:38:01.360574 10228 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:01.375944 10228 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:01.376699 10228 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:01.376927 10228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:01.377599 10228 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:38:01.378718 10228 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:38:01.378793 10228 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:01.378871 10228 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:38:01.378913 10228 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:01.388330 10228 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.194:39605
I20260808 14:38:01.388360 10424 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.194:39605 every 8 connection(s)
I20260808 14:38:01.389317 10228 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/ts-1/data/info.pb
I20260808 14:38:01.390345 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 10228
I20260808 14:38:01.390501 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/ts-1/wal/instance
I20260808 14:38:01.390858 11791 external_mini_cluster.cc:1428] Setting key 6f250b1401f1b2dac43de96927671084
I20260808 14:38:01.393138 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.131.195:0
--local_ip_for_outbound_sockets=127.11.131.195
--webserver_interface=127.11.131.195
--webserver_port=0
--tserver_master_addrs=127.11.131.254:39867
--builtin_ntp_servers=127.11.131.212:44509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 14:38:01.400281 9981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:01.391507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:46099 (local address 127.11.131.254:39867)
0808 14:38:01.391657 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:01.391661 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:01.392988 (+ 1327us) server_negotiation.cc:407] Connection header received
0808 14:38:01.394513 (+ 1525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:01.394519 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:01.394588 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:01.394708 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:01.395936 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:01.396456 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:01.398018 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:01.398234 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:01.398315 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:01.399763 (+ 1448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:01.399767 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:01.399769 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:38:01.399782 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:01.399800 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:38:01.399808 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:01.399895 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:01.400107 (+ 212us) server_negotiation.cc:299] Negotiation successful
0808 14:38:01.400163 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 14:38:01.401602 10428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:01.392003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:39867 (local address 127.11.131.194:46099)
0808 14:38:01.392802 (+ 799us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:01.392858 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:01.394288 (+ 1430us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:01.394871 (+ 583us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:01.394878 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:01.395003 (+ 125us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:38:01.395765 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:01.395787 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:01.396591 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:01.396594 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:01.397884 (+ 1290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:01.397899 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:01.398402 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:01.398409 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:01.398669 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:01.399431 (+ 762us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:38:01.399434 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:38:01.399497 (+ 63us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:38:01.399591 (+ 94us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:38:01.399929 (+ 338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:38:01.399942 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:38:01.399950 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 14:38:01.400103 (+ 153us) client_negotiation.cc:240] Negotiation successful
0808 14:38:01.400445 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":307,"thread_start_us":153,"threads_started":1}
I20260808 14:38:01.402910 10425 heartbeater.cc:347] Connected to a master server at 127.11.131.254:39867
I20260808 14:38:01.403165 10425 heartbeater.cc:464] Registering TS with master...
I20260808 14:38:01.403698 10425 heartbeater.cc:511] Master 127.11.131.254:39867 requested a full tablet report, sending...
I20260808 14:38:01.404834 9904 ts_manager.cc:194] Registered new tserver with Master: 06f12aa58517491fb63322a78ec3ad74 (127.11.131.194:39605)
I20260808 14:38:01.405751 9904 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.131.194:46099
W20260808 14:38:01.515900 10429 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:01.516167 10429 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:01.516206 10429 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:01.520162 10429 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:01.520212 10429 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:01.520265 10429 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.131.195
I20260808 14:38:01.525136 10429 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:44509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.131.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.131.195
--webserver_port=0
--tserver_master_addrs=127.11.131.254:39867
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10429
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.131.195
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:38:01.526199 10429 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:01.527603 10429 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:01.537411 10440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:01.537411 10435 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:01.537563 10429 server_base.cc:1034] running on GCE node
W20260808 14:38:01.537438 10436 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:01.538159 10429 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:01.538903 10429 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:01.540124 10429 hybrid_clock.cc:648] HybridClock initialized: now 1786199881540084 us; error 53 us; skew 500 ppm
I20260808 14:38:01.542316 10429 webserver.cc:460] Webserver started at http://127.11.131.195:42695/ using document root <none> and password file <none>
I20260808 14:38:01.542984 10429 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:01.543049 10429 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:01.543222 10429 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:38:01.545284 10429 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/ts-2/data/instance:
uuid: "1f34711f4aa841b6972c924f0cb2c32c"
format_stamp: "Formatted at 2026-08-08 14:38:01 on dist-test-slave-twwt"
server_key: "247bc3a7ac5bf863503ab75610a23d10"
server_key_iv: "aad4da5d1d815cf5552f89ce9e598db5"
server_key_version: "encryptionkey@0"
I20260808 14:38:01.545814 10429 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/ts-2/wal/instance:
uuid: "1f34711f4aa841b6972c924f0cb2c32c"
format_stamp: "Formatted at 2026-08-08 14:38:01 on dist-test-slave-twwt"
server_key: "247bc3a7ac5bf863503ab75610a23d10"
server_key_iv: "aad4da5d1d815cf5552f89ce9e598db5"
server_key_version: "encryptionkey@0"
I20260808 14:38:01.549630 10429 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260808 14:38:01.552194 10448 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:01.553470 10429 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 14:38:01.553597 10429 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/ts-2/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/ts-2/wal
uuid: "1f34711f4aa841b6972c924f0cb2c32c"
format_stamp: "Formatted at 2026-08-08 14:38:01 on dist-test-slave-twwt"
server_key: "247bc3a7ac5bf863503ab75610a23d10"
server_key_iv: "aad4da5d1d815cf5552f89ce9e598db5"
server_key_version: "encryptionkey@0"
I20260808 14:38:01.553711 10429 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:01.572348 10429 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:01.573154 10429 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:01.573381 10429 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:01.574075 10429 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 14:38:01.575233 10429 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 14:38:01.575286 10429 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:01.575330 10429 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 14:38:01.575387 10429 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:01.585222 10429 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.195:45729
I20260808 14:38:01.585268 10630 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.195:45729 every 8 connection(s)
I20260808 14:38:01.586274 10429 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/ts-2/data/info.pb
I20260808 14:38:01.592649 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 10429
I20260808 14:38:01.592800 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/ts-2/wal/instance
I20260808 14:38:01.593101 11791 external_mini_cluster.cc:1428] Setting key 0e51e98d8671d2497a109d7c3a88173a
I20260808 14:38:01.596565 9981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:01.588391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.195:41095 (local address 127.11.131.254:39867)
0808 14:38:01.588588 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:01.588592 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:01.589683 (+ 1091us) server_negotiation.cc:407] Connection header received
0808 14:38:01.591252 (+ 1569us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:01.591255 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:01.591314 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:01.591402 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:01.592421 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:01.593273 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:01.594562 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:01.594852 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:01.594934 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:01.596133 (+ 1199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:01.596137 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:01.596138 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:38:01.596151 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:01.596170 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:38:01.596178 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:01.596240 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:01.596397 (+ 157us) server_negotiation.cc:299] Negotiation successful
0808 14:38:01.596449 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260808 14:38:01.597554 10633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:01.588829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:39867 (local address 127.11.131.195:41095)
0808 14:38:01.589524 (+ 695us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:01.589569 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:01.591019 (+ 1450us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:01.591622 (+ 603us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:01.591630 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:01.591716 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:38:01.592243 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:01.592256 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:01.593413 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:01.593416 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:01.594449 (+ 1033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:01.594459 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:01.595013 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:01.595018 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:01.595220 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:01.595857 (+ 637us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 14:38:01.595859 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:38:01.595901 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 14:38:01.595971 (+ 70us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:38:01.596259 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:38:01.596266 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:38:01.596278 (+ 12us) client_negotiation.cc:769] Sending connection context
0808 14:38:01.596378 (+ 100us) client_negotiation.cc:240] Negotiation successful
0808 14:38:01.596618 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":116,"threads_started":1}
I20260808 14:38:01.598902 10631 heartbeater.cc:347] Connected to a master server at 127.11.131.254:39867
I20260808 14:38:01.599165 10631 heartbeater.cc:464] Registering TS with master...
I20260808 14:38:01.599746 10631 heartbeater.cc:511] Master 127.11.131.254:39867 requested a full tablet report, sending...
I20260808 14:38:01.600849 9904 ts_manager.cc:194] Registered new tserver with Master: 1f34711f4aa841b6972c924f0cb2c32c (127.11.131.195:45729)
I20260808 14:38:01.601449 9904 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.131.195:41095
I20260808 14:38:01.607411 11791 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 14:38:01.613385 9981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:01.609455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55230 (local address 127.11.131.254:39867)
0808 14:38:01.609603 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:01.609609 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:01.609760 (+ 151us) server_negotiation.cc:407] Connection header received
0808 14:38:01.609903 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:01.609905 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:01.609947 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:01.610016 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:01.610282 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:01.610877 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:01.611717 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:01.611929 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:01.612007 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:01.612898 (+ 891us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:01.612901 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:01.612903 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:38:01.612914 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:01.612931 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:38:01.612939 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:01.612997 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:01.613139 (+ 142us) server_negotiation.cc:299] Negotiation successful
0808 14:38:01.613188 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 14:38:01.616427 9904 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55230:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 14:38:01.619541 9904 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 14:38:01.634919 10647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:01.628881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48272 (local address 127.11.131.193:44507)
0808 14:38:01.629847 (+ 966us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:01.629860 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:01.629886 (+ 26us) server_negotiation.cc:407] Connection header received
0808 14:38:01.629974 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:01.629980 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:01.630204 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:01.630590 (+ 386us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:38:01.630841 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:01.631766 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:01.633310 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:01.634083 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:01.634208 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:01.634391 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:01.634594 (+ 203us) server_negotiation.cc:299] Negotiation successful
0808 14:38:01.634724 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":851,"thread_start_us":149,"threads_started":1}
I20260808 14:38:01.634899 10643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:01.628910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.194:39605 (local address 127.0.0.1:57968)
0808 14:38:01.629378 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:01.629392 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:01.629535 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:01.630467 (+ 932us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:01.630470 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:01.630493 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:38:01.630704 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:01.630714 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:01.632324 (+ 1610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:01.632327 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:01.633475 (+ 1148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:01.633485 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:01.634439 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:01.634443 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:01.634536 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:01.634557 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 14:38:01.634598 (+ 41us) client_negotiation.cc:240] Negotiation successful
0808 14:38:01.634701 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":416,"mutex_wait_us":32,"spinlock_wait_cycles":4736,"thread_start_us":126,"threads_started":1}
I20260808 14:38:01.634900 10645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:01.628683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:44507 (local address 127.0.0.1:48272)
0808 14:38:01.629336 (+ 653us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:01.629388 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:01.629535 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:01.630414 (+ 879us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:01.630423 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:01.630454 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:38:01.630722 (+ 268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:01.630731 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:01.631881 (+ 1150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:01.631884 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:01.633163 (+ 1279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:01.633174 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:01.634225 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:01.634229 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:01.634356 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:01.634424 (+ 68us) client_negotiation.cc:769] Sending connection context
0808 14:38:01.634532 (+ 108us) client_negotiation.cc:240] Negotiation successful
0808 14:38:01.634711 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":455,"mutex_wait_us":83,"spinlock_wait_cycles":7424,"thread_start_us":90,"threads_started":1}
I20260808 14:38:01.635597 10650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:01.629439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.195:45729 (local address 127.0.0.1:41336)
0808 14:38:01.630367 (+ 928us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:01.630381 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:01.630463 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:01.631199 (+ 736us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:01.631202 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:01.631223 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:38:01.631299 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:01.631304 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:01.632656 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:01.632660 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:01.633739 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:01.633750 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:01.635230 (+ 1480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:01.635234 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:01.635339 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:01.635363 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 14:38:01.635439 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 14:38:01.635493 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":844,"mutex_wait_us":16,"spinlock_wait_cycles":5888,"thread_start_us":102,"threads_started":1}
I20260808 14:38:01.635667 10654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:01.629477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57968 (local address 127.11.131.194:39605)
0808 14:38:01.629936 (+ 459us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:01.629951 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:01.629980 (+ 29us) server_negotiation.cc:407] Connection header received
0808 14:38:01.630061 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:01.630069 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:01.630276 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:01.630873 (+ 597us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:38:01.631006 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:01.632188 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:01.633604 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:01.634293 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:01.635164 (+ 871us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:01.635365 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:01.635416 (+ 51us) server_negotiation.cc:299] Negotiation successful
0808 14:38:01.635510 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":350,"thread_start_us":120,"threads_started":1}
I20260808 14:38:01.636170 10657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:01.629927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41336 (local address 127.11.131.195:45729)
0808 14:38:01.630722 (+ 795us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:01.630735 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:01.630759 (+ 24us) server_negotiation.cc:407] Connection header received
0808 14:38:01.630852 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:01.630858 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:01.631038 (+ 180us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:01.631195 (+ 157us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:38:01.631430 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:01.632522 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:01.633894 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:01.634724 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:01.634850 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:01.635825 (+ 975us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:01.635879 (+ 54us) server_negotiation.cc:299] Negotiation successful
0808 14:38:01.635966 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":652,"thread_start_us":159,"threads_started":1}
I20260808 14:38:01.638638 10318 tablet_service.cc:1467] Processing CreateTablet for tablet 97d3796c2221408794113615c5f07287 (DEFAULT_TABLE table=test-table [id=eafbcd41fc634d9496c1d3f47b63d2c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:38:01.638630 10120 tablet_service.cc:1467] Processing CreateTablet for tablet 97d3796c2221408794113615c5f07287 (DEFAULT_TABLE table=test-table [id=eafbcd41fc634d9496c1d3f47b63d2c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:38:01.639072 10527 tablet_service.cc:1467] Processing CreateTablet for tablet 97d3796c2221408794113615c5f07287 (DEFAULT_TABLE table=test-table [id=eafbcd41fc634d9496c1d3f47b63d2c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 14:38:01.639846 10318 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97d3796c2221408794113615c5f07287. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:38:01.639846 10120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97d3796c2221408794113615c5f07287. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:38:01.640120 10527 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97d3796c2221408794113615c5f07287. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:38:01.646413 10658 tablet_bootstrap.cc:492] T 97d3796c2221408794113615c5f07287 P 1f34711f4aa841b6972c924f0cb2c32c: Bootstrap starting.
I20260808 14:38:01.648048 10659 tablet_bootstrap.cc:492] T 97d3796c2221408794113615c5f07287 P 13b5aec9e8b24d7b8deecd30a35b60ad: Bootstrap starting.
I20260808 14:38:01.649461 10658 tablet_bootstrap.cc:654] T 97d3796c2221408794113615c5f07287 P 1f34711f4aa841b6972c924f0cb2c32c: Neither blocks nor log segments found. Creating new log.
I20260808 14:38:01.649911 10659 tablet_bootstrap.cc:654] T 97d3796c2221408794113615c5f07287 P 13b5aec9e8b24d7b8deecd30a35b60ad: Neither blocks nor log segments found. Creating new log.
I20260808 14:38:01.650269 10658 log.cc:824] T 97d3796c2221408794113615c5f07287 P 1f34711f4aa841b6972c924f0cb2c32c: Log is configured to *not* fsync() on all Append() calls
I20260808 14:38:01.650688 10659 log.cc:824] T 97d3796c2221408794113615c5f07287 P 13b5aec9e8b24d7b8deecd30a35b60ad: Log is configured to *not* fsync() on all Append() calls
I20260808 14:38:01.651098 10660 tablet_bootstrap.cc:492] T 97d3796c2221408794113615c5f07287 P 06f12aa58517491fb63322a78ec3ad74: Bootstrap starting.
I20260808 14:38:01.652535 10658 tablet_bootstrap.cc:492] T 97d3796c2221408794113615c5f07287 P 1f34711f4aa841b6972c924f0cb2c32c: No bootstrap required, opened a new log
I20260808 14:38:01.652499 10659 tablet_bootstrap.cc:492] T 97d3796c2221408794113615c5f07287 P 13b5aec9e8b24d7b8deecd30a35b60ad: No bootstrap required, opened a new log
I20260808 14:38:01.652760 10658 ts_tablet_manager.cc:1397] T 97d3796c2221408794113615c5f07287 P 1f34711f4aa841b6972c924f0cb2c32c: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.002s
I20260808 14:38:01.652833 10659 ts_tablet_manager.cc:1397] T 97d3796c2221408794113615c5f07287 P 13b5aec9e8b24d7b8deecd30a35b60ad: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 14:38:01.653409 10660 tablet_bootstrap.cc:654] T 97d3796c2221408794113615c5f07287 P 06f12aa58517491fb63322a78ec3ad74: Neither blocks nor log segments found. Creating new log.
I20260808 14:38:01.654253 10660 log.cc:824] T 97d3796c2221408794113615c5f07287 P 06f12aa58517491fb63322a78ec3ad74: Log is configured to *not* fsync() on all Append() calls
I20260808 14:38:01.656579 10660 tablet_bootstrap.cc:492] T 97d3796c2221408794113615c5f07287 P 06f12aa58517491fb63322a78ec3ad74: No bootstrap required, opened a new log
I20260808 14:38:01.656797 10660 ts_tablet_manager.cc:1397] T 97d3796c2221408794113615c5f07287 P 06f12aa58517491fb63322a78ec3ad74: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260808 14:38:01.656782 10659 raft_consensus.cc:348] T 97d3796c2221408794113615c5f07287 P 13b5aec9e8b24d7b8deecd30a35b60ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13b5aec9e8b24d7b8deecd30a35b60ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 44507 } } peers { permanent_uuid: "06f12aa58517491fb63322a78ec3ad74" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 39605 } } peers { permanent_uuid: "1f34711f4aa841b6972c924f0cb2c32c" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45729 } }
I20260808 14:38:01.657102 10659 raft_consensus.cc:374] T 97d3796c2221408794113615c5f07287 P 13b5aec9e8b24d7b8deecd30a35b60ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:38:01.657157 10659 raft_consensus.cc:729] T 97d3796c2221408794113615c5f07287 P 13b5aec9e8b24d7b8deecd30a35b60ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13b5aec9e8b24d7b8deecd30a35b60ad, State: Initialized, Role: FOLLOWER
I20260808 14:38:01.657467 10658 raft_consensus.cc:348] T 97d3796c2221408794113615c5f07287 P 1f34711f4aa841b6972c924f0cb2c32c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13b5aec9e8b24d7b8deecd30a35b60ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 44507 } } peers { permanent_uuid: "06f12aa58517491fb63322a78ec3ad74" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 39605 } } peers { permanent_uuid: "1f34711f4aa841b6972c924f0cb2c32c" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45729 } }
I20260808 14:38:01.657728 10658 raft_consensus.cc:374] T 97d3796c2221408794113615c5f07287 P 1f34711f4aa841b6972c924f0cb2c32c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:38:01.657821 10658 raft_consensus.cc:729] T 97d3796c2221408794113615c5f07287 P 1f34711f4aa841b6972c924f0cb2c32c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f34711f4aa841b6972c924f0cb2c32c, State: Initialized, Role: FOLLOWER
I20260808 14:38:01.657750 10659 consensus_queue.cc:260] T 97d3796c2221408794113615c5f07287 P 13b5aec9e8b24d7b8deecd30a35b60ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13b5aec9e8b24d7b8deecd30a35b60ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 44507 } } peers { permanent_uuid: "06f12aa58517491fb63322a78ec3ad74" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 39605 } } peers { permanent_uuid: "1f34711f4aa841b6972c924f0cb2c32c" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45729 } }
I20260808 14:38:01.658304 10658 consensus_queue.cc:260] T 97d3796c2221408794113615c5f07287 P 1f34711f4aa841b6972c924f0cb2c32c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13b5aec9e8b24d7b8deecd30a35b60ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 44507 } } peers { permanent_uuid: "06f12aa58517491fb63322a78ec3ad74" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 39605 } } peers { permanent_uuid: "1f34711f4aa841b6972c924f0cb2c32c" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45729 } }
I20260808 14:38:01.659082 10631 heartbeater.cc:503] Master 127.11.131.254:39867 was elected leader, sending a full tablet report...
I20260808 14:38:01.659653 10658 ts_tablet_manager.cc:1428] T 97d3796c2221408794113615c5f07287 P 1f34711f4aa841b6972c924f0cb2c32c: Time spent starting tablet: real 0.007s user 0.005s sys 0.002s
I20260808 14:38:01.660195 10659 ts_tablet_manager.cc:1428] T 97d3796c2221408794113615c5f07287 P 13b5aec9e8b24d7b8deecd30a35b60ad: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260808 14:38:01.660247 10222 heartbeater.cc:503] Master 127.11.131.254:39867 was elected leader, sending a full tablet report...
I20260808 14:38:01.661535 10660 raft_consensus.cc:348] T 97d3796c2221408794113615c5f07287 P 06f12aa58517491fb63322a78ec3ad74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13b5aec9e8b24d7b8deecd30a35b60ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 44507 } } peers { permanent_uuid: "06f12aa58517491fb63322a78ec3ad74" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 39605 } } peers { permanent_uuid: "1f34711f4aa841b6972c924f0cb2c32c" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45729 } }
I20260808 14:38:01.661839 10660 raft_consensus.cc:374] T 97d3796c2221408794113615c5f07287 P 06f12aa58517491fb63322a78ec3ad74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:38:01.661907 10660 raft_consensus.cc:729] T 97d3796c2221408794113615c5f07287 P 06f12aa58517491fb63322a78ec3ad74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06f12aa58517491fb63322a78ec3ad74, State: Initialized, Role: FOLLOWER
I20260808 14:38:01.662390 10660 consensus_queue.cc:260] T 97d3796c2221408794113615c5f07287 P 06f12aa58517491fb63322a78ec3ad74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13b5aec9e8b24d7b8deecd30a35b60ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 44507 } } peers { permanent_uuid: "06f12aa58517491fb63322a78ec3ad74" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 39605 } } peers { permanent_uuid: "1f34711f4aa841b6972c924f0cb2c32c" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45729 } }
I20260808 14:38:01.663476 10660 ts_tablet_manager.cc:1428] T 97d3796c2221408794113615c5f07287 P 06f12aa58517491fb63322a78ec3ad74: Time spent starting tablet: real 0.007s user 0.004s sys 0.004s
I20260808 14:38:01.663882 10425 heartbeater.cc:503] Master 127.11.131.254:39867 was elected leader, sending a full tablet report...
W20260808 14:38:01.694384 10224 tablet.cc:2369] T 97d3796c2221408794113615c5f07287 P 13b5aec9e8b24d7b8deecd30a35b60ad: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 14:38:01.747445 10669 raft_consensus.cc:482] T 97d3796c2221408794113615c5f07287 P 06f12aa58517491fb63322a78ec3ad74 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 14:38:01.747716 10669 raft_consensus.cc:504] T 97d3796c2221408794113615c5f07287 P 06f12aa58517491fb63322a78ec3ad74 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13b5aec9e8b24d7b8deecd30a35b60ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 44507 } } peers { permanent_uuid: "06f12aa58517491fb63322a78ec3ad74" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 39605 } } peers { permanent_uuid: "1f34711f4aa841b6972c924f0cb2c32c" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45729 } }
I20260808 14:38:01.749133 10669 leader_election.cc:288] T 97d3796c2221408794113615c5f07287 P 06f12aa58517491fb63322a78ec3ad74 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13b5aec9e8b24d7b8deecd30a35b60ad (127.11.131.193:44507), 1f34711f4aa841b6972c924f0cb2c32c (127.11.131.195:45729)
I20260808 14:38:01.752969 10428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:01.749366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:44507 (local address 127.11.131.194:45077)
0808 14:38:01.749508 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:01.749527 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:01.749637 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:01.749987 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:01.749990 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:01.750010 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:38:01.750135 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:01.750141 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:01.750997 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:01.751001 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:01.751843 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:01.751853 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:01.752492 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:01.752496 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:01.752604 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:01.752632 (+ 28us) client_negotiation.cc:769] Sending connection context
0808 14:38:01.752742 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 14:38:01.752827 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260808 14:38:01.752969 10647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:01.749485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:45077 (local address 127.11.131.193:44507)
0808 14:38:01.749691 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:01.749696 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:01.749716 (+ 20us) server_negotiation.cc:407] Connection header received
0808 14:38:01.749779 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:01.749782 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:01.749846 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:01.749963 (+ 117us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:38:01.750259 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:01.750879 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:01.751968 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:01.752362 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:01.752493 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:01.752564 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:01.752758 (+ 194us) server_negotiation.cc:299] Negotiation successful
0808 14:38:01.752847 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109}
I20260808 14:38:01.753201 10657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:01.749741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.131.194:53761 (local address 127.11.131.195:45729)
0808 14:38:01.749911 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:01.749917 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:01.750016 (+ 99us) server_negotiation.cc:407] Connection header received
0808 14:38:01.750191 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:01.750193 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:01.750237 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:01.750319 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 14:38:01.750653 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:01.751191 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:01.752204 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:01.752609 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:01.752758 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:01.752808 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:01.753020 (+ 212us) server_negotiation.cc:299] Negotiation successful
0808 14:38:01.753092 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 14:38:01.753216 10670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:01.749484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.195:45729 (local address 127.11.131.194:53761)
0808 14:38:01.749911 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:01.749925 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:01.750072 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:01.750350 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:01.750354 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:01.750371 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 14:38:01.750502 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:01.750508 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:01.751313 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:01.751317 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:01.752076 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:01.752084 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:01.752764 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:01.752768 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:01.752874 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:01.752901 (+ 27us) client_negotiation.cc:769] Sending connection context
0808 14:38:01.753001 (+ 100us) client_negotiation.cc:240] Negotiation successful
0808 14:38:01.753069 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":365,"spinlock_wait_cycles":768,"thread_start_us":162,"threads_started":1}
I20260808 14:38:01.753711 10152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97d3796c2221408794113615c5f07287" candidate_uuid: "06f12aa58517491fb63322a78ec3ad74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13b5aec9e8b24d7b8deecd30a35b60ad" is_pre_election: true
I20260808 14:38:01.753957 10568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97d3796c2221408794113615c5f07287" candidate_uuid: "06f12aa58517491fb63322a78ec3ad74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f34711f4aa841b6972c924f0cb2c32c" is_pre_election: true
I20260808 14:38:01.754066 10152 raft_consensus.cc:2454] T 97d3796c2221408794113615c5f07287 P 13b5aec9e8b24d7b8deecd30a35b60ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06f12aa58517491fb63322a78ec3ad74 in term 0.
I20260808 14:38:01.754281 10568 raft_consensus.cc:2454] T 97d3796c2221408794113615c5f07287 P 1f34711f4aa841b6972c924f0cb2c32c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06f12aa58517491fb63322a78ec3ad74 in term 0.
I20260808 14:38:01.754801 10254 leader_election.cc:302] T 97d3796c2221408794113615c5f07287 P 06f12aa58517491fb63322a78ec3ad74 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 06f12aa58517491fb63322a78ec3ad74, 13b5aec9e8b24d7b8deecd30a35b60ad, 1f34711f4aa841b6972c924f0cb2c32c; no voters:
I20260808 14:38:01.755128 10669 raft_consensus.cc:2781] T 97d3796c2221408794113615c5f07287 P 06f12aa58517491fb63322a78ec3ad74 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 14:38:01.755225 10669 raft_consensus.cc:482] T 97d3796c2221408794113615c5f07287 P 06f12aa58517491fb63322a78ec3ad74 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 14:38:01.755271 10669 raft_consensus.cc:3037] T 97d3796c2221408794113615c5f07287 P 06f12aa58517491fb63322a78ec3ad74 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:38:01.756979 10669 raft_consensus.cc:504] T 97d3796c2221408794113615c5f07287 P 06f12aa58517491fb63322a78ec3ad74 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13b5aec9e8b24d7b8deecd30a35b60ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 44507 } } peers { permanent_uuid: "06f12aa58517491fb63322a78ec3ad74" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 39605 } } peers { permanent_uuid: "1f34711f4aa841b6972c924f0cb2c32c" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45729 } }
I20260808 14:38:01.757478 10669 leader_election.cc:288] T 97d3796c2221408794113615c5f07287 P 06f12aa58517491fb63322a78ec3ad74 [CANDIDATE]: Term 1 election: Requested vote from peers 13b5aec9e8b24d7b8deecd30a35b60ad (127.11.131.193:44507), 1f34711f4aa841b6972c924f0cb2c32c (127.11.131.195:45729)
I20260808 14:38:01.757969 10568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97d3796c2221408794113615c5f07287" candidate_uuid: "06f12aa58517491fb63322a78ec3ad74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f34711f4aa841b6972c924f0cb2c32c"
I20260808 14:38:01.758105 10152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97d3796c2221408794113615c5f07287" candidate_uuid: "06f12aa58517491fb63322a78ec3ad74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13b5aec9e8b24d7b8deecd30a35b60ad"
I20260808 14:38:01.758126 10568 raft_consensus.cc:3037] T 97d3796c2221408794113615c5f07287 P 1f34711f4aa841b6972c924f0cb2c32c [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:38:01.758270 10152 raft_consensus.cc:3037] T 97d3796c2221408794113615c5f07287 P 13b5aec9e8b24d7b8deecd30a35b60ad [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:38:01.759625 10152 raft_consensus.cc:2454] T 97d3796c2221408794113615c5f07287 P 13b5aec9e8b24d7b8deecd30a35b60ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06f12aa58517491fb63322a78ec3ad74 in term 1.
I20260808 14:38:01.759630 10568 raft_consensus.cc:2454] T 97d3796c2221408794113615c5f07287 P 1f34711f4aa841b6972c924f0cb2c32c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06f12aa58517491fb63322a78ec3ad74 in term 1.
I20260808 14:38:01.760013 10253 leader_election.cc:302] T 97d3796c2221408794113615c5f07287 P 06f12aa58517491fb63322a78ec3ad74 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06f12aa58517491fb63322a78ec3ad74, 1f34711f4aa841b6972c924f0cb2c32c; no voters:
I20260808 14:38:01.760252 10669 raft_consensus.cc:2781] T 97d3796c2221408794113615c5f07287 P 06f12aa58517491fb63322a78ec3ad74 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:38:01.760514 10669 raft_consensus.cc:686] T 97d3796c2221408794113615c5f07287 P 06f12aa58517491fb63322a78ec3ad74 [term 1 LEADER]: Becoming Leader. State: Replica: 06f12aa58517491fb63322a78ec3ad74, State: Running, Role: LEADER
I20260808 14:38:01.760883 10669 consensus_queue.cc:237] T 97d3796c2221408794113615c5f07287 P 06f12aa58517491fb63322a78ec3ad74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13b5aec9e8b24d7b8deecd30a35b60ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 44507 } } peers { permanent_uuid: "06f12aa58517491fb63322a78ec3ad74" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 39605 } } peers { permanent_uuid: "1f34711f4aa841b6972c924f0cb2c32c" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45729 } }
I20260808 14:38:01.764709 9903 catalog_manager.cc:5495] T 97d3796c2221408794113615c5f07287 P 06f12aa58517491fb63322a78ec3ad74 reported cstate change: term changed from 0 to 1, leader changed from <none> to 06f12aa58517491fb63322a78ec3ad74 (127.11.131.194). New cstate: current_term: 1 leader_uuid: "06f12aa58517491fb63322a78ec3ad74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13b5aec9e8b24d7b8deecd30a35b60ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 44507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "06f12aa58517491fb63322a78ec3ad74" member_type: VOTER last_known_addr { host: "127.11.131.194" port: 39605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f34711f4aa841b6972c924f0cb2c32c" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45729 } health_report { overall_health: UNKNOWN } } }
I20260808 14:38:01.797199 10654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:01.793350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57978 (local address 127.11.131.194:39605)
0808 14:38:01.793516 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:01.793521 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:01.793537 (+ 16us) server_negotiation.cc:407] Connection header received
0808 14:38:01.793697 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:01.793700 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:01.793762 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:01.793935 (+ 173us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:38:01.794202 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:01.794735 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:01.795615 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:01.795851 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:01.795964 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:01.796307 (+ 343us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:38:01.796771 (+ 464us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:38:01.796921 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:01.796970 (+ 49us) server_negotiation.cc:299] Negotiation successful
0808 14:38:01.797026 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 14:38:01.803531 10152 raft_consensus.cc:1261] T 97d3796c2221408794113615c5f07287 P 13b5aec9e8b24d7b8deecd30a35b60ad [term 1 FOLLOWER]: Refusing update from remote peer 06f12aa58517491fb63322a78ec3ad74: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:38:01.803531 10568 raft_consensus.cc:1261] T 97d3796c2221408794113615c5f07287 P 1f34711f4aa841b6972c924f0cb2c32c [term 1 FOLLOWER]: Refusing update from remote peer 06f12aa58517491fb63322a78ec3ad74: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:38:01.804352 10669 consensus_queue.cc:1035] T 97d3796c2221408794113615c5f07287 P 06f12aa58517491fb63322a78ec3ad74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f34711f4aa841b6972c924f0cb2c32c" member_type: VOTER last_known_addr { host: "127.11.131.195" port: 45729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:38:01.804634 10671 consensus_queue.cc:1035] T 97d3796c2221408794113615c5f07287 P 06f12aa58517491fb63322a78ec3ad74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13b5aec9e8b24d7b8deecd30a35b60ad" member_type: VOTER last_known_addr { host: "127.11.131.193" port: 44507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:38:01.812007 10680 mvcc.cc:205] Tried to move back new op lower bound from 7316274715859124224 to 7316274715695419392. Current Snapshot: MvccSnapshot[applied={T|T < 7316274715859124224}]
I20260808 14:38:01.812567 10681 mvcc.cc:205] Tried to move back new op lower bound from 7316274715859124224 to 7316274715695419392. Current Snapshot: MvccSnapshot[applied={T|T < 7316274715859124224}]
I20260808 14:38:01.814407 10683 mvcc.cc:205] Tried to move back new op lower bound from 7316274715859124224 to 7316274715695419392. Current Snapshot: MvccSnapshot[applied={T|T < 7316274715859124224}]
I20260808 14:38:01.821668 9904 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55230:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:38:01.821868 9904 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55230:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 14:38:01.824739 9904 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b90d7a89255748468dbbbe59780a6b26: Sending DeleteTablet for 3 replicas of tablet 97d3796c2221408794113615c5f07287
I20260808 14:38:01.825690 10120 tablet_service.cc:1514] Processing DeleteTablet for tablet 97d3796c2221408794113615c5f07287 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:38:01 UTC) from {username='slave'} at 127.0.0.1:48272
I20260808 14:38:01.825742 10527 tablet_service.cc:1514] Processing DeleteTablet for tablet 97d3796c2221408794113615c5f07287 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:38:01 UTC) from {username='slave'} at 127.0.0.1:41336
I20260808 14:38:01.826303 10318 tablet_service.cc:1514] Processing DeleteTablet for tablet 97d3796c2221408794113615c5f07287 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 14:38:01 UTC) from {username='slave'} at 127.0.0.1:57968
I20260808 14:38:01.826529 10699 tablet_replica.cc:330] T 97d3796c2221408794113615c5f07287 P 13b5aec9e8b24d7b8deecd30a35b60ad: stopping tablet replica
I20260808 14:38:01.826700 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 10014
I20260808 14:38:01.826957 10699 raft_consensus.cc:2229] T 97d3796c2221408794113615c5f07287 P 13b5aec9e8b24d7b8deecd30a35b60ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:38:01.829463 10698 tablet_replica.cc:330] T 97d3796c2221408794113615c5f07287 P 1f34711f4aa841b6972c924f0cb2c32c: stopping tablet replica
I20260808 14:38:01.829823 10698 raft_consensus.cc:2229] T 97d3796c2221408794113615c5f07287 P 1f34711f4aa841b6972c924f0cb2c32c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 14:38:01.830153 10698 raft_consensus.cc:2258] T 97d3796c2221408794113615c5f07287 P 1f34711f4aa841b6972c924f0cb2c32c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:38:01.835968 10698 ts_tablet_manager.cc:1905] T 97d3796c2221408794113615c5f07287 P 1f34711f4aa841b6972c924f0cb2c32c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:38:01.839962 10698 ts_tablet_manager.cc:1918] T 97d3796c2221408794113615c5f07287 P 1f34711f4aa841b6972c924f0cb2c32c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:38:01.840103 10698 log.cc:1196] T 97d3796c2221408794113615c5f07287 P 1f34711f4aa841b6972c924f0cb2c32c: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/ts-2/wal/wals/97d3796c2221408794113615c5f07287
I20260808 14:38:01.840428 10698 ts_tablet_manager.cc:1939] T 97d3796c2221408794113615c5f07287 P 1f34711f4aa841b6972c924f0cb2c32c: Deleting consensus metadata
I20260808 14:38:01.841643 10700 tablet_replica.cc:330] T 97d3796c2221408794113615c5f07287 P 06f12aa58517491fb63322a78ec3ad74: stopping tablet replica
I20260808 14:38:01.842026 10700 raft_consensus.cc:2229] T 97d3796c2221408794113615c5f07287 P 06f12aa58517491fb63322a78ec3ad74 [term 1 LEADER]: Raft consensus shutting down.
I20260808 14:38:01.842016 9882 catalog_manager.cc:4841] TS 1f34711f4aa841b6972c924f0cb2c32c (127.11.131.195:45729): tablet 97d3796c2221408794113615c5f07287 (table test-table [id=eafbcd41fc634d9496c1d3f47b63d2c1]) successfully deleted
I20260808 14:38:01.842448 10700 raft_consensus.cc:2258] T 97d3796c2221408794113615c5f07287 P 06f12aa58517491fb63322a78ec3ad74 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 14:38:01.844070 10700 ts_tablet_manager.cc:1905] T 97d3796c2221408794113615c5f07287 P 06f12aa58517491fb63322a78ec3ad74: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 14:38:01.846863 10700 ts_tablet_manager.cc:1918] T 97d3796c2221408794113615c5f07287 P 06f12aa58517491fb63322a78ec3ad74: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 14:38:01.846966 10700 log.cc:1196] T 97d3796c2221408794113615c5f07287 P 06f12aa58517491fb63322a78ec3ad74: Deleting WAL directory at /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786199615258783-11791-0/minicluster-data/ts-1/wal/wals/97d3796c2221408794113615c5f07287
I20260808 14:38:01.847286 10700 ts_tablet_manager.cc:1939] T 97d3796c2221408794113615c5f07287 P 06f12aa58517491fb63322a78ec3ad74: Deleting consensus metadata
I20260808 14:38:01.848620 9882 catalog_manager.cc:4841] TS 06f12aa58517491fb63322a78ec3ad74 (127.11.131.194:39605): tablet 97d3796c2221408794113615c5f07287 (table test-table [id=eafbcd41fc634d9496c1d3f47b63d2c1]) successfully deleted
W20260808 14:38:01.849143 9885 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.131.193:44507 (error 108)
I20260808 14:38:01.850172 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 10228
I20260808 14:38:01.850351 10645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:01.849983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.193:44507 (local address 127.0.0.1:48282)
0808 14:38:01.850143 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:01.850239 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.193:44507: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260808 14:38:01.850538 9885 catalog_manager.cc:4584] TS 13b5aec9e8b24d7b8deecd30a35b60ad (127.11.131.193:44507): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 97d3796c2221408794113615c5f07287: Network error: Client connection negotiation failed: client connection to 127.11.131.193:44507: connect: Connection refused (error 111)
I20260808 14:38:01.861714 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 10429
I20260808 14:38:01.876956 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 9858
2026-08-08T14:38:01Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1156 ms)
[----------] 6 tests from EncryptionPolicyTest (11872 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786199615258783-11791-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:38:01 dist-test-slave-twwt krb5kdc[10705](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:38:01 dist-test-slave-twwt krb5kdc[10705](info): set up 2 sockets
Aug 08 14:38:01 dist-test-slave-twwt krb5kdc[10705](info): commencing operation
krb5kdc: starting...
W20260808 14:38:03.168846 11791 mini_kdc.cc:121] Time spent starting KDC: real 1.260s user 0.006s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Aug 08 14:38:03 dist-test-slave-twwt krb5kdc[10705](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199883, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:38:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:38:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786199615258783-11791-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786199615258783-11791-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:38:03.302325 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38031
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786199615258783-11791-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39705
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38031
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:38:03.420876 10724 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:03.421207 10724 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:03.421301 10724 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:03.425428 10724 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:38:03.425518 10724 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:03.425558 10724 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:03.425616 10724 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:38:03.425652 10724 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:38:03.431071 10724 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39705
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786199615258783-11791-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38031
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786199615258783-11791-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38031
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10724
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:38:03.432201 10724 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:03.433292 10724 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:03.442262 10733 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:03.442262 10732 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:03.442303 10737 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:03.442507 10724 server_base.cc:1034] running on GCE node
I20260808 14:38:03.443261 10724 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:03.444427 10724 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:03.445626 10724 hybrid_clock.cc:648] HybridClock initialized: now 1786199883445610 us; error 29 us; skew 500 ppm
Aug 08 14:38:03 dist-test-slave-twwt krb5kdc[10705](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199883, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:03.448673 10724 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:38:03.449688 10724 webserver.cc:460] Webserver started at http://127.0.0.1:40189/ using document root <none> and password file <none>
I20260808 14:38:03.450297 10724 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:03.450407 10724 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:03.450716 10724 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:38:03.452898 10724 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786199615258783-11791-0/minicluster-data/master-0/data/instance:
uuid: "6b9be6b928e2457398b42ae53d92b3bf"
format_stamp: "Formatted at 2026-08-08 14:38:03 on dist-test-slave-twwt"
server_key: "2034cb9c1c482829d9976e4f1e4ef6dc"
server_key_iv: "40b9cfab2231df070db8c39e93be6fae"
server_key_version: "encryptionkey@0"
I20260808 14:38:03.453505 10724 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786199615258783-11791-0/minicluster-data/master-0/wal/instance:
uuid: "6b9be6b928e2457398b42ae53d92b3bf"
format_stamp: "Formatted at 2026-08-08 14:38:03 on dist-test-slave-twwt"
server_key: "2034cb9c1c482829d9976e4f1e4ef6dc"
server_key_iv: "40b9cfab2231df070db8c39e93be6fae"
server_key_version: "encryptionkey@0"
I20260808 14:38:03.457427 10724 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 14:38:03.459998 10750 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:03.461292 10724 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 14:38:03.461468 10724 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "6b9be6b928e2457398b42ae53d92b3bf"
format_stamp: "Formatted at 2026-08-08 14:38:03 on dist-test-slave-twwt"
server_key: "2034cb9c1c482829d9976e4f1e4ef6dc"
server_key_iv: "40b9cfab2231df070db8c39e93be6fae"
server_key_version: "encryptionkey@0"
I20260808 14:38:03.461591 10724 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:03.480078 10724 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:03.483597 10724 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:03.483825 10724 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:03.491389 10724 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38031
I20260808 14:38:03.491437 10851 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38031 every 8 connection(s)
I20260808 14:38:03.492390 10724 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:38:03.495333 10853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:38:03.499782 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 10724
I20260808 14:38:03.499976 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786199615258783-11791-0/minicluster-data/master-0/wal/instance
I20260808 14:38:03.500316 11791 external_mini_cluster.cc:1428] Setting key 0a1ee1b636620203f3bd44653464dcf6
I20260808 14:38:03.502005 10853 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b9be6b928e2457398b42ae53d92b3bf: Bootstrap starting.
I20260808 14:38:03.505285 10853 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6b9be6b928e2457398b42ae53d92b3bf: Neither blocks nor log segments found. Creating new log.
I20260808 14:38:03.506335 10853 log.cc:824] T 00000000000000000000000000000000 P 6b9be6b928e2457398b42ae53d92b3bf: Log is configured to *not* fsync() on all Append() calls
I20260808 14:38:03.508879 10853 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b9be6b928e2457398b42ae53d92b3bf: No bootstrap required, opened a new log
Aug 08 14:38:03 dist-test-slave-twwt krb5kdc[10705](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199883, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 14:38:03.514072 10853 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6b9be6b928e2457398b42ae53d92b3bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b9be6b928e2457398b42ae53d92b3bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38031 } }
I20260808 14:38:03.514432 10853 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6b9be6b928e2457398b42ae53d92b3bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:38:03.514504 10853 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6b9be6b928e2457398b42ae53d92b3bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b9be6b928e2457398b42ae53d92b3bf, State: Initialized, Role: FOLLOWER
I20260808 14:38:03.515166 10853 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6b9be6b928e2457398b42ae53d92b3bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b9be6b928e2457398b42ae53d92b3bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38031 } }
I20260808 14:38:03.515383 10853 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6b9be6b928e2457398b42ae53d92b3bf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:38:03.515488 10853 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6b9be6b928e2457398b42ae53d92b3bf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:38:03.515609 10853 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6b9be6b928e2457398b42ae53d92b3bf [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:38:03.516975 10853 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6b9be6b928e2457398b42ae53d92b3bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b9be6b928e2457398b42ae53d92b3bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38031 } }
I20260808 14:38:03.517388 10853 leader_election.cc:302] T 00000000000000000000000000000000 P 6b9be6b928e2457398b42ae53d92b3bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6b9be6b928e2457398b42ae53d92b3bf; no voters:
I20260808 14:38:03.517746 10853 leader_election.cc:288] T 00000000000000000000000000000000 P 6b9be6b928e2457398b42ae53d92b3bf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:38:03.517868 10862 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6b9be6b928e2457398b42ae53d92b3bf [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:38:03.517887 10856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:03.501936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44965 (local address 127.0.0.1:38031)
0808 14:38:03.502435 (+ 499us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:03.502457 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:03.502506 (+ 49us) server_negotiation.cc:407] Connection header received
0808 14:38:03.503518 (+ 1012us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:03.503550 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:03.504067 (+ 517us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:03.504493 (+ 426us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:03.505260 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:03.506981 (+ 1721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:03.507941 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:03.508739 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:03.508932 (+ 193us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:03.511978 (+ 3046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:03.511984 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:03.511998 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:03.512026 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:03.513932 (+ 1906us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:03.514665 (+ 733us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:03.514672 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:03.514679 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:03.514868 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:03.515278 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:03.515280 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:03.515281 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:03.515884 (+ 603us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:03.516052 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:03.516599 (+ 547us) server_negotiation.cc:299] Negotiation successful
0808 14:38:03.516904 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":326,"thread_start_us":152,"threads_started":1}
I20260808 14:38:03.518115 10862 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6b9be6b928e2457398b42ae53d92b3bf [term 1 LEADER]: Becoming Leader. State: Replica: 6b9be6b928e2457398b42ae53d92b3bf, State: Running, Role: LEADER
I20260808 14:38:03.518460 10862 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6b9be6b928e2457398b42ae53d92b3bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b9be6b928e2457398b42ae53d92b3bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38031 } }
I20260808 14:38:03.519274 10853 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6b9be6b928e2457398b42ae53d92b3bf [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:38:03.519775 10862 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b9be6b928e2457398b42ae53d92b3bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6b9be6b928e2457398b42ae53d92b3bf. Latest consensus state: current_term: 1 leader_uuid: "6b9be6b928e2457398b42ae53d92b3bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b9be6b928e2457398b42ae53d92b3bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38031 } } }
I20260808 14:38:03.519896 10862 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b9be6b928e2457398b42ae53d92b3bf [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:03.520574 10863 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b9be6b928e2457398b42ae53d92b3bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6b9be6b928e2457398b42ae53d92b3bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b9be6b928e2457398b42ae53d92b3bf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38031 } } }
I20260808 14:38:03.520682 10863 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b9be6b928e2457398b42ae53d92b3bf [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:03.520972 10867 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:38:03.521461 11791 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:38:03.524513 10867 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:38:03.533502 10856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:03.523743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50251 (local address 127.0.0.1:38031)
0808 14:38:03.523857 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:03.523862 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:03.524269 (+ 407us) server_negotiation.cc:407] Connection header received
0808 14:38:03.524389 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:03.524393 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:03.524442 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:03.524533 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:03.525845 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:03.526647 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:03.527522 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:03.527774 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:03.527893 (+ 119us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:03.529504 (+ 1611us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:03.529509 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:03.529512 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:03.529542 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:03.531476 (+ 1934us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:03.532078 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:03.532083 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:03.532085 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:03.532181 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:03.532540 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:03.532544 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:03.532545 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:03.532745 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:03.532908 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:03.533194 (+ 286us) server_negotiation.cc:299] Negotiation successful
0808 14:38:03.533321 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 14:38:03.533631 10867 catalog_manager.cc:1347] Generated new cluster ID: 468017d3c5144cf5b374049cdfaa3e25
I20260808 14:38:03.533685 10867 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:38:03.550192 10867 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:38:03.551344 10867 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:38:03.557796 10867 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6b9be6b928e2457398b42ae53d92b3bf: Generated new TSK 0
I20260808 14:38:03.558740 10867 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:38:03.571403 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 10724
W20260808 14:38:03.589028 10703 connection.cc:535] client connection to 127.0.0.1:38031 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38031): Connection reset by peer (error 104)
2026-08-08T14:38:03Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1694 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786199615258783-11791-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:38:03 dist-test-slave-twwt krb5kdc[10906](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:38:03 dist-test-slave-twwt krb5kdc[10906](info): set up 2 sockets
Aug 08 14:38:03 dist-test-slave-twwt krb5kdc[10906](info): commencing operation
krb5kdc: starting...
W20260808 14:38:04.835148 11791 mini_kdc.cc:121] Time spent starting KDC: real 1.231s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Aug 08 14:38:04 dist-test-slave-twwt krb5kdc[10906](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199884, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:38:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:38:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786199615258783-11791-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786199615258783-11791-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:38:04.973861 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32927
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786199615258783-11791-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:32927
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:38:05.094218 10928 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:05.094568 10928 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:05.094714 10928 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:05.098866 10928 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:38:05.098975 10928 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:05.099016 10928 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:05.099053 10928 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:38:05.099092 10928 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:38:05.104662 10928 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786199615258783-11791-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:32927
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786199615258783-11791-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32927
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10928
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:38:05.105935 10928 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:05.107075 10928 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:05.116061 10946 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:05.116036 10939 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:05.116061 10942 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:05.116119 10928 server_base.cc:1034] running on GCE node
I20260808 14:38:05.116874 10928 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:05.117937 10928 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:05.119138 10928 hybrid_clock.cc:648] HybridClock initialized: now 1786199885119109 us; error 39 us; skew 500 ppm
Aug 08 14:38:05 dist-test-slave-twwt krb5kdc[10906](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199885, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:05.122040 10928 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:38:05.123057 10928 webserver.cc:460] Webserver started at http://127.0.0.1:37663/ using document root <none> and password file <none>
I20260808 14:38:05.123636 10928 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:05.123731 10928 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:05.123973 10928 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:38:05.126116 10928 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786199615258783-11791-0/minicluster-data/master-0/data/instance:
uuid: "f147bdfd3a804db5823d09b322315841"
format_stamp: "Formatted at 2026-08-08 14:38:05 on dist-test-slave-twwt"
server_key: "f673820d38544c829e17a966d93f5dfb"
server_key_iv: "f304f700035ab48d41222110a675f115"
server_key_version: "encryptionkey@0"
I20260808 14:38:05.126781 10928 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786199615258783-11791-0/minicluster-data/master-0/wal/instance:
uuid: "f147bdfd3a804db5823d09b322315841"
format_stamp: "Formatted at 2026-08-08 14:38:05 on dist-test-slave-twwt"
server_key: "f673820d38544c829e17a966d93f5dfb"
server_key_iv: "f304f700035ab48d41222110a675f115"
server_key_version: "encryptionkey@0"
I20260808 14:38:05.130856 10928 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 14:38:05.133611 10959 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:05.135073 10928 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:38:05.135231 10928 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "f147bdfd3a804db5823d09b322315841"
format_stamp: "Formatted at 2026-08-08 14:38:05 on dist-test-slave-twwt"
server_key: "f673820d38544c829e17a966d93f5dfb"
server_key_iv: "f304f700035ab48d41222110a675f115"
server_key_version: "encryptionkey@0"
I20260808 14:38:05.135382 10928 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:05.159104 10928 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:05.162778 10928 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:05.163018 10928 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:05.171350 10928 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:32927
I20260808 14:38:05.171381 11053 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:32927 every 8 connection(s)
I20260808 14:38:05.172415 10928 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:38:05.175544 11054 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:38:05.181788 11054 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f147bdfd3a804db5823d09b322315841: Bootstrap starting.
I20260808 14:38:05.182371 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 10928
I20260808 14:38:05.182524 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786199615258783-11791-0/minicluster-data/master-0/wal/instance
I20260808 14:38:05.182861 11791 external_mini_cluster.cc:1428] Setting key dc59a827127e66a8b43d834cf31577d1
I20260808 14:38:05.184926 11054 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f147bdfd3a804db5823d09b322315841: Neither blocks nor log segments found. Creating new log.
I20260808 14:38:05.185751 11054 log.cc:824] T 00000000000000000000000000000000 P f147bdfd3a804db5823d09b322315841: Log is configured to *not* fsync() on all Append() calls
I20260808 14:38:05.188051 11054 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f147bdfd3a804db5823d09b322315841: No bootstrap required, opened a new log
I20260808 14:38:05.192485 11054 raft_consensus.cc:348] T 00000000000000000000000000000000 P f147bdfd3a804db5823d09b322315841 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f147bdfd3a804db5823d09b322315841" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32927 } }
I20260808 14:38:05.192704 11057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:05.184320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45469 (local address 127.0.0.1:32927)
0808 14:38:05.184799 (+ 479us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:05.184815 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:05.184852 (+ 37us) server_negotiation.cc:407] Connection header received
0808 14:38:05.185583 (+ 731us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:05.185602 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:05.186024 (+ 422us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:05.186413 (+ 389us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:05.186879 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:05.187844 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:05.189068 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:05.189548 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:05.189689 (+ 141us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:05.190793 (+ 1104us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:05.190799 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:05.190813 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:38:05.191215 (+ 402us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:05.191293 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:38:05.191317 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:05.191429 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:05.191644 (+ 215us) server_negotiation.cc:299] Negotiation successful
0808 14:38:05.191822 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":325,"thread_start_us":162,"threads_started":1}
I20260808 14:38:05.192740 11054 raft_consensus.cc:374] T 00000000000000000000000000000000 P f147bdfd3a804db5823d09b322315841 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:38:05.193040 11054 raft_consensus.cc:729] T 00000000000000000000000000000000 P f147bdfd3a804db5823d09b322315841 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f147bdfd3a804db5823d09b322315841, State: Initialized, Role: FOLLOWER
I20260808 14:38:05.193563 11054 consensus_queue.cc:260] T 00000000000000000000000000000000 P f147bdfd3a804db5823d09b322315841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f147bdfd3a804db5823d09b322315841" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32927 } }
I20260808 14:38:05.193733 11054 raft_consensus.cc:388] T 00000000000000000000000000000000 P f147bdfd3a804db5823d09b322315841 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:38:05.193789 11054 raft_consensus.cc:482] T 00000000000000000000000000000000 P f147bdfd3a804db5823d09b322315841 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:38:05.193899 11054 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f147bdfd3a804db5823d09b322315841 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:38:05.195075 11054 raft_consensus.cc:504] T 00000000000000000000000000000000 P f147bdfd3a804db5823d09b322315841 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f147bdfd3a804db5823d09b322315841" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32927 } }
I20260808 14:38:05.195482 11054 leader_election.cc:302] T 00000000000000000000000000000000 P f147bdfd3a804db5823d09b322315841 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f147bdfd3a804db5823d09b322315841; no voters:
I20260808 14:38:05.195883 11054 leader_election.cc:288] T 00000000000000000000000000000000 P f147bdfd3a804db5823d09b322315841 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:38:05.195989 11059 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f147bdfd3a804db5823d09b322315841 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:38:05.196156 11791 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:38:05.196184 11059 raft_consensus.cc:686] T 00000000000000000000000000000000 P f147bdfd3a804db5823d09b322315841 [term 1 LEADER]: Becoming Leader. State: Replica: f147bdfd3a804db5823d09b322315841, State: Running, Role: LEADER
I20260808 14:38:05.196509 11059 consensus_queue.cc:237] T 00000000000000000000000000000000 P f147bdfd3a804db5823d09b322315841 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f147bdfd3a804db5823d09b322315841" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32927 } }
I20260808 14:38:05.197260 11054 sys_catalog.cc:564] T 00000000000000000000000000000000 P f147bdfd3a804db5823d09b322315841 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:38:05.197763 11059 sys_catalog.cc:455] T 00000000000000000000000000000000 P f147bdfd3a804db5823d09b322315841 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f147bdfd3a804db5823d09b322315841. Latest consensus state: current_term: 1 leader_uuid: "f147bdfd3a804db5823d09b322315841" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f147bdfd3a804db5823d09b322315841" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32927 } } }
I20260808 14:38:05.197880 11059 sys_catalog.cc:458] T 00000000000000000000000000000000 P f147bdfd3a804db5823d09b322315841 [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:05.198256 11060 sys_catalog.cc:455] T 00000000000000000000000000000000 P f147bdfd3a804db5823d09b322315841 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f147bdfd3a804db5823d09b322315841" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f147bdfd3a804db5823d09b322315841" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32927 } } }
I20260808 14:38:05.198361 11060 sys_catalog.cc:458] T 00000000000000000000000000000000 P f147bdfd3a804db5823d09b322315841 [sys.catalog]: This master's current role is: LEADER
W20260808 14:38:05.202924 11094 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f147bdfd3a804db5823d09b322315841: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:38:05.203019 11094 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:38:05.203087 11073 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:38:05.203877 11073 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:38:05.203883 11057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:05.198629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40261 (local address 127.0.0.1:32927)
0808 14:38:05.198748 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:05.198753 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:05.199779 (+ 1026us) server_negotiation.cc:407] Connection header received
0808 14:38:05.200123 (+ 344us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:05.200127 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:05.200176 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:05.200273 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:05.200657 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:05.201181 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:05.202045 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:05.202280 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:05.202385 (+ 105us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:05.203416 (+ 1031us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:05.203419 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:05.203422 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:38:05.203441 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:05.203466 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:38:05.203477 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:05.203571 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:05.203695 (+ 124us) server_negotiation.cc:299] Negotiation successful
0808 14:38:05.203737 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 14:38:05.210078 11073 catalog_manager.cc:1347] Generated new cluster ID: ea6e23e657234e28a35627cd4923eb02
I20260808 14:38:05.210161 11073 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:38:05.222514 11073 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:38:05.223629 11073 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:38:05.229234 11073 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f147bdfd3a804db5823d09b322315841: Generated new TSK 0
I20260808 14:38:05.229995 11073 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:38:05.240823 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 10928
W20260808 14:38:05.252095 10902 connection.cc:535] client connection to 127.0.0.1:32927 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:32927): Connection reset by peer (error 104)
2026-08-08T14:38:05Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1663 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786199615258783-11791-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:38:05 dist-test-slave-twwt krb5kdc[11107](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:38:05 dist-test-slave-twwt krb5kdc[11107](info): set up 2 sockets
Aug 08 14:38:05 dist-test-slave-twwt krb5kdc[11107](info): commencing operation
krb5kdc: starting...
W20260808 14:38:06.516889 11791 mini_kdc.cc:121] Time spent starting KDC: real 1.249s user 0.006s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Aug 08 14:38:06 dist-test-slave-twwt krb5kdc[11107](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199886, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:38:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:38:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786199615258783-11791-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786199615258783-11791-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:38:06.663781 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38115
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786199615258783-11791-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44627
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38115
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:38:06.781670 11130 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:06.781947 11130 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:06.781989 11130 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:06.787606 11130 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:38:06.787679 11130 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:06.787700 11130 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:06.787719 11130 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:38:06.787774 11130 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:38:06.793475 11130 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44627
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786199615258783-11791-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38115
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786199615258783-11791-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38115
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11130
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:38:06.794747 11130 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:06.795876 11130 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:06.805140 11146 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:06.805127 11139 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:06.805171 11130 server_base.cc:1034] running on GCE node
W20260808 14:38:06.805176 11140 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:06.806119 11130 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:06.807358 11130 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:06.808552 11130 hybrid_clock.cc:648] HybridClock initialized: now 1786199886808533 us; error 29 us; skew 500 ppm
Aug 08 14:38:06 dist-test-slave-twwt krb5kdc[11107](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199886, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:06.811522 11130 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:38:06.812489 11130 webserver.cc:460] Webserver started at http://127.0.0.1:42373/ using document root <none> and password file <none>
I20260808 14:38:06.813047 11130 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:06.813112 11130 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:06.813285 11130 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:38:06.815423 11130 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786199615258783-11791-0/minicluster-data/master-0/data/instance:
uuid: "afbbee019d054224b48f8023bbc80ff3"
format_stamp: "Formatted at 2026-08-08 14:38:06 on dist-test-slave-twwt"
server_key: "3072908bbf74f9e1fb64c31eb3f11ebc"
server_key_iv: "4aa77a2282d53012e9946f5bfac1e073"
server_key_version: "encryptionkey@0"
I20260808 14:38:06.815979 11130 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786199615258783-11791-0/minicluster-data/master-0/wal/instance:
uuid: "afbbee019d054224b48f8023bbc80ff3"
format_stamp: "Formatted at 2026-08-08 14:38:06 on dist-test-slave-twwt"
server_key: "3072908bbf74f9e1fb64c31eb3f11ebc"
server_key_iv: "4aa77a2282d53012e9946f5bfac1e073"
server_key_version: "encryptionkey@0"
I20260808 14:38:06.819674 11130 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 14:38:06.822186 11157 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:06.823494 11130 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 14:38:06.823601 11130 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "afbbee019d054224b48f8023bbc80ff3"
format_stamp: "Formatted at 2026-08-08 14:38:06 on dist-test-slave-twwt"
server_key: "3072908bbf74f9e1fb64c31eb3f11ebc"
server_key_iv: "4aa77a2282d53012e9946f5bfac1e073"
server_key_version: "encryptionkey@0"
I20260808 14:38:06.823688 11130 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:06.828109 11130 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:06.831166 11130 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:06.831318 11130 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:06.838297 11130 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38115
I20260808 14:38:06.838376 11232 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38115 every 8 connection(s)
I20260808 14:38:06.839327 11130 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:38:06.840884 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 11130
I20260808 14:38:06.841048 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786199615258783-11791-0/minicluster-data/master-0/wal/instance
I20260808 14:38:06.841387 11791 external_mini_cluster.cc:1428] Setting key 1a58baa1955ed3cbd14ee93499db3496
I20260808 14:38:06.842520 11233 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:38:06.847289 11237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:06.842895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52945 (local address 127.0.0.1:38115)
0808 14:38:06.843336 (+ 441us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:06.843356 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:06.843399 (+ 43us) server_negotiation.cc:407] Connection header received
0808 14:38:06.844304 (+ 905us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:06.844341 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:06.844689 (+ 348us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:06.845062 (+ 373us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:06.845813 (+ 751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:06.845819 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:06.845835 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:38:06.845848 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:06.845916 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:38:06.845944 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:06.846095 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:06.846166 (+ 71us) server_negotiation.cc:299] Negotiation successful
0808 14:38:06.846335 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":281,"thread_start_us":120,"threads_started":1}
I20260808 14:38:06.849853 11233 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P afbbee019d054224b48f8023bbc80ff3: Bootstrap starting.
I20260808 14:38:06.850240 11791 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:38:06.852239 11233 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P afbbee019d054224b48f8023bbc80ff3: Neither blocks nor log segments found. Creating new log.
I20260808 14:38:06.853200 11233 log.cc:824] T 00000000000000000000000000000000 P afbbee019d054224b48f8023bbc80ff3: Log is configured to *not* fsync() on all Append() calls
I20260808 14:38:06.854115 11237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:06.852389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56557 (local address 127.0.0.1:38115)
0808 14:38:06.852534 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:06.852541 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:06.852765 (+ 224us) server_negotiation.cc:407] Connection header received
0808 14:38:06.852861 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:06.852864 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:06.852898 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:06.852976 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:06.853712 (+ 736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:06.853716 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:06.853719 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:38:06.853733 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:06.853760 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:38:06.853773 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:06.853875 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:06.853943 (+ 68us) server_negotiation.cc:299] Negotiation successful
0808 14:38:06.853983 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 14:38:06.855368 11233 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P afbbee019d054224b48f8023bbc80ff3: No bootstrap required, opened a new log
I20260808 14:38:06.858881 11233 raft_consensus.cc:348] T 00000000000000000000000000000000 P afbbee019d054224b48f8023bbc80ff3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afbbee019d054224b48f8023bbc80ff3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38115 } }
I20260808 14:38:06.859102 11233 raft_consensus.cc:374] T 00000000000000000000000000000000 P afbbee019d054224b48f8023bbc80ff3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:38:06.859184 11233 raft_consensus.cc:729] T 00000000000000000000000000000000 P afbbee019d054224b48f8023bbc80ff3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afbbee019d054224b48f8023bbc80ff3, State: Initialized, Role: FOLLOWER
I20260808 14:38:06.859643 11233 consensus_queue.cc:260] T 00000000000000000000000000000000 P afbbee019d054224b48f8023bbc80ff3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afbbee019d054224b48f8023bbc80ff3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38115 } }
I20260808 14:38:06.859794 11233 raft_consensus.cc:388] T 00000000000000000000000000000000 P afbbee019d054224b48f8023bbc80ff3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:38:06.859894 11233 raft_consensus.cc:482] T 00000000000000000000000000000000 P afbbee019d054224b48f8023bbc80ff3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:38:06.860013 11233 raft_consensus.cc:3037] T 00000000000000000000000000000000 P afbbee019d054224b48f8023bbc80ff3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:38:06.860884 11233 raft_consensus.cc:504] T 00000000000000000000000000000000 P afbbee019d054224b48f8023bbc80ff3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afbbee019d054224b48f8023bbc80ff3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38115 } }
I20260808 14:38:06.861299 11233 leader_election.cc:302] T 00000000000000000000000000000000 P afbbee019d054224b48f8023bbc80ff3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: afbbee019d054224b48f8023bbc80ff3; no voters:
I20260808 14:38:06.861678 11233 leader_election.cc:288] T 00000000000000000000000000000000 P afbbee019d054224b48f8023bbc80ff3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:38:06.861812 11249 raft_consensus.cc:2781] T 00000000000000000000000000000000 P afbbee019d054224b48f8023bbc80ff3 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:38:06.862089 11249 raft_consensus.cc:686] T 00000000000000000000000000000000 P afbbee019d054224b48f8023bbc80ff3 [term 1 LEADER]: Becoming Leader. State: Replica: afbbee019d054224b48f8023bbc80ff3, State: Running, Role: LEADER
I20260808 14:38:06.862473 11249 consensus_queue.cc:237] T 00000000000000000000000000000000 P afbbee019d054224b48f8023bbc80ff3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afbbee019d054224b48f8023bbc80ff3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38115 } }
I20260808 14:38:06.862993 11233 sys_catalog.cc:564] T 00000000000000000000000000000000 P afbbee019d054224b48f8023bbc80ff3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:38:06.864202 11251 sys_catalog.cc:455] T 00000000000000000000000000000000 P afbbee019d054224b48f8023bbc80ff3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "afbbee019d054224b48f8023bbc80ff3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afbbee019d054224b48f8023bbc80ff3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38115 } } }
I20260808 14:38:06.864347 11251 sys_catalog.cc:458] T 00000000000000000000000000000000 P afbbee019d054224b48f8023bbc80ff3 [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:06.864732 11253 sys_catalog.cc:455] T 00000000000000000000000000000000 P afbbee019d054224b48f8023bbc80ff3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader afbbee019d054224b48f8023bbc80ff3. Latest consensus state: current_term: 1 leader_uuid: "afbbee019d054224b48f8023bbc80ff3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afbbee019d054224b48f8023bbc80ff3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38115 } } }
I20260808 14:38:06.864904 11253 sys_catalog.cc:458] T 00000000000000000000000000000000 P afbbee019d054224b48f8023bbc80ff3 [sys.catalog]: This master's current role is: LEADER
W20260808 14:38:06.868140 11274 catalog_manager.cc:1558] T 00000000000000000000000000000000 P afbbee019d054224b48f8023bbc80ff3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:38:06.868238 11274 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:38:06.868330 11265 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:38:06.869084 11265 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:38:06.875409 11265 catalog_manager.cc:1347] Generated new cluster ID: 68837dc12fa4497bb2ba01da9e9e3d57
I20260808 14:38:06.875494 11265 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:38:06.884727 11265 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:38:06.885095 11265 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:38:06.890668 11265 catalog_manager.cc:5868] T 00000000000000000000000000000000 P afbbee019d054224b48f8023bbc80ff3: Generated new TSK 0
I20260808 14:38:06.891525 11265 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:38:06.896881 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 11130
2026-08-08T14:38:06Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1666 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786199615258783-11791-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:38:06 dist-test-slave-twwt krb5kdc[11284](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:38:06 dist-test-slave-twwt krb5kdc[11284](info): set up 2 sockets
Aug 08 14:38:06 dist-test-slave-twwt krb5kdc[11284](info): commencing operation
krb5kdc: starting...
W20260808 14:38:08.170190 11791 mini_kdc.cc:121] Time spent starting KDC: real 1.236s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Aug 08 14:38:08 dist-test-slave-twwt krb5kdc[11284](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199888, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:38:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:38:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786199615258783-11791-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786199615258783-11791-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:38:08.305923 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39577
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786199615258783-11791-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41047
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39577
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:38:08.424165 11303 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:08.424515 11303 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:08.424605 11303 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:08.428768 11303 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:38:08.428879 11303 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:08.428922 11303 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:08.428960 11303 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:38:08.428994 11303 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:38:08.434531 11303 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41047
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786199615258783-11791-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39577
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786199615258783-11791-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39577
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11303
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:38:08.435734 11303 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:08.436831 11303 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:08.445883 11312 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:08.445916 11308 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:08.446062 11303 server_base.cc:1034] running on GCE node
W20260808 14:38:08.445886 11310 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:08.446882 11303 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:08.448022 11303 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:08.449218 11303 hybrid_clock.cc:648] HybridClock initialized: now 1786199888449200 us; error 29 us; skew 500 ppm
Aug 08 14:38:08 dist-test-slave-twwt krb5kdc[11284](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199888, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:08.452075 11303 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:38:08.453019 11303 webserver.cc:460] Webserver started at http://127.0.0.1:38755/ using document root <none> and password file <none>
I20260808 14:38:08.453539 11303 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:08.453596 11303 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:08.453758 11303 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:38:08.455920 11303 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786199615258783-11791-0/minicluster-data/master-0/data/instance:
uuid: "505a1af9b13747e8a213a98817f63c10"
format_stamp: "Formatted at 2026-08-08 14:38:08 on dist-test-slave-twwt"
server_key: "3f70903759aac03c9b110010b535ba47"
server_key_iv: "4383585976e95036f14cff08e6c52f1f"
server_key_version: "encryptionkey@0"
I20260808 14:38:08.456459 11303 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786199615258783-11791-0/minicluster-data/master-0/wal/instance:
uuid: "505a1af9b13747e8a213a98817f63c10"
format_stamp: "Formatted at 2026-08-08 14:38:08 on dist-test-slave-twwt"
server_key: "3f70903759aac03c9b110010b535ba47"
server_key_iv: "4383585976e95036f14cff08e6c52f1f"
server_key_version: "encryptionkey@0"
I20260808 14:38:08.460203 11303 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 14:38:08.462586 11321 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:08.464006 11303 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 14:38:08.464135 11303 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "505a1af9b13747e8a213a98817f63c10"
format_stamp: "Formatted at 2026-08-08 14:38:08 on dist-test-slave-twwt"
server_key: "3f70903759aac03c9b110010b535ba47"
server_key_iv: "4383585976e95036f14cff08e6c52f1f"
server_key_version: "encryptionkey@0"
I20260808 14:38:08.464250 11303 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:08.490456 11303 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:08.493700 11303 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:08.493891 11303 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:08.501277 11303 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39577
I20260808 14:38:08.501303 11401 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39577 every 8 connection(s)
I20260808 14:38:08.502265 11303 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:38:08.503500 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 11303
I20260808 14:38:08.503643 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786199615258783-11791-0/minicluster-data/master-0/wal/instance
I20260808 14:38:08.503947 11791 external_mini_cluster.cc:1428] Setting key 155aba1d7380ea16b13b2a3a9f1f906d
I20260808 14:38:08.505512 11405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:38:08.511427 11405 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 505a1af9b13747e8a213a98817f63c10: Bootstrap starting.
Aug 08 14:38:08 dist-test-slave-twwt krb5kdc[11284](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199888, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 14:38:08.513897 11405 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 505a1af9b13747e8a213a98817f63c10: Neither blocks nor log segments found. Creating new log.
I20260808 14:38:08.514822 11405 log.cc:824] T 00000000000000000000000000000000 P 505a1af9b13747e8a213a98817f63c10: Log is configured to *not* fsync() on all Append() calls
I20260808 14:38:08.517138 11405 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 505a1af9b13747e8a213a98817f63c10: No bootstrap required, opened a new log
I20260808 14:38:08.518198 11411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:08.505415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34653 (local address 127.0.0.1:39577)
0808 14:38:08.505867 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:08.505884 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:08.505920 (+ 36us) server_negotiation.cc:407] Connection header received
0808 14:38:08.506571 (+ 651us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:08.506588 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:08.507010 (+ 422us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:08.507370 (+ 360us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:08.508195 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:08.509190 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:08.510070 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:08.510553 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:08.510766 (+ 213us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:08.513330 (+ 2564us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:08.513340 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:08.513354 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:08.513383 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:08.515283 (+ 1900us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:08.515799 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:08.515804 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:08.515809 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:08.515924 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:08.516229 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:08.516232 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:08.516233 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:08.516645 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:08.516779 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:08.517130 (+ 351us) server_negotiation.cc:299] Negotiation successful
0808 14:38:08.517478 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":309,"thread_start_us":159,"threads_started":1}
I20260808 14:38:08.520599 11405 raft_consensus.cc:348] T 00000000000000000000000000000000 P 505a1af9b13747e8a213a98817f63c10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "505a1af9b13747e8a213a98817f63c10" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39577 } }
I20260808 14:38:08.520897 11405 raft_consensus.cc:374] T 00000000000000000000000000000000 P 505a1af9b13747e8a213a98817f63c10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:38:08.520979 11405 raft_consensus.cc:729] T 00000000000000000000000000000000 P 505a1af9b13747e8a213a98817f63c10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 505a1af9b13747e8a213a98817f63c10, State: Initialized, Role: FOLLOWER
I20260808 14:38:08.521481 11405 consensus_queue.cc:260] T 00000000000000000000000000000000 P 505a1af9b13747e8a213a98817f63c10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "505a1af9b13747e8a213a98817f63c10" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39577 } }
I20260808 14:38:08.521653 11405 raft_consensus.cc:388] T 00000000000000000000000000000000 P 505a1af9b13747e8a213a98817f63c10 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:38:08.521728 11405 raft_consensus.cc:482] T 00000000000000000000000000000000 P 505a1af9b13747e8a213a98817f63c10 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:38:08.521736 11791 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:38:08.521821 11405 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 505a1af9b13747e8a213a98817f63c10 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:38:08.522765 11405 raft_consensus.cc:504] T 00000000000000000000000000000000 P 505a1af9b13747e8a213a98817f63c10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "505a1af9b13747e8a213a98817f63c10" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39577 } }
I20260808 14:38:08.523123 11405 leader_election.cc:302] T 00000000000000000000000000000000 P 505a1af9b13747e8a213a98817f63c10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 505a1af9b13747e8a213a98817f63c10; no voters:
I20260808 14:38:08.523418 11405 leader_election.cc:288] T 00000000000000000000000000000000 P 505a1af9b13747e8a213a98817f63c10 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:38:08.523527 11419 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 505a1af9b13747e8a213a98817f63c10 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:38:08.523741 11419 raft_consensus.cc:686] T 00000000000000000000000000000000 P 505a1af9b13747e8a213a98817f63c10 [term 1 LEADER]: Becoming Leader. State: Replica: 505a1af9b13747e8a213a98817f63c10, State: Running, Role: LEADER
I20260808 14:38:08.524098 11419 consensus_queue.cc:237] T 00000000000000000000000000000000 P 505a1af9b13747e8a213a98817f63c10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "505a1af9b13747e8a213a98817f63c10" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39577 } }
I20260808 14:38:08.524730 11405 sys_catalog.cc:564] T 00000000000000000000000000000000 P 505a1af9b13747e8a213a98817f63c10 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:38:08.525885 11420 sys_catalog.cc:455] T 00000000000000000000000000000000 P 505a1af9b13747e8a213a98817f63c10 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "505a1af9b13747e8a213a98817f63c10" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "505a1af9b13747e8a213a98817f63c10" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39577 } } }
I20260808 14:38:08.526010 11420 sys_catalog.cc:458] T 00000000000000000000000000000000 P 505a1af9b13747e8a213a98817f63c10 [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:08.526309 11421 sys_catalog.cc:455] T 00000000000000000000000000000000 P 505a1af9b13747e8a213a98817f63c10 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 505a1af9b13747e8a213a98817f63c10. Latest consensus state: current_term: 1 leader_uuid: "505a1af9b13747e8a213a98817f63c10" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "505a1af9b13747e8a213a98817f63c10" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39577 } } }
I20260808 14:38:08.526485 11421 sys_catalog.cc:458] T 00000000000000000000000000000000 P 505a1af9b13747e8a213a98817f63c10 [sys.catalog]: This master's current role is: LEADER
W20260808 14:38:08.530272 11441 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 505a1af9b13747e8a213a98817f63c10: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:38:08.530375 11441 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:38:08.530490 11430 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:38:08.531261 11430 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:38:08.533306 11411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:08.524027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56357 (local address 127.0.0.1:39577)
0808 14:38:08.524121 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:08.524125 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:08.524523 (+ 398us) server_negotiation.cc:407] Connection header received
0808 14:38:08.524676 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:08.524679 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:08.524720 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:08.524809 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:08.525689 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:08.526472 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:08.527865 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:08.528089 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:08.528175 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:08.529688 (+ 1513us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:08.529692 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:08.529695 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:08.529721 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:08.531440 (+ 1719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:08.531934 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:08.531938 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:08.531940 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:08.532031 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:08.532350 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:08.532354 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:08.532355 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:08.532580 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:08.532764 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:08.533024 (+ 260us) server_negotiation.cc:299] Negotiation successful
0808 14:38:08.533143 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 14:38:08.537016 11430 catalog_manager.cc:1347] Generated new cluster ID: dd6effad32c645b5b180d1a7bdc0ef05
I20260808 14:38:08.537078 11430 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:38:08.542109 11430 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:38:08.543406 11430 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:38:08.552783 11430 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 505a1af9b13747e8a213a98817f63c10: Generated new TSK 0
I20260808 14:38:08.553574 11430 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:38:08.557991 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 11303
2026-08-08T14:38:08Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1656 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786199615258783-11791-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:38:08 dist-test-slave-twwt krb5kdc[11449](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:38:08 dist-test-slave-twwt krb5kdc[11449](info): set up 2 sockets
Aug 08 14:38:08 dist-test-slave-twwt krb5kdc[11449](info): commencing operation
krb5kdc: starting...
W20260808 14:38:09.808411 11791 mini_kdc.cc:121] Time spent starting KDC: real 1.218s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Aug 08 14:38:09 dist-test-slave-twwt krb5kdc[11449](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199889, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:38:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:38:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786199615258783-11791-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786199615258783-11791-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:38:09.943773 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36121
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786199615258783-11791-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38493
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36121
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:38:10.065754 11468 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:10.066036 11468 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:10.066080 11468 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:10.070263 11468 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:38:10.070330 11468 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:10.070350 11468 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:10.070367 11468 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:38:10.070384 11468 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:38:10.075798 11468 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38493
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786199615258783-11791-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36121
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786199615258783-11791-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36121
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11468
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:38:10.076862 11468 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:10.077888 11468 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:10.087033 11477 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:10.087033 11478 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:10.087232 11468 server_base.cc:1034] running on GCE node
W20260808 14:38:10.087097 11482 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:10.087991 11468 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:10.089176 11468 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:10.090371 11468 hybrid_clock.cc:648] HybridClock initialized: now 1786199890090350 us; error 33 us; skew 500 ppm
Aug 08 14:38:10 dist-test-slave-twwt krb5kdc[11449](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199890, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:10.093663 11468 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:38:10.094794 11468 webserver.cc:460] Webserver started at http://127.0.0.1:36245/ using document root <none> and password file <none>
I20260808 14:38:10.095436 11468 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:10.095507 11468 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:10.095782 11468 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:38:10.098102 11468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786199615258783-11791-0/minicluster-data/master-0/data/instance:
uuid: "2bbb760860224038bdd64d01d294def7"
format_stamp: "Formatted at 2026-08-08 14:38:10 on dist-test-slave-twwt"
server_key: "1ed2e2d447adffc8ffab55881fc0c01d"
server_key_iv: "22148a497c5b9f5b94ca43bc4b1b3546"
server_key_version: "encryptionkey@0"
I20260808 14:38:10.098809 11468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786199615258783-11791-0/minicluster-data/master-0/wal/instance:
uuid: "2bbb760860224038bdd64d01d294def7"
format_stamp: "Formatted at 2026-08-08 14:38:10 on dist-test-slave-twwt"
server_key: "1ed2e2d447adffc8ffab55881fc0c01d"
server_key_iv: "22148a497c5b9f5b94ca43bc4b1b3546"
server_key_version: "encryptionkey@0"
I20260808 14:38:10.102885 11468 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 14:38:10.105479 11494 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:10.106773 11468 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 14:38:10.106938 11468 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "2bbb760860224038bdd64d01d294def7"
format_stamp: "Formatted at 2026-08-08 14:38:10 on dist-test-slave-twwt"
server_key: "1ed2e2d447adffc8ffab55881fc0c01d"
server_key_iv: "22148a497c5b9f5b94ca43bc4b1b3546"
server_key_version: "encryptionkey@0"
I20260808 14:38:10.107041 11468 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:10.136678 11468 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:10.140234 11468 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:10.140458 11468 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:10.147775 11468 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36121
I20260808 14:38:10.147811 11575 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36121 every 8 connection(s)
I20260808 14:38:10.148824 11468 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:38:10.151767 11576 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:38:10.152190 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 11468
I20260808 14:38:10.152343 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786199615258783-11791-0/minicluster-data/master-0/wal/instance
I20260808 14:38:10.152666 11791 external_mini_cluster.cc:1428] Setting key 34f8c8fe6d87d5e2d5817fa235eaea37
I20260808 14:38:10.159826 11576 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2bbb760860224038bdd64d01d294def7: Bootstrap starting.
I20260808 14:38:10.162696 11576 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2bbb760860224038bdd64d01d294def7: Neither blocks nor log segments found. Creating new log.
I20260808 14:38:10.163483 11581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:10.154283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50389 (local address 127.0.0.1:36121)
0808 14:38:10.154782 (+ 499us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:10.154805 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:10.154864 (+ 59us) server_negotiation.cc:407] Connection header received
0808 14:38:10.155629 (+ 765us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:10.155655 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:10.156138 (+ 483us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:10.156535 (+ 397us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:10.156976 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:10.158487 (+ 1511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:10.159542 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:10.160239 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:10.160402 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:10.161339 (+ 937us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:10.161345 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:10.161364 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:38:10.161878 (+ 514us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:10.161949 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:38:10.161982 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:10.162081 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:10.162242 (+ 161us) server_negotiation.cc:299] Negotiation successful
0808 14:38:10.162462 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":118,"threads_started":1}
I20260808 14:38:10.163640 11576 log.cc:824] T 00000000000000000000000000000000 P 2bbb760860224038bdd64d01d294def7: Log is configured to *not* fsync() on all Append() calls
I20260808 14:38:10.166145 11576 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2bbb760860224038bdd64d01d294def7: No bootstrap required, opened a new log
I20260808 14:38:10.166870 11791 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:38:10.170392 11576 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2bbb760860224038bdd64d01d294def7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bbb760860224038bdd64d01d294def7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36121 } }
I20260808 14:38:10.170680 11576 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2bbb760860224038bdd64d01d294def7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:38:10.170773 11576 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2bbb760860224038bdd64d01d294def7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bbb760860224038bdd64d01d294def7, State: Initialized, Role: FOLLOWER
I20260808 14:38:10.171263 11576 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2bbb760860224038bdd64d01d294def7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bbb760860224038bdd64d01d294def7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36121 } }
I20260808 14:38:10.171442 11576 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2bbb760860224038bdd64d01d294def7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:38:10.171538 11576 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2bbb760860224038bdd64d01d294def7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:38:10.171674 11576 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2bbb760860224038bdd64d01d294def7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:38:10.172845 11576 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2bbb760860224038bdd64d01d294def7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bbb760860224038bdd64d01d294def7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36121 } }
I20260808 14:38:10.173229 11576 leader_election.cc:302] T 00000000000000000000000000000000 P 2bbb760860224038bdd64d01d294def7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2bbb760860224038bdd64d01d294def7; no voters:
I20260808 14:38:10.173496 11581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:10.169116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54499 (local address 127.0.0.1:36121)
0808 14:38:10.169257 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:10.169262 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:10.169436 (+ 174us) server_negotiation.cc:407] Connection header received
0808 14:38:10.169598 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:10.169606 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:10.169650 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:10.169734 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:10.170063 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:10.170588 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:10.171701 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:10.172076 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:10.172185 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:10.173052 (+ 867us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:10.173056 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:10.173059 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:38:10.173079 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:10.173109 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:38:10.173120 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:10.173199 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:10.173302 (+ 103us) server_negotiation.cc:299] Negotiation successful
0808 14:38:10.173358 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 14:38:10.173650 11576 leader_election.cc:288] T 00000000000000000000000000000000 P 2bbb760860224038bdd64d01d294def7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:38:10.173739 11590 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2bbb760860224038bdd64d01d294def7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:38:10.173947 11590 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2bbb760860224038bdd64d01d294def7 [term 1 LEADER]: Becoming Leader. State: Replica: 2bbb760860224038bdd64d01d294def7, State: Running, Role: LEADER
I20260808 14:38:10.174288 11590 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2bbb760860224038bdd64d01d294def7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bbb760860224038bdd64d01d294def7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36121 } }
I20260808 14:38:10.175118 11576 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2bbb760860224038bdd64d01d294def7 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:38:10.175607 11593 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2bbb760860224038bdd64d01d294def7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2bbb760860224038bdd64d01d294def7. Latest consensus state: current_term: 1 leader_uuid: "2bbb760860224038bdd64d01d294def7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bbb760860224038bdd64d01d294def7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36121 } } }
I20260808 14:38:10.175746 11593 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2bbb760860224038bdd64d01d294def7 [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:10.176479 11592 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2bbb760860224038bdd64d01d294def7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2bbb760860224038bdd64d01d294def7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bbb760860224038bdd64d01d294def7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36121 } } }
I20260808 14:38:10.176584 11592 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2bbb760860224038bdd64d01d294def7 [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:10.177711 11598 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:38:10.181162 11598 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:38:10.187480 11598 catalog_manager.cc:1347] Generated new cluster ID: 905c03d8d84748f1942768f961f48bdb
I20260808 14:38:10.187559 11598 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:38:10.204576 11598 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:38:10.205968 11598 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:38:10.211410 11598 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2bbb760860224038bdd64d01d294def7: Generated new TSK 0
I20260808 14:38:10.212261 11598 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:38:10.226230 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 11468
2026-08-08T14:38:10Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1669 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786199615258783-11791-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:38:10 dist-test-slave-twwt krb5kdc[11626](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:38:10 dist-test-slave-twwt krb5kdc[11626](info): set up 2 sockets
Aug 08 14:38:10 dist-test-slave-twwt krb5kdc[11626](info): commencing operation
krb5kdc: starting...
W20260808 14:38:11.482815 11791 mini_kdc.cc:121] Time spent starting KDC: real 1.223s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Aug 08 14:38:11 dist-test-slave-twwt krb5kdc[11626](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199891, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:38:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:38:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786199615258783-11791-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786199615258783-11791-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:38:11.618072 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45757
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786199615258783-11791-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45757
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:38:11.734139 11644 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:11.734445 11644 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:11.734527 11644 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:11.738524 11644 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:38:11.738643 11644 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:11.738695 11644 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:11.738751 11644 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:38:11.738790 11644 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:38:11.744200 11644 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786199615258783-11791-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45757
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786199615258783-11791-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45757
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11644
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:38:11.745340 11644 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:11.746414 11644 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:11.755353 11655 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:11.755298 11653 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:11.755568 11644 server_base.cc:1034] running on GCE node
W20260808 14:38:11.755735 11652 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:11.756372 11644 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:11.757632 11644 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:11.758836 11644 hybrid_clock.cc:648] HybridClock initialized: now 1786199891758814 us; error 35 us; skew 500 ppm
Aug 08 14:38:11 dist-test-slave-twwt krb5kdc[11626](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199891, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:11.761894 11644 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:38:11.762950 11644 webserver.cc:460] Webserver started at http://127.0.0.1:34705/ using document root <none> and password file <none>
I20260808 14:38:11.763576 11644 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:11.763675 11644 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:11.763942 11644 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:38:11.766300 11644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786199615258783-11791-0/minicluster-data/master-0/data/instance:
uuid: "e3aad1340e564aa2a4497ee52334dac4"
format_stamp: "Formatted at 2026-08-08 14:38:11 on dist-test-slave-twwt"
server_key: "bb82a4fd4cb6a1b9c3a5ef25c1db736c"
server_key_iv: "184810a73bb5b765a1da374a39ade961"
server_key_version: "encryptionkey@0"
I20260808 14:38:11.766958 11644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786199615258783-11791-0/minicluster-data/master-0/wal/instance:
uuid: "e3aad1340e564aa2a4497ee52334dac4"
format_stamp: "Formatted at 2026-08-08 14:38:11 on dist-test-slave-twwt"
server_key: "bb82a4fd4cb6a1b9c3a5ef25c1db736c"
server_key_iv: "184810a73bb5b765a1da374a39ade961"
server_key_version: "encryptionkey@0"
I20260808 14:38:11.771034 11644 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 14:38:11.773686 11664 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:11.775177 11644 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:38:11.775333 11644 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "e3aad1340e564aa2a4497ee52334dac4"
format_stamp: "Formatted at 2026-08-08 14:38:11 on dist-test-slave-twwt"
server_key: "bb82a4fd4cb6a1b9c3a5ef25c1db736c"
server_key_iv: "184810a73bb5b765a1da374a39ade961"
server_key_version: "encryptionkey@0"
I20260808 14:38:11.775470 11644 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:11.780664 11644 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:11.784425 11644 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:11.784648 11644 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:11.794801 11644 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45757
I20260808 14:38:11.794845 11743 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45757 every 8 connection(s)
I20260808 14:38:11.795898 11644 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:38:11.798864 11744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:38:11.805326 11744 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3aad1340e564aa2a4497ee52334dac4: Bootstrap starting.
I20260808 14:38:11.806011 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 11644
I20260808 14:38:11.806171 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786199615258783-11791-0/minicluster-data/master-0/wal/instance
I20260808 14:38:11.806458 11791 external_mini_cluster.cc:1428] Setting key 91a88ed7669c8b93e98fc50febf15946
I20260808 14:38:11.808495 11744 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e3aad1340e564aa2a4497ee52334dac4: Neither blocks nor log segments found. Creating new log.
I20260808 14:38:11.809265 11744 log.cc:824] T 00000000000000000000000000000000 P e3aad1340e564aa2a4497ee52334dac4: Log is configured to *not* fsync() on all Append() calls
I20260808 14:38:11.811579 11744 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3aad1340e564aa2a4497ee52334dac4: No bootstrap required, opened a new log
I20260808 14:38:11.811928 11750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:11.808032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53687 (local address 127.0.0.1:45757)
0808 14:38:11.808508 (+ 476us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:11.808523 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:11.808559 (+ 36us) server_negotiation.cc:407] Connection header received
0808 14:38:11.809215 (+ 656us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:11.809233 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:11.809528 (+ 295us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:11.809895 (+ 367us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:11.810704 (+ 809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:11.810708 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:11.810721 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:38:11.810732 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:11.810786 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:38:11.810806 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:11.810932 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:11.811037 (+ 105us) server_negotiation.cc:299] Negotiation successful
0808 14:38:11.811208 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":313,"thread_start_us":143,"threads_started":1}
I20260808 14:38:11.814965 11791 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:38:11.816099 11744 raft_consensus.cc:348] T 00000000000000000000000000000000 P e3aad1340e564aa2a4497ee52334dac4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3aad1340e564aa2a4497ee52334dac4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45757 } }
I20260808 14:38:11.816378 11744 raft_consensus.cc:374] T 00000000000000000000000000000000 P e3aad1340e564aa2a4497ee52334dac4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:38:11.816445 11744 raft_consensus.cc:729] T 00000000000000000000000000000000 P e3aad1340e564aa2a4497ee52334dac4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3aad1340e564aa2a4497ee52334dac4, State: Initialized, Role: FOLLOWER
I20260808 14:38:11.816931 11744 consensus_queue.cc:260] T 00000000000000000000000000000000 P e3aad1340e564aa2a4497ee52334dac4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3aad1340e564aa2a4497ee52334dac4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45757 } }
I20260808 14:38:11.817118 11744 raft_consensus.cc:388] T 00000000000000000000000000000000 P e3aad1340e564aa2a4497ee52334dac4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:38:11.817198 11744 raft_consensus.cc:482] T 00000000000000000000000000000000 P e3aad1340e564aa2a4497ee52334dac4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:38:11.817322 11744 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e3aad1340e564aa2a4497ee52334dac4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:38:11.818714 11744 raft_consensus.cc:504] T 00000000000000000000000000000000 P e3aad1340e564aa2a4497ee52334dac4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3aad1340e564aa2a4497ee52334dac4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45757 } }
I20260808 14:38:11.818830 11750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:11.817051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40221 (local address 127.0.0.1:45757)
0808 14:38:11.817183 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:11.817190 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:11.817440 (+ 250us) server_negotiation.cc:407] Connection header received
0808 14:38:11.817575 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:11.817577 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:11.817606 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:11.817673 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:11.818395 (+ 722us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:11.818397 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:11.818399 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:38:11.818410 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:11.818433 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:38:11.818443 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:11.818511 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:11.818679 (+ 168us) server_negotiation.cc:299] Negotiation successful
0808 14:38:11.818721 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 14:38:11.819087 11744 leader_election.cc:302] T 00000000000000000000000000000000 P e3aad1340e564aa2a4497ee52334dac4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e3aad1340e564aa2a4497ee52334dac4; no voters:
I20260808 14:38:11.819439 11744 leader_election.cc:288] T 00000000000000000000000000000000 P e3aad1340e564aa2a4497ee52334dac4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:38:11.819535 11760 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e3aad1340e564aa2a4497ee52334dac4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:38:11.819782 11760 raft_consensus.cc:686] T 00000000000000000000000000000000 P e3aad1340e564aa2a4497ee52334dac4 [term 1 LEADER]: Becoming Leader. State: Replica: e3aad1340e564aa2a4497ee52334dac4, State: Running, Role: LEADER
I20260808 14:38:11.820147 11760 consensus_queue.cc:237] T 00000000000000000000000000000000 P e3aad1340e564aa2a4497ee52334dac4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3aad1340e564aa2a4497ee52334dac4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45757 } }
I20260808 14:38:11.820745 11744 sys_catalog.cc:564] T 00000000000000000000000000000000 P e3aad1340e564aa2a4497ee52334dac4 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:38:11.821231 11760 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3aad1340e564aa2a4497ee52334dac4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e3aad1340e564aa2a4497ee52334dac4. Latest consensus state: current_term: 1 leader_uuid: "e3aad1340e564aa2a4497ee52334dac4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3aad1340e564aa2a4497ee52334dac4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45757 } } }
I20260808 14:38:11.821421 11760 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3aad1340e564aa2a4497ee52334dac4 [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:11.821699 11761 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3aad1340e564aa2a4497ee52334dac4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e3aad1340e564aa2a4497ee52334dac4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3aad1340e564aa2a4497ee52334dac4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45757 } } }
I20260808 14:38:11.821839 11761 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3aad1340e564aa2a4497ee52334dac4 [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:11.822156 11772 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:38:11.825110 11772 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:38:11.831080 11772 catalog_manager.cc:1347] Generated new cluster ID: cc6624c4a3aa4b13ba1229eb3b781067
I20260808 14:38:11.831149 11772 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:38:11.857141 11772 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:38:11.857546 11772 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:38:11.881512 11772 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e3aad1340e564aa2a4497ee52334dac4: Generated new TSK 0
I20260808 14:38:11.882426 11772 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:38:11.899914 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 11644
2026-08-08T14:38:11Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1671 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786199615258783-11791-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:38:11 dist-test-slave-twwt krb5kdc[11804](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:38:11 dist-test-slave-twwt krb5kdc[11804](info): set up 2 sockets
Aug 08 14:38:11 dist-test-slave-twwt krb5kdc[11804](info): commencing operation
krb5kdc: starting...
W20260808 14:38:13.159188 11791 mini_kdc.cc:121] Time spent starting KDC: real 1.228s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Aug 08 14:38:13 dist-test-slave-twwt krb5kdc[11804](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199893, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:38:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:38:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786199615258783-11791-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786199615258783-11791-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:38:13.293953 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45303
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786199615258783-11791-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36825
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45303
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:38:13.416622 11822 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:13.417011 11822 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:13.417079 11822 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:13.422442 11822 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:38:13.422513 11822 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:13.422533 11822 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:13.422549 11822 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:38:13.422564 11822 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:38:13.428011 11822 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36825
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786199615258783-11791-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45303
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786199615258783-11791-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45303
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11822
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:38:13.429059 11822 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:13.430089 11822 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:13.439051 11832 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:13.439122 11831 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:13.439103 11834 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:13.439364 11822 server_base.cc:1034] running on GCE node
I20260808 14:38:13.439971 11822 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:13.441210 11822 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:13.442443 11822 hybrid_clock.cc:648] HybridClock initialized: now 1786199893442418 us; error 45 us; skew 500 ppm
Aug 08 14:38:13 dist-test-slave-twwt krb5kdc[11804](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199893, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:13.450940 11822 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:38:13.451938 11822 webserver.cc:460] Webserver started at http://127.0.0.1:34731/ using document root <none> and password file <none>
I20260808 14:38:13.452564 11822 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:13.452661 11822 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:13.452926 11822 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:38:13.455159 11822 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786199615258783-11791-0/minicluster-data/master-0/data/instance:
uuid: "08235215c0f94ecdb61c17324558fa5a"
format_stamp: "Formatted at 2026-08-08 14:38:13 on dist-test-slave-twwt"
server_key: "c836a92bd08c98a959586123f1e7c273"
server_key_iv: "23fe3b7cde41c92e8c1e94712b6c7582"
server_key_version: "encryptionkey@0"
I20260808 14:38:13.455756 11822 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786199615258783-11791-0/minicluster-data/master-0/wal/instance:
uuid: "08235215c0f94ecdb61c17324558fa5a"
format_stamp: "Formatted at 2026-08-08 14:38:13 on dist-test-slave-twwt"
server_key: "c836a92bd08c98a959586123f1e7c273"
server_key_iv: "23fe3b7cde41c92e8c1e94712b6c7582"
server_key_version: "encryptionkey@0"
I20260808 14:38:13.459704 11822 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 14:38:13.462271 11846 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:13.463625 11822 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 14:38:13.463778 11822 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "08235215c0f94ecdb61c17324558fa5a"
format_stamp: "Formatted at 2026-08-08 14:38:13 on dist-test-slave-twwt"
server_key: "c836a92bd08c98a959586123f1e7c273"
server_key_iv: "23fe3b7cde41c92e8c1e94712b6c7582"
server_key_version: "encryptionkey@0"
I20260808 14:38:13.463905 11822 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:13.486230 11822 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:13.489991 11822 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:13.490224 11822 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:13.498435 11822 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45303
I20260808 14:38:13.498456 11928 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45303 every 8 connection(s)
I20260808 14:38:13.499540 11822 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:38:13.501513 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 11822
I20260808 14:38:13.501688 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786199615258783-11791-0/minicluster-data/master-0/wal/instance
I20260808 14:38:13.502028 11791 external_mini_cluster.cc:1428] Setting key e21c8301faa6b28373724b09dbcde859
I20260808 14:38:13.502991 11929 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:38:13.509286 11929 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 08235215c0f94ecdb61c17324558fa5a: Bootstrap starting.
Aug 08 14:38:13 dist-test-slave-twwt krb5kdc[11804](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199893, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 14:38:13.511950 11929 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 08235215c0f94ecdb61c17324558fa5a: Neither blocks nor log segments found. Creating new log.
I20260808 14:38:13.512775 11929 log.cc:824] T 00000000000000000000000000000000 P 08235215c0f94ecdb61c17324558fa5a: Log is configured to *not* fsync() on all Append() calls
I20260808 14:38:13.515003 11929 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 08235215c0f94ecdb61c17324558fa5a: No bootstrap required, opened a new log
I20260808 14:38:13.517601 11935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:13.503595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.192:43761 (local address 127.0.0.1:45303)
0808 14:38:13.504109 (+ 514us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:13.504126 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:13.504165 (+ 39us) server_negotiation.cc:407] Connection header received
0808 14:38:13.504857 (+ 692us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:13.504880 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:13.505227 (+ 347us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:13.505574 (+ 347us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:13.506466 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.507547 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.508443 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.508932 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.509108 (+ 176us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:13.511980 (+ 2872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:13.511985 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:13.512023 (+ 38us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:13.512061 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:13.514097 (+ 2036us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:13.514649 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:13.514656 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:13.514668 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:13.514786 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:13.515198 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:13.515202 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:13.515204 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:13.515735 (+ 531us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:13.515970 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:13.516285 (+ 315us) server_negotiation.cc:299] Negotiation successful
0808 14:38:13.516519 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":363,"thread_start_us":172,"threads_started":1}
I20260808 14:38:13.519698 11929 raft_consensus.cc:348] T 00000000000000000000000000000000 P 08235215c0f94ecdb61c17324558fa5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08235215c0f94ecdb61c17324558fa5a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45303 } }
I20260808 14:38:13.519984 11929 raft_consensus.cc:374] T 00000000000000000000000000000000 P 08235215c0f94ecdb61c17324558fa5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:38:13.520113 11929 raft_consensus.cc:729] T 00000000000000000000000000000000 P 08235215c0f94ecdb61c17324558fa5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08235215c0f94ecdb61c17324558fa5a, State: Initialized, Role: FOLLOWER
I20260808 14:38:13.520571 11929 consensus_queue.cc:260] T 00000000000000000000000000000000 P 08235215c0f94ecdb61c17324558fa5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08235215c0f94ecdb61c17324558fa5a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45303 } }
I20260808 14:38:13.520738 11929 raft_consensus.cc:388] T 00000000000000000000000000000000 P 08235215c0f94ecdb61c17324558fa5a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:38:13.520833 11929 raft_consensus.cc:482] T 00000000000000000000000000000000 P 08235215c0f94ecdb61c17324558fa5a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:38:13.520938 11791 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:38:13.520946 11929 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 08235215c0f94ecdb61c17324558fa5a [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:38:13.522184 11929 raft_consensus.cc:504] T 00000000000000000000000000000000 P 08235215c0f94ecdb61c17324558fa5a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08235215c0f94ecdb61c17324558fa5a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45303 } }
I20260808 14:38:13.522588 11929 leader_election.cc:302] T 00000000000000000000000000000000 P 08235215c0f94ecdb61c17324558fa5a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 08235215c0f94ecdb61c17324558fa5a; no voters:
I20260808 14:38:13.522964 11929 leader_election.cc:288] T 00000000000000000000000000000000 P 08235215c0f94ecdb61c17324558fa5a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:38:13.523092 11946 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 08235215c0f94ecdb61c17324558fa5a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:38:13.523325 11946 raft_consensus.cc:686] T 00000000000000000000000000000000 P 08235215c0f94ecdb61c17324558fa5a [term 1 LEADER]: Becoming Leader. State: Replica: 08235215c0f94ecdb61c17324558fa5a, State: Running, Role: LEADER
I20260808 14:38:13.523634 11946 consensus_queue.cc:237] T 00000000000000000000000000000000 P 08235215c0f94ecdb61c17324558fa5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08235215c0f94ecdb61c17324558fa5a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45303 } }
I20260808 14:38:13.524289 11929 sys_catalog.cc:564] T 00000000000000000000000000000000 P 08235215c0f94ecdb61c17324558fa5a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:38:13.524763 11946 sys_catalog.cc:455] T 00000000000000000000000000000000 P 08235215c0f94ecdb61c17324558fa5a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 08235215c0f94ecdb61c17324558fa5a. Latest consensus state: current_term: 1 leader_uuid: "08235215c0f94ecdb61c17324558fa5a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08235215c0f94ecdb61c17324558fa5a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45303 } } }
I20260808 14:38:13.524951 11946 sys_catalog.cc:458] T 00000000000000000000000000000000 P 08235215c0f94ecdb61c17324558fa5a [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:13.525283 11949 sys_catalog.cc:455] T 00000000000000000000000000000000 P 08235215c0f94ecdb61c17324558fa5a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "08235215c0f94ecdb61c17324558fa5a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08235215c0f94ecdb61c17324558fa5a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45303 } } }
I20260808 14:38:13.525391 11958 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:38:13.525472 11949 sys_catalog.cc:458] T 00000000000000000000000000000000 P 08235215c0f94ecdb61c17324558fa5a [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:13.528736 11958 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:38:13.535045 11958 catalog_manager.cc:1347] Generated new cluster ID: 8cbd22c1ef9e4ab8ab66f0a083836c63
I20260808 14:38:13.535162 11958 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:38:13.536603 11935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:13.523346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.192:50675 (local address 127.0.0.1:45303)
0808 14:38:13.523461 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:13.523466 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:13.526878 (+ 3412us) server_negotiation.cc:407] Connection header received
0808 14:38:13.527014 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:13.527018 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:13.527070 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:13.527164 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:13.527977 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.528494 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.529603 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:13.529914 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:13.530033 (+ 119us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:13.531682 (+ 1649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:13.531687 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:13.531690 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:13.531717 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:13.533978 (+ 2261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:13.534583 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:13.534587 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:13.534589 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:13.534709 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:13.535143 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:13.535146 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:13.535148 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:13.535404 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:13.535551 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:13.536342 (+ 791us) server_negotiation.cc:299] Negotiation successful
0808 14:38:13.536443 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 14:38:13.547276 11958 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:38:13.548417 11958 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:38:13.554816 11958 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 08235215c0f94ecdb61c17324558fa5a: Generated new TSK 0
I20260808 14:38:13.555570 11958 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:38:13.566036 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 11822
W20260808 14:38:13.582991 11801 connection.cc:535] client connection to 127.0.0.1:45303 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45303): Connection reset by peer (error 104)
2026-08-08T14:38:13Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1666 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786199615258783-11791-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:38:13 dist-test-slave-twwt krb5kdc[11984](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:38:13 dist-test-slave-twwt krb5kdc[11984](info): set up 2 sockets
Aug 08 14:38:13 dist-test-slave-twwt krb5kdc[11984](info): commencing operation
krb5kdc: starting...
W20260808 14:38:14.831336 11791 mini_kdc.cc:121] Time spent starting KDC: real 1.234s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Aug 08 14:38:14 dist-test-slave-twwt krb5kdc[11984](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199894, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:38:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:38:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786199615258783-11791-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786199615258783-11791-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:38:14.961789 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36201
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786199615258783-11791-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37315
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36201
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:38:15.078452 12010 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:15.078799 12010 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:15.078909 12010 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:15.083019 12010 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:38:15.083103 12010 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:15.083140 12010 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:15.083194 12010 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:38:15.083230 12010 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:38:15.088733 12010 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37315
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786199615258783-11791-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36201
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786199615258783-11791-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36201
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12010
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:38:15.089876 12010 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:15.091033 12010 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:15.100092 12022 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:15.100095 12019 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:15.100142 12018 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:15.100508 12010 server_base.cc:1034] running on GCE node
I20260808 14:38:15.101090 12010 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:15.102231 12010 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:15.103394 12010 hybrid_clock.cc:648] HybridClock initialized: now 1786199895103381 us; error 26 us; skew 500 ppm
Aug 08 14:38:15 dist-test-slave-twwt krb5kdc[11984](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199895, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:15.106137 12010 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:38:15.107152 12010 webserver.cc:460] Webserver started at http://127.0.0.1:39669/ using document root <none> and password file <none>
I20260808 14:38:15.107734 12010 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:15.107797 12010 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:15.108054 12010 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:38:15.110148 12010 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786199615258783-11791-0/minicluster-data/master-0/data/instance:
uuid: "06eddb4b422f43f5b0a09ef4daae17ca"
format_stamp: "Formatted at 2026-08-08 14:38:15 on dist-test-slave-twwt"
server_key: "cd6fc9513b4c7597c4d539bdc4d4350a"
server_key_iv: "92df29d2021176ba56f4e6178cf0a7fb"
server_key_version: "encryptionkey@0"
I20260808 14:38:15.110798 12010 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786199615258783-11791-0/minicluster-data/master-0/wal/instance:
uuid: "06eddb4b422f43f5b0a09ef4daae17ca"
format_stamp: "Formatted at 2026-08-08 14:38:15 on dist-test-slave-twwt"
server_key: "cd6fc9513b4c7597c4d539bdc4d4350a"
server_key_iv: "92df29d2021176ba56f4e6178cf0a7fb"
server_key_version: "encryptionkey@0"
I20260808 14:38:15.114544 12010 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:38:15.116968 12035 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:15.118170 12010 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 14:38:15.118317 12010 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "06eddb4b422f43f5b0a09ef4daae17ca"
format_stamp: "Formatted at 2026-08-08 14:38:15 on dist-test-slave-twwt"
server_key: "cd6fc9513b4c7597c4d539bdc4d4350a"
server_key_iv: "92df29d2021176ba56f4e6178cf0a7fb"
server_key_version: "encryptionkey@0"
I20260808 14:38:15.118419 12010 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:15.130429 12010 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:15.133503 12010 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:15.133674 12010 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:15.141400 12010 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36201
I20260808 14:38:15.141419 12113 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36201 every 8 connection(s)
I20260808 14:38:15.142437 12010 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:38:15.145401 12114 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:38:15.149808 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 12010
I20260808 14:38:15.150004 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786199615258783-11791-0/minicluster-data/master-0/wal/instance
I20260808 14:38:15.150318 11791 external_mini_cluster.cc:1428] Setting key e745e37b11665fbdeeff1397eefe1f20
I20260808 14:38:15.152040 12114 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 06eddb4b422f43f5b0a09ef4daae17ca: Bootstrap starting.
I20260808 14:38:15.154418 12114 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 06eddb4b422f43f5b0a09ef4daae17ca: Neither blocks nor log segments found. Creating new log.
I20260808 14:38:15.155244 12114 log.cc:824] T 00000000000000000000000000000000 P 06eddb4b422f43f5b0a09ef4daae17ca: Log is configured to *not* fsync() on all Append() calls
I20260808 14:38:15.157222 12114 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 06eddb4b422f43f5b0a09ef4daae17ca: No bootstrap required, opened a new log
I20260808 14:38:15.159817 12119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:15.151913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.192:43311 (local address 127.0.0.1:36201)
0808 14:38:15.152395 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:15.152412 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:15.152450 (+ 38us) server_negotiation.cc:407] Connection header received
0808 14:38:15.153132 (+ 682us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:15.153148 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:15.153510 (+ 362us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:15.153873 (+ 363us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:15.154323 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:15.155469 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:15.156395 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:15.156886 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:15.157063 (+ 177us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:15.158030 (+ 967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:15.158036 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:15.158050 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:38:15.158445 (+ 395us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:15.158503 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:38:15.158527 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:15.158706 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:15.158922 (+ 216us) server_negotiation.cc:299] Negotiation successful
0808 14:38:15.159069 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":143,"threads_started":1}
I20260808 14:38:15.161331 12114 raft_consensus.cc:348] T 00000000000000000000000000000000 P 06eddb4b422f43f5b0a09ef4daae17ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06eddb4b422f43f5b0a09ef4daae17ca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36201 } }
I20260808 14:38:15.161643 12114 raft_consensus.cc:374] T 00000000000000000000000000000000 P 06eddb4b422f43f5b0a09ef4daae17ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:38:15.161739 12114 raft_consensus.cc:729] T 00000000000000000000000000000000 P 06eddb4b422f43f5b0a09ef4daae17ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06eddb4b422f43f5b0a09ef4daae17ca, State: Initialized, Role: FOLLOWER
I20260808 14:38:15.162302 12114 consensus_queue.cc:260] T 00000000000000000000000000000000 P 06eddb4b422f43f5b0a09ef4daae17ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06eddb4b422f43f5b0a09ef4daae17ca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36201 } }
I20260808 14:38:15.162513 12114 raft_consensus.cc:388] T 00000000000000000000000000000000 P 06eddb4b422f43f5b0a09ef4daae17ca [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:38:15.162626 12114 raft_consensus.cc:482] T 00000000000000000000000000000000 P 06eddb4b422f43f5b0a09ef4daae17ca [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:38:15.162739 12114 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 06eddb4b422f43f5b0a09ef4daae17ca [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:38:15.163259 11791 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:38:15.163890 12114 raft_consensus.cc:504] T 00000000000000000000000000000000 P 06eddb4b422f43f5b0a09ef4daae17ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06eddb4b422f43f5b0a09ef4daae17ca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36201 } }
I20260808 14:38:15.164255 12114 leader_election.cc:302] T 00000000000000000000000000000000 P 06eddb4b422f43f5b0a09ef4daae17ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 06eddb4b422f43f5b0a09ef4daae17ca; no voters:
I20260808 14:38:15.164621 12114 leader_election.cc:288] T 00000000000000000000000000000000 P 06eddb4b422f43f5b0a09ef4daae17ca [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:38:15.164700 12122 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 06eddb4b422f43f5b0a09ef4daae17ca [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:38:15.164937 12122 raft_consensus.cc:686] T 00000000000000000000000000000000 P 06eddb4b422f43f5b0a09ef4daae17ca [term 1 LEADER]: Becoming Leader. State: Replica: 06eddb4b422f43f5b0a09ef4daae17ca, State: Running, Role: LEADER
I20260808 14:38:15.165311 12122 consensus_queue.cc:237] T 00000000000000000000000000000000 P 06eddb4b422f43f5b0a09ef4daae17ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06eddb4b422f43f5b0a09ef4daae17ca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36201 } }
I20260808 14:38:15.166059 12114 sys_catalog.cc:564] T 00000000000000000000000000000000 P 06eddb4b422f43f5b0a09ef4daae17ca [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:38:15.167129 12127 sys_catalog.cc:455] T 00000000000000000000000000000000 P 06eddb4b422f43f5b0a09ef4daae17ca [sys.catalog]: SysCatalogTable state changed. Reason: New leader 06eddb4b422f43f5b0a09ef4daae17ca. Latest consensus state: current_term: 1 leader_uuid: "06eddb4b422f43f5b0a09ef4daae17ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06eddb4b422f43f5b0a09ef4daae17ca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36201 } } }
I20260808 14:38:15.167281 12127 sys_catalog.cc:458] T 00000000000000000000000000000000 P 06eddb4b422f43f5b0a09ef4daae17ca [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:15.167605 12128 sys_catalog.cc:455] T 00000000000000000000000000000000 P 06eddb4b422f43f5b0a09ef4daae17ca [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "06eddb4b422f43f5b0a09ef4daae17ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06eddb4b422f43f5b0a09ef4daae17ca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36201 } } }
I20260808 14:38:15.167688 12128 sys_catalog.cc:458] T 00000000000000000000000000000000 P 06eddb4b422f43f5b0a09ef4daae17ca [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:15.168519 12140 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:38:15.170725 12119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:15.165601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.192:35945 (local address 127.0.0.1:36201)
0808 14:38:15.165720 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:15.165726 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:15.166011 (+ 285us) server_negotiation.cc:407] Connection header received
0808 14:38:15.166160 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:15.166164 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:15.166213 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:15.166287 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:15.166624 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:15.167403 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:15.168602 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:15.168956 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:15.169035 (+ 79us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:15.170128 (+ 1093us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:15.170135 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:15.170137 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:38:15.170154 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:15.170185 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:38:15.170200 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:15.170318 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:15.170502 (+ 184us) server_negotiation.cc:299] Negotiation successful
0808 14:38:15.170539 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":42}
I20260808 14:38:15.172384 12140 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:38:15.178215 12140 catalog_manager.cc:1347] Generated new cluster ID: b5db059dd7d14559aaa087f2559179d5
I20260808 14:38:15.178289 12140 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:38:15.206857 12140 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:38:15.208230 12140 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:38:15.214250 12140 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 06eddb4b422f43f5b0a09ef4daae17ca: Generated new TSK 0
I20260808 14:38:15.215009 12140 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:38:15.228354 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 12010
W20260808 14:38:15.244171 11979 connection.cc:535] client connection to 127.0.0.1:36201 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36201): Connection reset by peer (error 104)
2026-08-08T14:38:15Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1661 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786199615258783-11791-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:38:15 dist-test-slave-twwt krb5kdc[12157](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:38:15 dist-test-slave-twwt krb5kdc[12157](info): set up 2 sockets
Aug 08 14:38:15 dist-test-slave-twwt krb5kdc[12157](info): commencing operation
krb5kdc: starting...
W20260808 14:38:16.480757 11791 mini_kdc.cc:121] Time spent starting KDC: real 1.222s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Aug 08 14:38:16 dist-test-slave-twwt krb5kdc[12157](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199896, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:38:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:38:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786199615258783-11791-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786199615258783-11791-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:38:16.628268 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33429
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786199615258783-11791-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38101
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33429
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:38:16.745281 12176 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:16.745560 12176 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:16.745601 12176 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:16.749527 12176 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:38:16.749584 12176 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:16.749603 12176 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:16.749619 12176 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:38:16.749635 12176 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:38:16.754772 12176 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38101
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786199615258783-11791-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33429
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786199615258783-11791-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33429
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12176
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:38:16.755751 12176 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:16.756739 12176 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:16.765626 12193 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:16.765621 12187 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:16.765640 12189 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:16.765974 12176 server_base.cc:1034] running on GCE node
I20260808 14:38:16.766543 12176 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:16.767720 12176 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:16.768935 12176 hybrid_clock.cc:648] HybridClock initialized: now 1786199896768912 us; error 31 us; skew 500 ppm
Aug 08 14:38:16 dist-test-slave-twwt krb5kdc[12157](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199896, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:16.772022 12176 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:38:16.773025 12176 webserver.cc:460] Webserver started at http://127.0.0.1:41489/ using document root <none> and password file <none>
I20260808 14:38:16.773629 12176 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:16.773727 12176 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:16.773980 12176 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:38:16.776187 12176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786199615258783-11791-0/minicluster-data/master-0/data/instance:
uuid: "c15f80e07342415297fcf675cae43760"
format_stamp: "Formatted at 2026-08-08 14:38:16 on dist-test-slave-twwt"
server_key: "73a4bc926d576443466d9f99a9379553"
server_key_iv: "ba449165702c64fd08e7dae9f234f2cb"
server_key_version: "encryptionkey@0"
I20260808 14:38:16.776850 12176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786199615258783-11791-0/minicluster-data/master-0/wal/instance:
uuid: "c15f80e07342415297fcf675cae43760"
format_stamp: "Formatted at 2026-08-08 14:38:16 on dist-test-slave-twwt"
server_key: "73a4bc926d576443466d9f99a9379553"
server_key_iv: "ba449165702c64fd08e7dae9f234f2cb"
server_key_version: "encryptionkey@0"
I20260808 14:38:16.780695 12176 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 14:38:16.783193 12204 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:16.784431 12176 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 14:38:16.784580 12176 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "c15f80e07342415297fcf675cae43760"
format_stamp: "Formatted at 2026-08-08 14:38:16 on dist-test-slave-twwt"
server_key: "73a4bc926d576443466d9f99a9379553"
server_key_iv: "ba449165702c64fd08e7dae9f234f2cb"
server_key_version: "encryptionkey@0"
I20260808 14:38:16.784699 12176 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:16.789546 12176 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:16.793035 12176 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:16.793252 12176 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:16.800722 12176 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33429
I20260808 14:38:16.800751 12291 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33429 every 8 connection(s)
I20260808 14:38:16.801769 12176 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:38:16.804670 12292 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:38:16.806083 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 12176
I20260808 14:38:16.806246 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786199615258783-11791-0/minicluster-data/master-0/wal/instance
I20260808 14:38:16.806568 11791 external_mini_cluster.cc:1428] Setting key 598e96b8477d4e696c47b5b3831dbf79
I20260808 14:38:16.811626 12292 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c15f80e07342415297fcf675cae43760: Bootstrap starting.
I20260808 14:38:16.812338 12298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:16.808050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.192:47997 (local address 127.0.0.1:33429)
0808 14:38:16.808494 (+ 444us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:16.808514 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:16.808558 (+ 44us) server_negotiation.cc:407] Connection header received
0808 14:38:16.809386 (+ 828us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:16.809413 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:16.809779 (+ 366us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:16.810159 (+ 380us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:16.810953 (+ 794us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:16.810958 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:16.810973 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:38:16.810985 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:16.811051 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:38:16.811078 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:16.811224 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:16.811292 (+ 68us) server_negotiation.cc:299] Negotiation successful
0808 14:38:16.811446 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":287,"thread_start_us":124,"threads_started":1}
I20260808 14:38:16.814289 12292 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c15f80e07342415297fcf675cae43760: Neither blocks nor log segments found. Creating new log.
I20260808 14:38:16.815263 12292 log.cc:824] T 00000000000000000000000000000000 P c15f80e07342415297fcf675cae43760: Log is configured to *not* fsync() on all Append() calls
I20260808 14:38:16.815356 11791 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:38:16.817307 12292 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c15f80e07342415297fcf675cae43760: No bootstrap required, opened a new log
I20260808 14:38:16.819402 12298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:16.817677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.192:35609 (local address 127.0.0.1:33429)
0808 14:38:16.817822 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:16.817827 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:16.818006 (+ 179us) server_negotiation.cc:407] Connection header received
0808 14:38:16.818124 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:16.818126 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:16.818155 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:16.818220 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:16.818988 (+ 768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:16.818991 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:16.818993 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:38:16.819004 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:16.819029 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:38:16.819040 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:16.819113 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:16.819220 (+ 107us) server_negotiation.cc:299] Negotiation successful
0808 14:38:16.819255 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 14:38:16.821832 12292 raft_consensus.cc:348] T 00000000000000000000000000000000 P c15f80e07342415297fcf675cae43760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c15f80e07342415297fcf675cae43760" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33429 } }
I20260808 14:38:16.822083 12292 raft_consensus.cc:374] T 00000000000000000000000000000000 P c15f80e07342415297fcf675cae43760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:38:16.822154 12292 raft_consensus.cc:729] T 00000000000000000000000000000000 P c15f80e07342415297fcf675cae43760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15f80e07342415297fcf675cae43760, State: Initialized, Role: FOLLOWER
I20260808 14:38:16.822574 12292 consensus_queue.cc:260] T 00000000000000000000000000000000 P c15f80e07342415297fcf675cae43760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c15f80e07342415297fcf675cae43760" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33429 } }
I20260808 14:38:16.822794 12292 raft_consensus.cc:388] T 00000000000000000000000000000000 P c15f80e07342415297fcf675cae43760 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:38:16.822870 12292 raft_consensus.cc:482] T 00000000000000000000000000000000 P c15f80e07342415297fcf675cae43760 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:38:16.822973 12292 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c15f80e07342415297fcf675cae43760 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:38:16.824231 12292 raft_consensus.cc:504] T 00000000000000000000000000000000 P c15f80e07342415297fcf675cae43760 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c15f80e07342415297fcf675cae43760" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33429 } }
I20260808 14:38:16.824647 12292 leader_election.cc:302] T 00000000000000000000000000000000 P c15f80e07342415297fcf675cae43760 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c15f80e07342415297fcf675cae43760; no voters:
I20260808 14:38:16.825012 12292 leader_election.cc:288] T 00000000000000000000000000000000 P c15f80e07342415297fcf675cae43760 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:38:16.825139 12315 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c15f80e07342415297fcf675cae43760 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:38:16.825366 12315 raft_consensus.cc:686] T 00000000000000000000000000000000 P c15f80e07342415297fcf675cae43760 [term 1 LEADER]: Becoming Leader. State: Replica: c15f80e07342415297fcf675cae43760, State: Running, Role: LEADER
I20260808 14:38:16.825773 12315 consensus_queue.cc:237] T 00000000000000000000000000000000 P c15f80e07342415297fcf675cae43760 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c15f80e07342415297fcf675cae43760" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33429 } }
I20260808 14:38:16.826480 12292 sys_catalog.cc:564] T 00000000000000000000000000000000 P c15f80e07342415297fcf675cae43760 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:38:16.827732 12316 sys_catalog.cc:455] T 00000000000000000000000000000000 P c15f80e07342415297fcf675cae43760 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c15f80e07342415297fcf675cae43760. Latest consensus state: current_term: 1 leader_uuid: "c15f80e07342415297fcf675cae43760" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c15f80e07342415297fcf675cae43760" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33429 } } }
I20260808 14:38:16.827922 12316 sys_catalog.cc:458] T 00000000000000000000000000000000 P c15f80e07342415297fcf675cae43760 [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:16.827760 12317 sys_catalog.cc:455] T 00000000000000000000000000000000 P c15f80e07342415297fcf675cae43760 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c15f80e07342415297fcf675cae43760" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c15f80e07342415297fcf675cae43760" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33429 } } }
I20260808 14:38:16.828209 12317 sys_catalog.cc:458] T 00000000000000000000000000000000 P c15f80e07342415297fcf675cae43760 [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:16.828877 12330 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:38:16.832067 12330 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:38:16.837347 12330 catalog_manager.cc:1347] Generated new cluster ID: ef7c5b7135f240d887a2b16dbe59dafe
I20260808 14:38:16.837419 12330 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:38:16.874272 12330 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:38:16.874709 12330 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:38:16.881338 12330 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c15f80e07342415297fcf675cae43760: Generated new TSK 0
I20260808 14:38:16.882099 12330 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:38:16.890066 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 12176
2026-08-08T14:38:16Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1660 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786199615258783-11791-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:38:16 dist-test-slave-twwt krb5kdc[12349](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:38:16 dist-test-slave-twwt krb5kdc[12349](info): set up 2 sockets
Aug 08 14:38:16 dist-test-slave-twwt krb5kdc[12349](info): commencing operation
krb5kdc: starting...
W20260808 14:38:18.144026 11791 mini_kdc.cc:121] Time spent starting KDC: real 1.224s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Aug 08 14:38:18 dist-test-slave-twwt krb5kdc[12349](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199898, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:38:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:38:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786199615258783-11791-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786199615258783-11791-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:38:18.274153 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46487
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786199615258783-11791-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40181
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46487
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:38:18.389744 12372 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:18.390067 12372 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:18.390152 12372 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:18.394492 12372 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:38:18.394605 12372 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:18.394670 12372 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:18.394734 12372 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:38:18.394801 12372 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:38:18.400239 12372 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40181
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786199615258783-11791-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46487
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786199615258783-11791-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46487
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12372
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:38:18.401351 12372 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:18.402446 12372 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:18.411181 12382 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:18.411206 12387 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:18.411188 12383 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:18.411432 12372 server_base.cc:1034] running on GCE node
I20260808 14:38:18.412102 12372 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:18.413205 12372 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:18.414414 12372 hybrid_clock.cc:648] HybridClock initialized: now 1786199898414403 us; error 27 us; skew 500 ppm
Aug 08 14:38:18 dist-test-slave-twwt krb5kdc[12349](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199898, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:18.417315 12372 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:38:18.418248 12372 webserver.cc:460] Webserver started at http://127.0.0.1:36895/ using document root <none> and password file <none>
I20260808 14:38:18.418908 12372 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:18.419005 12372 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:18.419250 12372 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:38:18.421310 12372 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786199615258783-11791-0/minicluster-data/master-0/data/instance:
uuid: "7f4dcaef99084242b79808b5ac2a6297"
format_stamp: "Formatted at 2026-08-08 14:38:18 on dist-test-slave-twwt"
server_key: "8fe5ccd9ae43d9864d9c82141ec6a850"
server_key_iv: "5aec7ba7ca54974970f73d785c823202"
server_key_version: "encryptionkey@0"
I20260808 14:38:18.421900 12372 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786199615258783-11791-0/minicluster-data/master-0/wal/instance:
uuid: "7f4dcaef99084242b79808b5ac2a6297"
format_stamp: "Formatted at 2026-08-08 14:38:18 on dist-test-slave-twwt"
server_key: "8fe5ccd9ae43d9864d9c82141ec6a850"
server_key_iv: "5aec7ba7ca54974970f73d785c823202"
server_key_version: "encryptionkey@0"
I20260808 14:38:18.425678 12372 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260808 14:38:18.428109 12398 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:18.429275 12372 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 14:38:18.429442 12372 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "7f4dcaef99084242b79808b5ac2a6297"
format_stamp: "Formatted at 2026-08-08 14:38:18 on dist-test-slave-twwt"
server_key: "8fe5ccd9ae43d9864d9c82141ec6a850"
server_key_iv: "5aec7ba7ca54974970f73d785c823202"
server_key_version: "encryptionkey@0"
I20260808 14:38:18.429558 12372 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:18.443216 12372 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:18.446578 12372 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:18.446812 12372 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:18.454267 12372 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46487
I20260808 14:38:18.454293 12485 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46487 every 8 connection(s)
I20260808 14:38:18.455292 12372 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:38:18.458140 12487 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:38:18.461129 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 12372
I20260808 14:38:18.461294 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786199615258783-11791-0/minicluster-data/master-0/wal/instance
I20260808 14:38:18.461573 11791 external_mini_cluster.cc:1428] Setting key a5cfe6f38469f3ac67b6a83e34ec827a
I20260808 14:38:18.464296 12487 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f4dcaef99084242b79808b5ac2a6297: Bootstrap starting.
I20260808 14:38:18.467093 12487 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7f4dcaef99084242b79808b5ac2a6297: Neither blocks nor log segments found. Creating new log.
I20260808 14:38:18.467957 12487 log.cc:824] T 00000000000000000000000000000000 P 7f4dcaef99084242b79808b5ac2a6297: Log is configured to *not* fsync() on all Append() calls
I20260808 14:38:18.470178 12487 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f4dcaef99084242b79808b5ac2a6297: No bootstrap required, opened a new log
I20260808 14:38:18.474366 12487 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7f4dcaef99084242b79808b5ac2a6297 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f4dcaef99084242b79808b5ac2a6297" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46487 } }
I20260808 14:38:18.474671 12487 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7f4dcaef99084242b79808b5ac2a6297 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:38:18.474766 12487 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7f4dcaef99084242b79808b5ac2a6297 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f4dcaef99084242b79808b5ac2a6297, State: Initialized, Role: FOLLOWER
Aug 08 14:38:18 dist-test-slave-twwt krb5kdc[12349](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199898, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 14:38:18.475318 12487 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7f4dcaef99084242b79808b5ac2a6297 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f4dcaef99084242b79808b5ac2a6297" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46487 } }
I20260808 14:38:18.475486 12487 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7f4dcaef99084242b79808b5ac2a6297 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:38:18.475565 12487 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7f4dcaef99084242b79808b5ac2a6297 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:38:18.475669 12487 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7f4dcaef99084242b79808b5ac2a6297 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:38:18.476652 12487 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7f4dcaef99084242b79808b5ac2a6297 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f4dcaef99084242b79808b5ac2a6297" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46487 } }
I20260808 14:38:18.477065 12487 leader_election.cc:302] T 00000000000000000000000000000000 P 7f4dcaef99084242b79808b5ac2a6297 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7f4dcaef99084242b79808b5ac2a6297; no voters:
I20260808 14:38:18.477460 12487 leader_election.cc:288] T 00000000000000000000000000000000 P 7f4dcaef99084242b79808b5ac2a6297 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:38:18.477586 12495 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7f4dcaef99084242b79808b5ac2a6297 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:38:18.477813 12495 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7f4dcaef99084242b79808b5ac2a6297 [term 1 LEADER]: Becoming Leader. State: Replica: 7f4dcaef99084242b79808b5ac2a6297, State: Running, Role: LEADER
I20260808 14:38:18.478186 12495 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7f4dcaef99084242b79808b5ac2a6297 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f4dcaef99084242b79808b5ac2a6297" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46487 } }
I20260808 14:38:18.478986 12487 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7f4dcaef99084242b79808b5ac2a6297 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:38:18.479920 12497 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f4dcaef99084242b79808b5ac2a6297 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7f4dcaef99084242b79808b5ac2a6297. Latest consensus state: current_term: 1 leader_uuid: "7f4dcaef99084242b79808b5ac2a6297" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f4dcaef99084242b79808b5ac2a6297" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46487 } } }
I20260808 14:38:18.480050 12497 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f4dcaef99084242b79808b5ac2a6297 [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:18.480428 12496 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f4dcaef99084242b79808b5ac2a6297 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7f4dcaef99084242b79808b5ac2a6297" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f4dcaef99084242b79808b5ac2a6297" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46487 } } }
I20260808 14:38:18.480526 12496 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f4dcaef99084242b79808b5ac2a6297 [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:18.480875 12508 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:38:18.482550 12490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:18.463106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.192:41569 (local address 127.0.0.1:46487)
0808 14:38:18.463530 (+ 424us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:18.463551 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:18.463595 (+ 44us) server_negotiation.cc:407] Connection header received
0808 14:38:18.464427 (+ 832us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:18.464452 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:18.464886 (+ 434us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:18.465248 (+ 362us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:18.465952 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:18.467509 (+ 1557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:18.468427 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:18.469024 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:18.469147 (+ 123us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:18.475638 (+ 6491us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:18.475647 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:18.475666 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:18.475706 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:18.477877 (+ 2171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:18.478601 (+ 724us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:18.478631 (+ 30us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:18.478637 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:18.478783 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:18.479192 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:18.479196 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:18.479198 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:18.479795 (+ 597us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:18.480952 (+ 1157us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:18.481164 (+ 212us) server_negotiation.cc:299] Negotiation successful
0808 14:38:18.481423 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":5,"server-negotiator.queue_time_us":261,"thread_start_us":100,"threads_started":1}
I20260808 14:38:18.484275 12508 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:38:18.486059 11791 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:38:18.491060 12508 catalog_manager.cc:1347] Generated new cluster ID: 3bc1eef276fa4795849d181020d9d5bb
I20260808 14:38:18.491124 12508 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:38:18.497332 12490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:18.488368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.192:40759 (local address 127.0.0.1:46487)
0808 14:38:18.488501 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:18.488506 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:18.488824 (+ 318us) server_negotiation.cc:407] Connection header received
0808 14:38:18.488955 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:18.488959 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:18.489010 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:18.489099 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:18.489911 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:18.490441 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:18.491548 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:18.491927 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:18.492039 (+ 112us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:18.493677 (+ 1638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:18.493681 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:18.493684 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:18.493711 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:18.495467 (+ 1756us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:18.495985 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:18.495989 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:18.495991 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:18.496083 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:18.496421 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:18.496424 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:18.496426 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:18.496643 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:18.496792 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:18.497067 (+ 275us) server_negotiation.cc:299] Negotiation successful
0808 14:38:18.497174 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 14:38:18.523590 12508 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:38:18.524657 12508 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:38:18.538319 12508 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7f4dcaef99084242b79808b5ac2a6297: Generated new TSK 0
I20260808 14:38:18.539155 12508 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:38:18.545085 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 12372
W20260808 14:38:18.560129 12345 connection.cc:535] client connection to 127.0.0.1:46487 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46487): Connection reset by peer (error 104)
2026-08-08T14:38:18Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1655 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786199615258783-11791-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:38:18 dist-test-slave-twwt krb5kdc[12537](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:38:18 dist-test-slave-twwt krb5kdc[12537](info): set up 2 sockets
Aug 08 14:38:18 dist-test-slave-twwt krb5kdc[12537](info): commencing operation
krb5kdc: starting...
W20260808 14:38:19.790503 11791 mini_kdc.cc:121] Time spent starting KDC: real 1.215s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Aug 08 14:38:19 dist-test-slave-twwt krb5kdc[12537](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199899, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:38:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:38:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786199615258783-11791-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786199615258783-11791-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:38:19.925518 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35203
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786199615258783-11791-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41565
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35203
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:38:20.045369 12556 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:20.045696 12556 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:20.045789 12556 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:20.049824 12556 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:38:20.049924 12556 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:20.049964 12556 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:20.050016 12556 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:38:20.050055 12556 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:38:20.055583 12556 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41565
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786199615258783-11791-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35203
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786199615258783-11791-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35203
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12556
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:38:20.056687 12556 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:20.057749 12556 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:20.066769 12563 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:20.066759 12564 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:20.066759 12566 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:20.066851 12556 server_base.cc:1034] running on GCE node
I20260808 14:38:20.067744 12556 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:20.068903 12556 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:20.070097 12556 hybrid_clock.cc:648] HybridClock initialized: now 1786199900070071 us; error 44 us; skew 500 ppm
Aug 08 14:38:20 dist-test-slave-twwt krb5kdc[12537](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199900, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:20.072971 12556 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:38:20.073839 12556 webserver.cc:460] Webserver started at http://127.0.0.1:41967/ using document root <none> and password file <none>
I20260808 14:38:20.074484 12556 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:20.074576 12556 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:20.074846 12556 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:38:20.076992 12556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786199615258783-11791-0/minicluster-data/master-0/data/instance:
uuid: "faec61dc36be4fceadb9c59dc84775ae"
format_stamp: "Formatted at 2026-08-08 14:38:20 on dist-test-slave-twwt"
server_key: "ae6538cf49c8d349951b8df97dfcd86a"
server_key_iv: "30414625bff610b52525066f12d6be05"
server_key_version: "encryptionkey@0"
I20260808 14:38:20.077582 12556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786199615258783-11791-0/minicluster-data/master-0/wal/instance:
uuid: "faec61dc36be4fceadb9c59dc84775ae"
format_stamp: "Formatted at 2026-08-08 14:38:20 on dist-test-slave-twwt"
server_key: "ae6538cf49c8d349951b8df97dfcd86a"
server_key_iv: "30414625bff610b52525066f12d6be05"
server_key_version: "encryptionkey@0"
I20260808 14:38:20.081326 12556 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.006s
I20260808 14:38:20.083823 12577 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:20.085057 12556 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 14:38:20.085213 12556 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "faec61dc36be4fceadb9c59dc84775ae"
format_stamp: "Formatted at 2026-08-08 14:38:20 on dist-test-slave-twwt"
server_key: "ae6538cf49c8d349951b8df97dfcd86a"
server_key_iv: "30414625bff610b52525066f12d6be05"
server_key_version: "encryptionkey@0"
I20260808 14:38:20.085330 12556 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:20.110209 12556 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:20.113286 12556 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:20.113512 12556 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:20.121029 12556 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35203
I20260808 14:38:20.121055 12655 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35203 every 8 connection(s)
I20260808 14:38:20.122040 12556 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:38:20.123111 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 12556
I20260808 14:38:20.123263 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786199615258783-11791-0/minicluster-data/master-0/wal/instance
I20260808 14:38:20.123586 11791 external_mini_cluster.cc:1428] Setting key 844f12e563e2f963bf31a7d357d6f240
I20260808 14:38:20.125425 12656 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:38:20.131206 12656 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P faec61dc36be4fceadb9c59dc84775ae: Bootstrap starting.
I20260808 14:38:20.132774 12660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:20.125008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.192:60287 (local address 127.0.0.1:35203)
0808 14:38:20.125496 (+ 488us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:20.125513 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:20.125579 (+ 66us) server_negotiation.cc:407] Connection header received
0808 14:38:20.126245 (+ 666us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:20.126262 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:20.126681 (+ 419us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:20.127028 (+ 347us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:20.127445 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:20.128409 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:20.129338 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:20.129815 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:20.130011 (+ 196us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:20.131003 (+ 992us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:20.131009 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:20.131021 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:38:20.131471 (+ 450us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:20.131528 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:38:20.131552 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:20.131696 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:20.131889 (+ 193us) server_negotiation.cc:299] Negotiation successful
0808 14:38:20.132035 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":345,"thread_start_us":163,"threads_started":1}
I20260808 14:38:20.133827 12656 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P faec61dc36be4fceadb9c59dc84775ae: Neither blocks nor log segments found. Creating new log.
I20260808 14:38:20.134660 12656 log.cc:824] T 00000000000000000000000000000000 P faec61dc36be4fceadb9c59dc84775ae: Log is configured to *not* fsync() on all Append() calls
I20260808 14:38:20.135869 11791 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:38:20.136675 12656 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P faec61dc36be4fceadb9c59dc84775ae: No bootstrap required, opened a new log
I20260808 14:38:20.141322 12656 raft_consensus.cc:348] T 00000000000000000000000000000000 P faec61dc36be4fceadb9c59dc84775ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "faec61dc36be4fceadb9c59dc84775ae" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35203 } }
I20260808 14:38:20.141644 12656 raft_consensus.cc:374] T 00000000000000000000000000000000 P faec61dc36be4fceadb9c59dc84775ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:38:20.141747 12656 raft_consensus.cc:729] T 00000000000000000000000000000000 P faec61dc36be4fceadb9c59dc84775ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: faec61dc36be4fceadb9c59dc84775ae, State: Initialized, Role: FOLLOWER
I20260808 14:38:20.142230 12660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:20.137930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.192:37343 (local address 127.0.0.1:35203)
0808 14:38:20.138058 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:20.138063 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:20.138250 (+ 187us) server_negotiation.cc:407] Connection header received
0808 14:38:20.138394 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:20.138396 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:20.138433 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:20.138497 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:20.138846 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:20.139355 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:20.140505 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:20.140715 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:20.140788 (+ 73us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:20.141657 (+ 869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:20.141663 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:20.141668 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:38:20.141688 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:20.141731 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:38:20.141747 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:20.141859 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:20.142034 (+ 175us) server_negotiation.cc:299] Negotiation successful
0808 14:38:20.142077 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 14:38:20.142247 12656 consensus_queue.cc:260] T 00000000000000000000000000000000 P faec61dc36be4fceadb9c59dc84775ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "faec61dc36be4fceadb9c59dc84775ae" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35203 } }
I20260808 14:38:20.142496 12656 raft_consensus.cc:388] T 00000000000000000000000000000000 P faec61dc36be4fceadb9c59dc84775ae [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:38:20.142575 12656 raft_consensus.cc:482] T 00000000000000000000000000000000 P faec61dc36be4fceadb9c59dc84775ae [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:38:20.142714 12656 raft_consensus.cc:3037] T 00000000000000000000000000000000 P faec61dc36be4fceadb9c59dc84775ae [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:38:20.143705 12656 raft_consensus.cc:504] T 00000000000000000000000000000000 P faec61dc36be4fceadb9c59dc84775ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "faec61dc36be4fceadb9c59dc84775ae" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35203 } }
I20260808 14:38:20.144014 12656 leader_election.cc:302] T 00000000000000000000000000000000 P faec61dc36be4fceadb9c59dc84775ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: faec61dc36be4fceadb9c59dc84775ae; no voters:
I20260808 14:38:20.144261 12656 leader_election.cc:288] T 00000000000000000000000000000000 P faec61dc36be4fceadb9c59dc84775ae [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:38:20.144377 12673 raft_consensus.cc:2781] T 00000000000000000000000000000000 P faec61dc36be4fceadb9c59dc84775ae [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:38:20.144637 12673 raft_consensus.cc:686] T 00000000000000000000000000000000 P faec61dc36be4fceadb9c59dc84775ae [term 1 LEADER]: Becoming Leader. State: Replica: faec61dc36be4fceadb9c59dc84775ae, State: Running, Role: LEADER
I20260808 14:38:20.145044 12673 consensus_queue.cc:237] T 00000000000000000000000000000000 P faec61dc36be4fceadb9c59dc84775ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "faec61dc36be4fceadb9c59dc84775ae" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35203 } }
I20260808 14:38:20.145555 12656 sys_catalog.cc:564] T 00000000000000000000000000000000 P faec61dc36be4fceadb9c59dc84775ae [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:38:20.146768 12674 sys_catalog.cc:455] T 00000000000000000000000000000000 P faec61dc36be4fceadb9c59dc84775ae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "faec61dc36be4fceadb9c59dc84775ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "faec61dc36be4fceadb9c59dc84775ae" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35203 } } }
I20260808 14:38:20.146919 12674 sys_catalog.cc:458] T 00000000000000000000000000000000 P faec61dc36be4fceadb9c59dc84775ae [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:20.147310 12687 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:38:20.147315 12675 sys_catalog.cc:455] T 00000000000000000000000000000000 P faec61dc36be4fceadb9c59dc84775ae [sys.catalog]: SysCatalogTable state changed. Reason: New leader faec61dc36be4fceadb9c59dc84775ae. Latest consensus state: current_term: 1 leader_uuid: "faec61dc36be4fceadb9c59dc84775ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "faec61dc36be4fceadb9c59dc84775ae" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35203 } } }
I20260808 14:38:20.147548 12675 sys_catalog.cc:458] T 00000000000000000000000000000000 P faec61dc36be4fceadb9c59dc84775ae [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:20.150477 12687 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:38:20.156826 12687 catalog_manager.cc:1347] Generated new cluster ID: 1827168259954a25924c2b0f2eabfe7c
I20260808 14:38:20.156916 12687 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:38:20.165870 12687 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:38:20.167188 12687 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:38:20.172803 12687 catalog_manager.cc:5868] T 00000000000000000000000000000000 P faec61dc36be4fceadb9c59dc84775ae: Generated new TSK 0
I20260808 14:38:20.173672 12687 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:38:20.181219 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 12556
W20260808 14:38:20.200821 12534 connection.cc:535] client connection to 127.0.0.1:35203 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:35203): Connection reset by peer (error 104)
2026-08-08T14:38:20Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1640 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786199615258783-11791-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:38:20 dist-test-slave-twwt krb5kdc[12701](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:38:20 dist-test-slave-twwt krb5kdc[12701](info): set up 2 sockets
Aug 08 14:38:20 dist-test-slave-twwt krb5kdc[12701](info): commencing operation
krb5kdc: starting...
W20260808 14:38:21.446585 11791 mini_kdc.cc:121] Time spent starting KDC: real 1.231s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Aug 08 14:38:21 dist-test-slave-twwt krb5kdc[12701](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199901, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:38:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:38:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786199615258783-11791-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786199615258783-11791-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 14:38:21.579989 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41083
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786199615258783-11791-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41213
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41083
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:38:21.696553 12720 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:21.696817 12720 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:21.696859 12720 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:21.700820 12720 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:38:21.700879 12720 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:21.700898 12720 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:21.700914 12720 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:38:21.700958 12720 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:38:21.706314 12720 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41213
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786199615258783-11791-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41083
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786199615258783-11791-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41083
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12720
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:38:21.707408 12720 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:21.708429 12720 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:21.717271 12735 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:21.717274 12736 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:21.717309 12720 server_base.cc:1034] running on GCE node
W20260808 14:38:21.717271 12740 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:21.718058 12720 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:21.719229 12720 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:21.720434 12720 hybrid_clock.cc:648] HybridClock initialized: now 1786199901720421 us; error 26 us; skew 500 ppm
Aug 08 14:38:21 dist-test-slave-twwt krb5kdc[12701](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199901, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:21.723272 12720 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 14:38:21.724174 12720 webserver.cc:460] Webserver started at http://127.0.0.1:42497/ using document root <none> and password file <none>
I20260808 14:38:21.724750 12720 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:21.724845 12720 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:21.725095 12720 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:38:21.727296 12720 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786199615258783-11791-0/minicluster-data/master-0/data/instance:
uuid: "0bc0dcd5f1f742dc926f3c05937745a7"
format_stamp: "Formatted at 2026-08-08 14:38:21 on dist-test-slave-twwt"
server_key: "6e79df276a86a5199ff2db4d6478eb83"
server_key_iv: "0a5727e21d649086255f1b314ddc29fa"
server_key_version: "encryptionkey@0"
I20260808 14:38:21.727910 12720 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786199615258783-11791-0/minicluster-data/master-0/wal/instance:
uuid: "0bc0dcd5f1f742dc926f3c05937745a7"
format_stamp: "Formatted at 2026-08-08 14:38:21 on dist-test-slave-twwt"
server_key: "6e79df276a86a5199ff2db4d6478eb83"
server_key_iv: "0a5727e21d649086255f1b314ddc29fa"
server_key_version: "encryptionkey@0"
I20260808 14:38:21.731747 12720 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 14:38:21.734212 12750 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:21.735610 12720 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 14:38:21.735765 12720 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "0bc0dcd5f1f742dc926f3c05937745a7"
format_stamp: "Formatted at 2026-08-08 14:38:21 on dist-test-slave-twwt"
server_key: "6e79df276a86a5199ff2db4d6478eb83"
server_key_iv: "0a5727e21d649086255f1b314ddc29fa"
server_key_version: "encryptionkey@0"
I20260808 14:38:21.735888 12720 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:21.740515 12720 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:21.743510 12720 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:21.743710 12720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:21.750934 12720 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41083
I20260808 14:38:21.750959 12829 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41083 every 8 connection(s)
I20260808 14:38:21.751902 12720 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:38:21.754768 12830 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:38:21.757481 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 12720
I20260808 14:38:21.757640 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786199615258783-11791-0/minicluster-data/master-0/wal/instance
I20260808 14:38:21.757961 11791 external_mini_cluster.cc:1428] Setting key 4453f50d40ac8f33b5d8f1674e52c1a9
I20260808 14:38:21.761399 12830 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0bc0dcd5f1f742dc926f3c05937745a7: Bootstrap starting.
I20260808 14:38:21.763527 12833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:21.759561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.192:40427 (local address 127.0.0.1:41083)
0808 14:38:21.760051 (+ 490us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:21.760066 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:21.760104 (+ 38us) server_negotiation.cc:407] Connection header received
0808 14:38:21.760758 (+ 654us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:21.760777 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:21.761075 (+ 298us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:21.761445 (+ 370us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:21.762230 (+ 785us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:21.762235 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:21.762248 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:38:21.762259 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:21.762313 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:38:21.762332 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:21.762493 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:21.762569 (+ 76us) server_negotiation.cc:299] Negotiation successful
0808 14:38:21.762808 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":154,"threads_started":1}
I20260808 14:38:21.764065 12830 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0bc0dcd5f1f742dc926f3c05937745a7: Neither blocks nor log segments found. Creating new log.
I20260808 14:38:21.764832 12830 log.cc:824] T 00000000000000000000000000000000 P 0bc0dcd5f1f742dc926f3c05937745a7: Log is configured to *not* fsync() on all Append() calls
I20260808 14:38:21.766453 11791 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:38:21.767055 12830 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0bc0dcd5f1f742dc926f3c05937745a7: No bootstrap required, opened a new log
I20260808 14:38:21.770265 12833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:21.768595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.192:56273 (local address 127.0.0.1:41083)
0808 14:38:21.768731 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:21.768736 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:21.768905 (+ 169us) server_negotiation.cc:407] Connection header received
0808 14:38:21.769029 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:21.769031 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:21.769060 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:21.769125 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:21.769854 (+ 729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:21.769857 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:21.769859 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:38:21.769883 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:21.769908 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:38:21.769918 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:21.770011 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:21.770105 (+ 94us) server_negotiation.cc:299] Negotiation successful
0808 14:38:21.770138 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 14:38:21.771716 12830 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0bc0dcd5f1f742dc926f3c05937745a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bc0dcd5f1f742dc926f3c05937745a7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41083 } }
I20260808 14:38:21.771982 12830 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0bc0dcd5f1f742dc926f3c05937745a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:38:21.772054 12830 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0bc0dcd5f1f742dc926f3c05937745a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bc0dcd5f1f742dc926f3c05937745a7, State: Initialized, Role: FOLLOWER
I20260808 14:38:21.772480 12830 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0bc0dcd5f1f742dc926f3c05937745a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bc0dcd5f1f742dc926f3c05937745a7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41083 } }
I20260808 14:38:21.772640 12830 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0bc0dcd5f1f742dc926f3c05937745a7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:38:21.772764 12830 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0bc0dcd5f1f742dc926f3c05937745a7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:38:21.772894 12830 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0bc0dcd5f1f742dc926f3c05937745a7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:38:21.773905 12830 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0bc0dcd5f1f742dc926f3c05937745a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bc0dcd5f1f742dc926f3c05937745a7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41083 } }
I20260808 14:38:21.774271 12830 leader_election.cc:302] T 00000000000000000000000000000000 P 0bc0dcd5f1f742dc926f3c05937745a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0bc0dcd5f1f742dc926f3c05937745a7; no voters:
I20260808 14:38:21.774587 12830 leader_election.cc:288] T 00000000000000000000000000000000 P 0bc0dcd5f1f742dc926f3c05937745a7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:38:21.774745 12844 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0bc0dcd5f1f742dc926f3c05937745a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:38:21.775048 12844 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0bc0dcd5f1f742dc926f3c05937745a7 [term 1 LEADER]: Becoming Leader. State: Replica: 0bc0dcd5f1f742dc926f3c05937745a7, State: Running, Role: LEADER
I20260808 14:38:21.775451 12844 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0bc0dcd5f1f742dc926f3c05937745a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bc0dcd5f1f742dc926f3c05937745a7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41083 } }
I20260808 14:38:21.775943 12830 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0bc0dcd5f1f742dc926f3c05937745a7 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:38:21.777349 12846 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0bc0dcd5f1f742dc926f3c05937745a7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0bc0dcd5f1f742dc926f3c05937745a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bc0dcd5f1f742dc926f3c05937745a7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41083 } } }
I20260808 14:38:21.777495 12846 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0bc0dcd5f1f742dc926f3c05937745a7 [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:21.777858 12847 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0bc0dcd5f1f742dc926f3c05937745a7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0bc0dcd5f1f742dc926f3c05937745a7. Latest consensus state: current_term: 1 leader_uuid: "0bc0dcd5f1f742dc926f3c05937745a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bc0dcd5f1f742dc926f3c05937745a7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41083 } } }
I20260808 14:38:21.777968 12847 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0bc0dcd5f1f742dc926f3c05937745a7 [sys.catalog]: This master's current role is: LEADER
W20260808 14:38:21.781092 12864 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0bc0dcd5f1f742dc926f3c05937745a7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:38:21.781188 12864 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:38:21.781267 12860 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:38:21.781980 12860 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:38:21.787881 12860 catalog_manager.cc:1347] Generated new cluster ID: eb290cda63c14ae7a0c5bd55c9e3f494
I20260808 14:38:21.787956 12860 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:38:21.810118 12860 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:38:21.810467 12860 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:38:21.821228 12860 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0bc0dcd5f1f742dc926f3c05937745a7: Generated new TSK 0
I20260808 14:38:21.821964 12860 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:38:21.833971 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 12720
2026-08-08T14:38:21Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1652 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786199615258783-11791-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:38:21 dist-test-slave-twwt krb5kdc[12883](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:38:21 dist-test-slave-twwt krb5kdc[12883](info): set up 2 sockets
Aug 08 14:38:21 dist-test-slave-twwt krb5kdc[12883](info): commencing operation
krb5kdc: starting...
W20260808 14:38:23.097651 11791 mini_kdc.cc:121] Time spent starting KDC: real 1.230s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Aug 08 14:38:23 dist-test-slave-twwt krb5kdc[12883](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199903, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:38:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:38:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.131.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
I20260808 14:38:23.233429 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:40231
--webserver_interface=127.11.131.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:41119
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:40231
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:38:23.351137 12908 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:23.351441 12908 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:23.351516 12908 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:23.355544 12908 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:38:23.355621 12908 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:23.355660 12908 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:23.355717 12908 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:38:23.355756 12908 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:38:23.361054 12908 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:41119
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786199615258783-11791-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:40231
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:40231
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.131.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12908
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:38:23.362210 12908 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:23.363304 12908 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:23.371999 12915 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:23.372052 12917 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:23.372107 12908 server_base.cc:1034] running on GCE node
W20260808 14:38:23.372038 12914 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:23.372793 12908 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:23.373888 12908 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:23.375051 12908 hybrid_clock.cc:648] HybridClock initialized: now 1786199903375032 us; error 32 us; skew 500 ppm
Aug 08 14:38:23 dist-test-slave-twwt krb5kdc[12883](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199903, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:23.377699 12908 init.cc:377] Logged in from keytab as kudu/127.11.131.254@KRBTEST.COM (short username kudu)
I20260808 14:38:23.378564 12908 webserver.cc:460] Webserver started at http://127.11.131.254:46161/ using document root <none> and password file <none>
I20260808 14:38:23.379186 12908 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:23.379252 12908 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:23.379446 12908 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:38:23.381534 12908 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786199615258783-11791-0/minicluster-data/master-0/data/instance:
uuid: "ec4352678bd643c999c7ae84390151f0"
format_stamp: "Formatted at 2026-08-08 14:38:23 on dist-test-slave-twwt"
server_key: "0578e24320006620951768eb85204f65"
server_key_iv: "989eb7b1192b8af6ad96443c87dfc669"
server_key_version: "encryptionkey@0"
I20260808 14:38:23.382084 12908 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786199615258783-11791-0/minicluster-data/master-0/wal/instance:
uuid: "ec4352678bd643c999c7ae84390151f0"
format_stamp: "Formatted at 2026-08-08 14:38:23 on dist-test-slave-twwt"
server_key: "0578e24320006620951768eb85204f65"
server_key_iv: "989eb7b1192b8af6ad96443c87dfc669"
server_key_version: "encryptionkey@0"
I20260808 14:38:23.386021 12908 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 14:38:23.388715 12929 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:23.390115 12908 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 14:38:23.390231 12908 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "ec4352678bd643c999c7ae84390151f0"
format_stamp: "Formatted at 2026-08-08 14:38:23 on dist-test-slave-twwt"
server_key: "0578e24320006620951768eb85204f65"
server_key_iv: "989eb7b1192b8af6ad96443c87dfc669"
server_key_version: "encryptionkey@0"
I20260808 14:38:23.390326 12908 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:23.405102 12908 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:23.408773 12908 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:23.408960 12908 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:23.416329 12908 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.254:40231
I20260808 14:38:23.416405 13017 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.254:40231 every 8 connection(s)
I20260808 14:38:23.417486 12908 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:38:23.420403 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 12908
I20260808 14:38:23.420568 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786199615258783-11791-0/minicluster-data/master-0/wal/instance
I20260808 14:38:23.420701 13018 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:38:23.420930 11791 external_mini_cluster.cc:1428] Setting key 2f52c8690a2a4c0abf3d42c1af0a654f
I20260808 14:38:23.427955 13018 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec4352678bd643c999c7ae84390151f0: Bootstrap starting.
Aug 08 14:38:23 dist-test-slave-twwt krb5kdc[12883](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199903, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:38:23.430923 13018 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ec4352678bd643c999c7ae84390151f0: Neither blocks nor log segments found. Creating new log.
I20260808 14:38:23.431749 13018 log.cc:824] T 00000000000000000000000000000000 P ec4352678bd643c999c7ae84390151f0: Log is configured to *not* fsync() on all Append() calls
I20260808 14:38:23.434201 13018 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec4352678bd643c999c7ae84390151f0: No bootstrap required, opened a new log
I20260808 14:38:23.436362 13023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:23.422364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56959 (local address 127.11.131.254:40231)
0808 14:38:23.422844 (+ 480us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:23.422859 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:23.422896 (+ 37us) server_negotiation.cc:407] Connection header received
0808 14:38:23.423572 (+ 676us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:23.423591 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:23.424022 (+ 431us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:23.424320 (+ 298us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:23.425319 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:23.426395 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:23.427603 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:23.428169 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:23.428296 (+ 127us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:23.431310 (+ 3014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:23.431316 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:23.431329 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:23.431357 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:23.433215 (+ 1858us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:23.433866 (+ 651us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:23.433872 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:23.433878 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:23.433992 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:23.434399 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:23.434401 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:23.434402 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:23.434861 (+ 459us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:23.435034 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:23.435358 (+ 324us) server_negotiation.cc:299] Negotiation successful
0808 14:38:23.435616 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":142,"threads_started":1}
I20260808 14:38:23.438319 13018 raft_consensus.cc:348] T 00000000000000000000000000000000 P ec4352678bd643c999c7ae84390151f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec4352678bd643c999c7ae84390151f0" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 40231 } }
I20260808 14:38:23.438651 13018 raft_consensus.cc:374] T 00000000000000000000000000000000 P ec4352678bd643c999c7ae84390151f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:38:23.438719 13018 raft_consensus.cc:729] T 00000000000000000000000000000000 P ec4352678bd643c999c7ae84390151f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4352678bd643c999c7ae84390151f0, State: Initialized, Role: FOLLOWER
I20260808 14:38:23.439215 13018 consensus_queue.cc:260] T 00000000000000000000000000000000 P ec4352678bd643c999c7ae84390151f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec4352678bd643c999c7ae84390151f0" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 40231 } }
I20260808 14:38:23.439383 13018 raft_consensus.cc:388] T 00000000000000000000000000000000 P ec4352678bd643c999c7ae84390151f0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:38:23.439457 13018 raft_consensus.cc:482] T 00000000000000000000000000000000 P ec4352678bd643c999c7ae84390151f0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:38:23.439574 13018 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ec4352678bd643c999c7ae84390151f0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:38:23.439739 11791 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:38:23.440536 13018 raft_consensus.cc:504] T 00000000000000000000000000000000 P ec4352678bd643c999c7ae84390151f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec4352678bd643c999c7ae84390151f0" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 40231 } }
I20260808 14:38:23.440881 13018 leader_election.cc:302] T 00000000000000000000000000000000 P ec4352678bd643c999c7ae84390151f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec4352678bd643c999c7ae84390151f0; no voters:
I20260808 14:38:23.441257 13018 leader_election.cc:288] T 00000000000000000000000000000000 P ec4352678bd643c999c7ae84390151f0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:38:23.441320 13030 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ec4352678bd643c999c7ae84390151f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:38:23.441537 13030 raft_consensus.cc:686] T 00000000000000000000000000000000 P ec4352678bd643c999c7ae84390151f0 [term 1 LEADER]: Becoming Leader. State: Replica: ec4352678bd643c999c7ae84390151f0, State: Running, Role: LEADER
I20260808 14:38:23.441890 13030 consensus_queue.cc:237] T 00000000000000000000000000000000 P ec4352678bd643c999c7ae84390151f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec4352678bd643c999c7ae84390151f0" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 40231 } }
I20260808 14:38:23.442559 13018 sys_catalog.cc:564] T 00000000000000000000000000000000 P ec4352678bd643c999c7ae84390151f0 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:38:23.443635 13034 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec4352678bd643c999c7ae84390151f0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ec4352678bd643c999c7ae84390151f0. Latest consensus state: current_term: 1 leader_uuid: "ec4352678bd643c999c7ae84390151f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec4352678bd643c999c7ae84390151f0" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 40231 } } }
I20260808 14:38:23.443778 13034 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec4352678bd643c999c7ae84390151f0 [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:23.444157 13033 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec4352678bd643c999c7ae84390151f0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ec4352678bd643c999c7ae84390151f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec4352678bd643c999c7ae84390151f0" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 40231 } } }
I20260808 14:38:23.444334 13033 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec4352678bd643c999c7ae84390151f0 [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:23.445122 13048 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:38:23.447947 13048 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:38:23.451529 13023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:23.442160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43957 (local address 127.11.131.254:40231)
0808 14:38:23.442258 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:23.442263 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:23.442314 (+ 51us) server_negotiation.cc:407] Connection header received
0808 14:38:23.442473 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:23.442476 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:23.442525 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:23.442597 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:23.443455 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:23.444230 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:23.445676 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:23.445919 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:23.446032 (+ 113us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:23.447747 (+ 1715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:23.447751 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:23.447754 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:23.447782 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:23.449467 (+ 1685us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:23.450057 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:23.450061 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:23.450063 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:23.450156 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:23.450552 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:23.450555 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:23.450557 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:23.450813 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:23.450958 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:23.451285 (+ 327us) server_negotiation.cc:299] Negotiation successful
0808 14:38:23.451384 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 14:38:23.454540 13048 catalog_manager.cc:1347] Generated new cluster ID: 199bbf0daa4a4793b8a0d8bcb54cd697
I20260808 14:38:23.454636 13048 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:38:23.474664 13048 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:38:23.475652 13048 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:38:23.481803 13048 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ec4352678bd643c999c7ae84390151f0: Generated new TSK 0
I20260808 14:38:23.482581 13048 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:38:23.492139 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 12908
W20260808 14:38:23.505999 12879 connection.cc:535] client connection to 127.11.131.254:40231 recv error: Network error: failed to read from TLS socket (remote: 127.11.131.254:40231): Connection reset by peer (error 104)
2026-08-08T14:38:23Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1652 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786199615258783-11791-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:38:23 dist-test-slave-twwt krb5kdc[13063](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:38:23 dist-test-slave-twwt krb5kdc[13063](info): set up 2 sockets
Aug 08 14:38:23 dist-test-slave-twwt krb5kdc[13063](info): commencing operation
krb5kdc: starting...
W20260808 14:38:24.758198 11791 mini_kdc.cc:121] Time spent starting KDC: real 1.238s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Aug 08 14:38:24 dist-test-slave-twwt krb5kdc[13063](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199904, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:38:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:38:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.131.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
I20260808 14:38:24.898958 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:38687
--webserver_interface=127.11.131.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:37845
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:38687
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:38:25.020721 13085 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:25.021102 13085 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:25.021198 13085 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:25.025367 13085 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:38:25.025470 13085 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:25.025511 13085 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:25.025549 13085 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:38:25.025591 13085 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:38:25.031109 13085 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:37845
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786199615258783-11791-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:38687
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:38687
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.131.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13085
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:38:25.032291 13085 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:25.033422 13085 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:25.042318 13100 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:25.042351 13096 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:25.042403 13085 server_base.cc:1034] running on GCE node
W20260808 14:38:25.042351 13097 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:25.043347 13085 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:25.044466 13085 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:25.045658 13085 hybrid_clock.cc:648] HybridClock initialized: now 1786199905045638 us; error 33 us; skew 500 ppm
Aug 08 14:38:25 dist-test-slave-twwt krb5kdc[13063](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199905, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:25.048691 13085 init.cc:377] Logged in from keytab as kudu/127.11.131.254@KRBTEST.COM (short username kudu)
I20260808 14:38:25.049736 13085 webserver.cc:460] Webserver started at http://127.11.131.254:32863/ using document root <none> and password file <none>
I20260808 14:38:25.050362 13085 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:25.050462 13085 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:25.050776 13085 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:38:25.052999 13085 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786199615258783-11791-0/minicluster-data/master-0/data/instance:
uuid: "11ce934528294b5186ead434b58e45f1"
format_stamp: "Formatted at 2026-08-08 14:38:25 on dist-test-slave-twwt"
server_key: "3bd4e39c03c04788f64c7670cff612d7"
server_key_iv: "d01e6f4c6b50f7c62476c02fa390b7fb"
server_key_version: "encryptionkey@0"
I20260808 14:38:25.053633 13085 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786199615258783-11791-0/minicluster-data/master-0/wal/instance:
uuid: "11ce934528294b5186ead434b58e45f1"
format_stamp: "Formatted at 2026-08-08 14:38:25 on dist-test-slave-twwt"
server_key: "3bd4e39c03c04788f64c7670cff612d7"
server_key_iv: "d01e6f4c6b50f7c62476c02fa390b7fb"
server_key_version: "encryptionkey@0"
I20260808 14:38:25.057773 13085 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 14:38:25.060643 13110 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:25.062077 13085 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 14:38:25.062245 13085 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "11ce934528294b5186ead434b58e45f1"
format_stamp: "Formatted at 2026-08-08 14:38:25 on dist-test-slave-twwt"
server_key: "3bd4e39c03c04788f64c7670cff612d7"
server_key_iv: "d01e6f4c6b50f7c62476c02fa390b7fb"
server_key_version: "encryptionkey@0"
I20260808 14:38:25.062386 13085 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:25.076691 13085 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:25.079865 13085 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:25.080080 13085 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:25.087801 13085 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.254:38687
I20260808 14:38:25.087817 13184 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.254:38687 every 8 connection(s)
I20260808 14:38:25.088807 13085 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:38:25.091682 13185 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:38:25.097429 13185 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11ce934528294b5186ead434b58e45f1: Bootstrap starting.
I20260808 14:38:25.097504 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 13085
I20260808 14:38:25.097694 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786199615258783-11791-0/minicluster-data/master-0/wal/instance
I20260808 14:38:25.097985 11791 external_mini_cluster.cc:1428] Setting key 11fec9b629ea6da2dc665c5ae5dc38fd
I20260808 14:38:25.100209 13185 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 11ce934528294b5186ead434b58e45f1: Neither blocks nor log segments found. Creating new log.
I20260808 14:38:25.100986 13185 log.cc:824] T 00000000000000000000000000000000 P 11ce934528294b5186ead434b58e45f1: Log is configured to *not* fsync() on all Append() calls
I20260808 14:38:25.103157 13185 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11ce934528294b5186ead434b58e45f1: No bootstrap required, opened a new log
I20260808 14:38:25.107613 13185 raft_consensus.cc:348] T 00000000000000000000000000000000 P 11ce934528294b5186ead434b58e45f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11ce934528294b5186ead434b58e45f1" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38687 } }
I20260808 14:38:25.107869 13185 raft_consensus.cc:374] T 00000000000000000000000000000000 P 11ce934528294b5186ead434b58e45f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:38:25.107954 13185 raft_consensus.cc:729] T 00000000000000000000000000000000 P 11ce934528294b5186ead434b58e45f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11ce934528294b5186ead434b58e45f1, State: Initialized, Role: FOLLOWER
I20260808 14:38:25.108281 13188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:25.099472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40657 (local address 127.11.131.254:38687)
0808 14:38:25.099960 (+ 488us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:25.099977 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:25.100015 (+ 38us) server_negotiation.cc:407] Connection header received
0808 14:38:25.100782 (+ 767us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:25.100803 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:25.101210 (+ 407us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:25.101595 (+ 385us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:25.102072 (+ 477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:25.103210 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:25.104427 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:25.104978 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:25.105108 (+ 130us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:25.106113 (+ 1005us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:25.106119 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:25.106132 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:38:25.106550 (+ 418us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:25.106652 (+ 102us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:38:25.106696 (+ 44us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:25.106852 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:25.107115 (+ 263us) server_negotiation.cc:299] Negotiation successful
0808 14:38:25.107277 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":333,"thread_start_us":147,"threads_started":1}
I20260808 14:38:25.108464 13185 consensus_queue.cc:260] T 00000000000000000000000000000000 P 11ce934528294b5186ead434b58e45f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11ce934528294b5186ead434b58e45f1" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38687 } }
I20260808 14:38:25.108633 13185 raft_consensus.cc:388] T 00000000000000000000000000000000 P 11ce934528294b5186ead434b58e45f1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:38:25.108704 13185 raft_consensus.cc:482] T 00000000000000000000000000000000 P 11ce934528294b5186ead434b58e45f1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:38:25.108804 13185 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 11ce934528294b5186ead434b58e45f1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:38:25.109827 13185 raft_consensus.cc:504] T 00000000000000000000000000000000 P 11ce934528294b5186ead434b58e45f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11ce934528294b5186ead434b58e45f1" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38687 } }
I20260808 14:38:25.110198 13185 leader_election.cc:302] T 00000000000000000000000000000000 P 11ce934528294b5186ead434b58e45f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 11ce934528294b5186ead434b58e45f1; no voters:
I20260808 14:38:25.110577 13185 leader_election.cc:288] T 00000000000000000000000000000000 P 11ce934528294b5186ead434b58e45f1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:38:25.110682 13190 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 11ce934528294b5186ead434b58e45f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:38:25.110919 13190 raft_consensus.cc:686] T 00000000000000000000000000000000 P 11ce934528294b5186ead434b58e45f1 [term 1 LEADER]: Becoming Leader. State: Replica: 11ce934528294b5186ead434b58e45f1, State: Running, Role: LEADER
I20260808 14:38:25.111238 13190 consensus_queue.cc:237] T 00000000000000000000000000000000 P 11ce934528294b5186ead434b58e45f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11ce934528294b5186ead434b58e45f1" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38687 } }
I20260808 14:38:25.111630 11791 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:38:25.111981 13185 sys_catalog.cc:564] T 00000000000000000000000000000000 P 11ce934528294b5186ead434b58e45f1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:38:25.112438 13191 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11ce934528294b5186ead434b58e45f1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "11ce934528294b5186ead434b58e45f1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11ce934528294b5186ead434b58e45f1" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38687 } } }
I20260808 14:38:25.112636 13191 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11ce934528294b5186ead434b58e45f1 [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:25.112914 13195 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11ce934528294b5186ead434b58e45f1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 11ce934528294b5186ead434b58e45f1. Latest consensus state: current_term: 1 leader_uuid: "11ce934528294b5186ead434b58e45f1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11ce934528294b5186ead434b58e45f1" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38687 } } }
I20260808 14:38:25.113020 13195 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11ce934528294b5186ead434b58e45f1 [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:25.113461 13206 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:38:25.117125 13206 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:38:25.118945 13188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:25.114210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57685 (local address 127.11.131.254:38687)
0808 14:38:25.114313 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:25.114318 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:25.114337 (+ 19us) server_negotiation.cc:407] Connection header received
0808 14:38:25.114380 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:25.114383 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:25.114428 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:25.114513 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:25.114999 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:25.115763 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:25.116902 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:25.117265 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:25.117373 (+ 108us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:25.118296 (+ 923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:25.118301 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:25.118303 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:38:25.118316 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:25.118343 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:38:25.118357 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:25.118452 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:25.118774 (+ 322us) server_negotiation.cc:299] Negotiation successful
0808 14:38:25.118811 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 14:38:25.123768 13206 catalog_manager.cc:1347] Generated new cluster ID: f3dc17869a0e44f2986efb3f6a1dc339
I20260808 14:38:25.123867 13206 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:38:25.139799 13206 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:38:25.140836 13206 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:38:25.147419 13206 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 11ce934528294b5186ead434b58e45f1: Generated new TSK 0
I20260808 14:38:25.148172 13206 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:38:25.159085 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 13085
W20260808 14:38:25.171182 13061 connection.cc:535] client connection to 127.11.131.254:38687 recv error: Network error: failed to read from TLS socket (remote: 127.11.131.254:38687): Connection reset by peer (error 104)
2026-08-08T14:38:25Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1665 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786199615258783-11791-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:38:25 dist-test-slave-twwt krb5kdc[13231](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:38:25 dist-test-slave-twwt krb5kdc[13231](info): set up 2 sockets
Aug 08 14:38:25 dist-test-slave-twwt krb5kdc[13231](info): commencing operation
krb5kdc: starting...
W20260808 14:38:26.421312 11791 mini_kdc.cc:121] Time spent starting KDC: real 1.235s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Aug 08 14:38:26 dist-test-slave-twwt krb5kdc[13231](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199906, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:38:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:38:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.131.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
I20260808 14:38:26.557212 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:46725
--webserver_interface=127.11.131.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:42771
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:46725
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:38:26.687058 13254 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:26.687345 13254 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:26.687446 13254 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:26.694149 13254 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:38:26.694236 13254 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:26.694273 13254 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:26.694348 13254 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:38:26.694386 13254 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:38:26.700052 13254 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:42771
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786199615258783-11791-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:46725
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:46725
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.131.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13254
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:38:26.701164 13254 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:26.702250 13254 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:26.711159 13262 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:26.711166 13259 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:26.711171 13260 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:26.711426 13254 server_base.cc:1034] running on GCE node
I20260808 14:38:26.712107 13254 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:26.713214 13254 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:26.714408 13254 hybrid_clock.cc:648] HybridClock initialized: now 1786199906714387 us; error 30 us; skew 500 ppm
Aug 08 14:38:26 dist-test-slave-twwt krb5kdc[13231](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199906, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:26.717140 13254 init.cc:377] Logged in from keytab as kudu/127.11.131.254@KRBTEST.COM (short username kudu)
I20260808 14:38:26.718055 13254 webserver.cc:460] Webserver started at http://127.11.131.254:42615/ using document root <none> and password file <none>
I20260808 14:38:26.718683 13254 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:26.718775 13254 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:26.719024 13254 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:38:26.721133 13254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786199615258783-11791-0/minicluster-data/master-0/data/instance:
uuid: "9b212db86f3d43e98753447433da5681"
format_stamp: "Formatted at 2026-08-08 14:38:26 on dist-test-slave-twwt"
server_key: "327c558c089ada72e855b1f4f1f13ced"
server_key_iv: "4b0d357855eebd0f22b69d4b9c299e21"
server_key_version: "encryptionkey@0"
I20260808 14:38:26.721704 13254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786199615258783-11791-0/minicluster-data/master-0/wal/instance:
uuid: "9b212db86f3d43e98753447433da5681"
format_stamp: "Formatted at 2026-08-08 14:38:26 on dist-test-slave-twwt"
server_key: "327c558c089ada72e855b1f4f1f13ced"
server_key_iv: "4b0d357855eebd0f22b69d4b9c299e21"
server_key_version: "encryptionkey@0"
I20260808 14:38:26.725629 13254 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260808 14:38:26.728160 13270 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:26.729431 13254 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 14:38:26.729586 13254 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "9b212db86f3d43e98753447433da5681"
format_stamp: "Formatted at 2026-08-08 14:38:26 on dist-test-slave-twwt"
server_key: "327c558c089ada72e855b1f4f1f13ced"
server_key_iv: "4b0d357855eebd0f22b69d4b9c299e21"
server_key_version: "encryptionkey@0"
I20260808 14:38:26.729704 13254 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:26.734453 13254 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:26.737401 13254 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:26.737602 13254 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:26.744916 13254 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.254:46725
I20260808 14:38:26.744927 13347 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.254:46725 every 8 connection(s)
I20260808 14:38:26.745893 13254 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:38:26.748719 13348 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:38:26.754402 13348 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b212db86f3d43e98753447433da5681: Bootstrap starting.
I20260808 14:38:26.755079 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 13254
I20260808 14:38:26.755230 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786199615258783-11791-0/minicluster-data/master-0/wal/instance
I20260808 14:38:26.755522 11791 external_mini_cluster.cc:1428] Setting key 18567fa622b0f058c27f9bdedbdb16c7
I20260808 14:38:26.757489 13348 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9b212db86f3d43e98753447433da5681: Neither blocks nor log segments found. Creating new log.
I20260808 14:38:26.758241 13348 log.cc:824] T 00000000000000000000000000000000 P 9b212db86f3d43e98753447433da5681: Log is configured to *not* fsync() on all Append() calls
I20260808 14:38:26.760653 13348 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b212db86f3d43e98753447433da5681: No bootstrap required, opened a new log
I20260808 14:38:26.761097 13351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:26.756948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53481 (local address 127.11.131.254:46725)
0808 14:38:26.757404 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:26.757420 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:26.757458 (+ 38us) server_negotiation.cc:407] Connection header received
0808 14:38:26.758167 (+ 709us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:26.758185 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:26.758538 (+ 353us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:26.758957 (+ 419us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:26.759782 (+ 825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:26.759787 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:26.759799 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:38:26.759808 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:26.759860 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:38:26.759879 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:26.759970 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:26.760121 (+ 151us) server_negotiation.cc:299] Negotiation successful
0808 14:38:26.760301 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":300,"thread_start_us":129,"threads_started":1}
I20260808 14:38:26.764284 11791 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:38:26.765220 13348 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9b212db86f3d43e98753447433da5681 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b212db86f3d43e98753447433da5681" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46725 } }
I20260808 14:38:26.765518 13348 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9b212db86f3d43e98753447433da5681 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:38:26.765594 13348 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9b212db86f3d43e98753447433da5681 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b212db86f3d43e98753447433da5681, State: Initialized, Role: FOLLOWER
I20260808 14:38:26.766156 13348 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9b212db86f3d43e98753447433da5681 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b212db86f3d43e98753447433da5681" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46725 } }
I20260808 14:38:26.766353 13348 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9b212db86f3d43e98753447433da5681 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:38:26.766438 13348 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9b212db86f3d43e98753447433da5681 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:38:26.766571 13348 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9b212db86f3d43e98753447433da5681 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:38:26.768011 13348 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9b212db86f3d43e98753447433da5681 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b212db86f3d43e98753447433da5681" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46725 } }
I20260808 14:38:26.768437 13348 leader_election.cc:302] T 00000000000000000000000000000000 P 9b212db86f3d43e98753447433da5681 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9b212db86f3d43e98753447433da5681; no voters:
I20260808 14:38:26.768445 13351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:26.766676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34833 (local address 127.11.131.254:46725)
0808 14:38:26.766899 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:26.766902 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:26.767005 (+ 103us) server_negotiation.cc:407] Connection header received
0808 14:38:26.767133 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:26.767135 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:26.767166 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:26.767229 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:26.767957 (+ 728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:26.767960 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:26.767962 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:38:26.767972 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:26.767996 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:38:26.768006 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:26.768074 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:26.768254 (+ 180us) server_negotiation.cc:299] Negotiation successful
0808 14:38:26.768291 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150}
I20260808 14:38:26.768782 13348 leader_election.cc:288] T 00000000000000000000000000000000 P 9b212db86f3d43e98753447433da5681 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:38:26.768887 13361 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9b212db86f3d43e98753447433da5681 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:38:26.769106 13361 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9b212db86f3d43e98753447433da5681 [term 1 LEADER]: Becoming Leader. State: Replica: 9b212db86f3d43e98753447433da5681, State: Running, Role: LEADER
I20260808 14:38:26.769526 13361 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9b212db86f3d43e98753447433da5681 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b212db86f3d43e98753447433da5681" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46725 } }
I20260808 14:38:26.770128 13348 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9b212db86f3d43e98753447433da5681 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:38:26.770761 13361 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b212db86f3d43e98753447433da5681 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9b212db86f3d43e98753447433da5681. Latest consensus state: current_term: 1 leader_uuid: "9b212db86f3d43e98753447433da5681" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b212db86f3d43e98753447433da5681" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46725 } } }
I20260808 14:38:26.770958 13361 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b212db86f3d43e98753447433da5681 [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:26.771301 13364 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b212db86f3d43e98753447433da5681 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9b212db86f3d43e98753447433da5681" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b212db86f3d43e98753447433da5681" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46725 } } }
I20260808 14:38:26.771452 13364 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b212db86f3d43e98753447433da5681 [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:26.771425 13373 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:38:26.775004 13373 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:38:26.780970 13373 catalog_manager.cc:1347] Generated new cluster ID: ce8921d6a0f54af480a657bb46d2d5ef
I20260808 14:38:26.781046 13373 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:38:26.804064 13373 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:38:26.804435 13373 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:38:26.814432 13373 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9b212db86f3d43e98753447433da5681: Generated new TSK 0
I20260808 14:38:26.815182 13373 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:38:26.821050 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 13254
2026-08-08T14:38:26Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1657 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786199615258783-11791-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:38:26 dist-test-slave-twwt krb5kdc[13396](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:38:26 dist-test-slave-twwt krb5kdc[13396](info): set up 2 sockets
Aug 08 14:38:26 dist-test-slave-twwt krb5kdc[13396](info): commencing operation
krb5kdc: starting...
W20260808 14:38:28.071049 11791 mini_kdc.cc:121] Time spent starting KDC: real 1.228s user 0.006s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Aug 08 14:38:28 dist-test-slave-twwt krb5kdc[13396](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199908, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:38:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:38:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.131.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
I20260808 14:38:28.206161 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:36497
--webserver_interface=127.11.131.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:36657
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:36497
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:38:28.324170 13419 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:28.324433 13419 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:28.324473 13419 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:28.328804 13419 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:38:28.328876 13419 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:28.328928 13419 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:28.328959 13419 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:38:28.329074 13419 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:38:28.334511 13419 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:36657
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786199615258783-11791-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:36497
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:36497
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.131.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13419
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:38:28.335601 13419 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:28.336625 13419 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:28.345113 13427 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:28.345089 13434 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:28.345453 13419 server_base.cc:1034] running on GCE node
W20260808 14:38:28.345101 13425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:28.345995 13419 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:28.347110 13419 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:28.348272 13419 hybrid_clock.cc:648] HybridClock initialized: now 1786199908348246 us; error 39 us; skew 500 ppm
Aug 08 14:38:28 dist-test-slave-twwt krb5kdc[13396](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199908, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:28.351202 13419 init.cc:377] Logged in from keytab as kudu/127.11.131.254@KRBTEST.COM (short username kudu)
I20260808 14:38:28.352087 13419 webserver.cc:460] Webserver started at http://127.11.131.254:43593/ using document root <none> and password file <none>
I20260808 14:38:28.352715 13419 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:28.352782 13419 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:28.353004 13419 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:38:28.355094 13419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786199615258783-11791-0/minicluster-data/master-0/data/instance:
uuid: "afeafc6fcf1e41fd94468a1b31ee1dfa"
format_stamp: "Formatted at 2026-08-08 14:38:28 on dist-test-slave-twwt"
server_key: "f324d51ffacc6011d81847f0195f8cba"
server_key_iv: "3a76231c86897e3cb1a11267c6d23d1b"
server_key_version: "encryptionkey@0"
I20260808 14:38:28.355665 13419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786199615258783-11791-0/minicluster-data/master-0/wal/instance:
uuid: "afeafc6fcf1e41fd94468a1b31ee1dfa"
format_stamp: "Formatted at 2026-08-08 14:38:28 on dist-test-slave-twwt"
server_key: "f324d51ffacc6011d81847f0195f8cba"
server_key_iv: "3a76231c86897e3cb1a11267c6d23d1b"
server_key_version: "encryptionkey@0"
I20260808 14:38:28.359428 13419 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260808 14:38:28.361725 13446 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:28.363062 13419 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 14:38:28.363197 13419 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "afeafc6fcf1e41fd94468a1b31ee1dfa"
format_stamp: "Formatted at 2026-08-08 14:38:28 on dist-test-slave-twwt"
server_key: "f324d51ffacc6011d81847f0195f8cba"
server_key_iv: "3a76231c86897e3cb1a11267c6d23d1b"
server_key_version: "encryptionkey@0"
I20260808 14:38:28.363305 13419 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:28.377432 13419 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:28.381049 13419 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:28.381273 13419 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:28.388667 13419 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.254:36497
I20260808 14:38:28.388734 13521 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.254:36497 every 8 connection(s)
I20260808 14:38:28.389753 13419 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:38:28.392891 13522 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:38:28.393417 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 13419
I20260808 14:38:28.393582 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786199615258783-11791-0/minicluster-data/master-0/wal/instance
I20260808 14:38:28.393923 11791 external_mini_cluster.cc:1428] Setting key d90eff35d0e64a3bf2326dda3375a690
I20260808 14:38:28.400378 13522 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P afeafc6fcf1e41fd94468a1b31ee1dfa: Bootstrap starting.
Aug 08 14:38:28 dist-test-slave-twwt krb5kdc[13396](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199908, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:38:28.403247 13522 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P afeafc6fcf1e41fd94468a1b31ee1dfa: Neither blocks nor log segments found. Creating new log.
I20260808 14:38:28.404182 13522 log.cc:824] T 00000000000000000000000000000000 P afeafc6fcf1e41fd94468a1b31ee1dfa: Log is configured to *not* fsync() on all Append() calls
I20260808 14:38:28.406319 13522 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P afeafc6fcf1e41fd94468a1b31ee1dfa: No bootstrap required, opened a new log
I20260808 14:38:28.408601 13525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:28.395324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52455 (local address 127.11.131.254:36497)
0808 14:38:28.395734 (+ 410us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:28.395766 (+ 32us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:28.395801 (+ 35us) server_negotiation.cc:407] Connection header received
0808 14:38:28.396477 (+ 676us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:28.396496 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:28.396842 (+ 346us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:28.397149 (+ 307us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:28.398114 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:28.399195 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:28.400359 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:28.400872 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:28.400990 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:28.403811 (+ 2821us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:28.403817 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:28.403835 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:28.403868 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:28.405657 (+ 1789us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:28.406155 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:28.406159 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:28.406165 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:28.406286 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:28.406593 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:28.406596 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:28.406597 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:28.407044 (+ 447us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:28.407197 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:28.407545 (+ 348us) server_negotiation.cc:299] Negotiation successful
0808 14:38:28.407871 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":260,"thread_start_us":128,"threads_started":1}
I20260808 14:38:28.410408 13522 raft_consensus.cc:348] T 00000000000000000000000000000000 P afeafc6fcf1e41fd94468a1b31ee1dfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afeafc6fcf1e41fd94468a1b31ee1dfa" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 36497 } }
I20260808 14:38:28.410709 13522 raft_consensus.cc:374] T 00000000000000000000000000000000 P afeafc6fcf1e41fd94468a1b31ee1dfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:38:28.410799 13522 raft_consensus.cc:729] T 00000000000000000000000000000000 P afeafc6fcf1e41fd94468a1b31ee1dfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afeafc6fcf1e41fd94468a1b31ee1dfa, State: Initialized, Role: FOLLOWER
I20260808 14:38:28.411331 13522 consensus_queue.cc:260] T 00000000000000000000000000000000 P afeafc6fcf1e41fd94468a1b31ee1dfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afeafc6fcf1e41fd94468a1b31ee1dfa" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 36497 } }
I20260808 14:38:28.411499 13522 raft_consensus.cc:388] T 00000000000000000000000000000000 P afeafc6fcf1e41fd94468a1b31ee1dfa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:38:28.411571 13522 raft_consensus.cc:482] T 00000000000000000000000000000000 P afeafc6fcf1e41fd94468a1b31ee1dfa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:38:28.411679 13522 raft_consensus.cc:3037] T 00000000000000000000000000000000 P afeafc6fcf1e41fd94468a1b31ee1dfa [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:38:28.411759 11791 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:38:28.412881 13522 raft_consensus.cc:504] T 00000000000000000000000000000000 P afeafc6fcf1e41fd94468a1b31ee1dfa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afeafc6fcf1e41fd94468a1b31ee1dfa" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 36497 } }
I20260808 14:38:28.413280 13522 leader_election.cc:302] T 00000000000000000000000000000000 P afeafc6fcf1e41fd94468a1b31ee1dfa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: afeafc6fcf1e41fd94468a1b31ee1dfa; no voters:
I20260808 14:38:28.413621 13522 leader_election.cc:288] T 00000000000000000000000000000000 P afeafc6fcf1e41fd94468a1b31ee1dfa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:38:28.413726 13532 raft_consensus.cc:2781] T 00000000000000000000000000000000 P afeafc6fcf1e41fd94468a1b31ee1dfa [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:38:28.413981 13532 raft_consensus.cc:686] T 00000000000000000000000000000000 P afeafc6fcf1e41fd94468a1b31ee1dfa [term 1 LEADER]: Becoming Leader. State: Replica: afeafc6fcf1e41fd94468a1b31ee1dfa, State: Running, Role: LEADER
I20260808 14:38:28.414368 13532 consensus_queue.cc:237] T 00000000000000000000000000000000 P afeafc6fcf1e41fd94468a1b31ee1dfa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afeafc6fcf1e41fd94468a1b31ee1dfa" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 36497 } }
I20260808 14:38:28.415006 13522 sys_catalog.cc:564] T 00000000000000000000000000000000 P afeafc6fcf1e41fd94468a1b31ee1dfa [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:38:28.415719 13534 sys_catalog.cc:455] T 00000000000000000000000000000000 P afeafc6fcf1e41fd94468a1b31ee1dfa [sys.catalog]: SysCatalogTable state changed. Reason: New leader afeafc6fcf1e41fd94468a1b31ee1dfa. Latest consensus state: current_term: 1 leader_uuid: "afeafc6fcf1e41fd94468a1b31ee1dfa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afeafc6fcf1e41fd94468a1b31ee1dfa" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 36497 } } }
I20260808 14:38:28.415869 13534 sys_catalog.cc:458] T 00000000000000000000000000000000 P afeafc6fcf1e41fd94468a1b31ee1dfa [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:28.416159 13533 sys_catalog.cc:455] T 00000000000000000000000000000000 P afeafc6fcf1e41fd94468a1b31ee1dfa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "afeafc6fcf1e41fd94468a1b31ee1dfa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afeafc6fcf1e41fd94468a1b31ee1dfa" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 36497 } } }
I20260808 14:38:28.416308 13533 sys_catalog.cc:458] T 00000000000000000000000000000000 P afeafc6fcf1e41fd94468a1b31ee1dfa [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:28.416633 13544 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:38:28.420091 13544 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:38:28.424300 13525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:28.414418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33215 (local address 127.11.131.254:36497)
0808 14:38:28.414523 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:28.414527 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:28.414582 (+ 55us) server_negotiation.cc:407] Connection header received
0808 14:38:28.414788 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:28.414791 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:28.414837 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:28.414916 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:28.415870 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:28.416706 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:28.417944 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:28.418189 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:28.418303 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:28.420681 (+ 2378us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:28.420685 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:28.420687 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:28.420713 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:28.422419 (+ 1706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:28.422933 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:28.422937 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:28.422939 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:28.423029 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:28.423357 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:28.423361 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:28.423363 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:28.423586 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:28.423717 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:28.424008 (+ 291us) server_negotiation.cc:299] Negotiation successful
0808 14:38:28.424130 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 14:38:28.426324 13544 catalog_manager.cc:1347] Generated new cluster ID: 922b15478271420eb7578d3ce8571b1b
I20260808 14:38:28.426391 13544 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:38:28.443085 13544 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:38:28.444041 13544 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:38:28.451900 13544 catalog_manager.cc:5868] T 00000000000000000000000000000000 P afeafc6fcf1e41fd94468a1b31ee1dfa: Generated new TSK 0
I20260808 14:38:28.452647 13544 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:38:28.458123 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 13419
2026-08-08T14:38:28Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1645 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786199615258783-11791-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:38:28 dist-test-slave-twwt krb5kdc[13569](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:38:28 dist-test-slave-twwt krb5kdc[13569](info): set up 2 sockets
Aug 08 14:38:28 dist-test-slave-twwt krb5kdc[13569](info): commencing operation
krb5kdc: starting...
W20260808 14:38:29.714010 11791 mini_kdc.cc:121] Time spent starting KDC: real 1.225s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Aug 08 14:38:29 dist-test-slave-twwt krb5kdc[13569](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199909, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:38:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:38:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.131.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
I20260808 14:38:29.850323 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:45069
--webserver_interface=127.11.131.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:38151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:45069
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:38:29.969799 13593 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:29.970086 13593 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:29.970170 13593 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:29.974228 13593 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:38:29.974311 13593 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:29.974363 13593 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:29.974419 13593 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:38:29.974457 13593 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:38:29.979853 13593 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:38151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786199615258783-11791-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:45069
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:45069
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.131.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13593
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:38:29.980947 13593 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:29.982000 13593 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:29.990727 13602 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:29.990736 13609 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:29.990873 13593 server_base.cc:1034] running on GCE node
W20260808 14:38:29.990747 13605 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:29.991644 13593 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:29.992828 13593 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:29.994024 13593 hybrid_clock.cc:648] HybridClock initialized: now 1786199909994001 us; error 35 us; skew 500 ppm
Aug 08 14:38:29 dist-test-slave-twwt krb5kdc[13569](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199909, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:29.996984 13593 init.cc:377] Logged in from keytab as kudu/127.11.131.254@KRBTEST.COM (short username kudu)
I20260808 14:38:29.997957 13593 webserver.cc:460] Webserver started at http://127.11.131.254:38405/ using document root <none> and password file <none>
I20260808 14:38:29.998538 13593 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:29.998649 13593 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:29.998909 13593 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:38:30.001036 13593 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786199615258783-11791-0/minicluster-data/master-0/data/instance:
uuid: "e07c93ca865d4d9088d69b1c4f0f2972"
format_stamp: "Formatted at 2026-08-08 14:38:29 on dist-test-slave-twwt"
server_key: "e70d3a3218bd3e830b600a698b84a9b5"
server_key_iv: "85c8a21d3e83acb8f43aecdf2e25f740"
server_key_version: "encryptionkey@0"
I20260808 14:38:30.001631 13593 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786199615258783-11791-0/minicluster-data/master-0/wal/instance:
uuid: "e07c93ca865d4d9088d69b1c4f0f2972"
format_stamp: "Formatted at 2026-08-08 14:38:29 on dist-test-slave-twwt"
server_key: "e70d3a3218bd3e830b600a698b84a9b5"
server_key_iv: "85c8a21d3e83acb8f43aecdf2e25f740"
server_key_version: "encryptionkey@0"
I20260808 14:38:30.005545 13593 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260808 14:38:30.008246 13617 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:30.009518 13593 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 14:38:30.009670 13593 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "e07c93ca865d4d9088d69b1c4f0f2972"
format_stamp: "Formatted at 2026-08-08 14:38:29 on dist-test-slave-twwt"
server_key: "e70d3a3218bd3e830b600a698b84a9b5"
server_key_iv: "85c8a21d3e83acb8f43aecdf2e25f740"
server_key_version: "encryptionkey@0"
I20260808 14:38:30.009792 13593 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:30.021473 13593 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:30.025101 13593 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:30.025321 13593 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:30.033203 13593 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.254:45069
I20260808 14:38:30.033232 13701 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.254:45069 every 8 connection(s)
I20260808 14:38:30.034269 13593 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:38:30.037165 13702 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:38:30.037560 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 13593
I20260808 14:38:30.037722 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786199615258783-11791-0/minicluster-data/master-0/wal/instance
I20260808 14:38:30.038017 11791 external_mini_cluster.cc:1428] Setting key cd271018329714a9214a2043a1ae839f
I20260808 14:38:30.043893 13702 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e07c93ca865d4d9088d69b1c4f0f2972: Bootstrap starting.
I20260808 14:38:30.046362 13702 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e07c93ca865d4d9088d69b1c4f0f2972: Neither blocks nor log segments found. Creating new log.
I20260808 14:38:30.047107 13708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:30.039467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33597 (local address 127.11.131.254:45069)
0808 14:38:30.039920 (+ 453us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:30.039936 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:30.039972 (+ 36us) server_negotiation.cc:407] Connection header received
0808 14:38:30.040631 (+ 659us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:30.040648 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:30.041000 (+ 352us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:30.041344 (+ 344us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:30.041765 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:30.042819 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:30.043751 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:30.044267 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:30.044436 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:30.045366 (+ 930us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:30.045371 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:30.045384 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:38:30.045766 (+ 382us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:30.045818 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:38:30.045840 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:30.045962 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:30.046094 (+ 132us) server_negotiation.cc:299] Negotiation successful
0808 14:38:30.046301 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":136,"threads_started":1}
I20260808 14:38:30.047259 13702 log.cc:824] T 00000000000000000000000000000000 P e07c93ca865d4d9088d69b1c4f0f2972: Log is configured to *not* fsync() on all Append() calls
I20260808 14:38:30.049437 13702 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e07c93ca865d4d9088d69b1c4f0f2972: No bootstrap required, opened a new log
I20260808 14:38:30.049866 11791 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:38:30.053612 13702 raft_consensus.cc:348] T 00000000000000000000000000000000 P e07c93ca865d4d9088d69b1c4f0f2972 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e07c93ca865d4d9088d69b1c4f0f2972" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 45069 } }
I20260808 14:38:30.053862 13702 raft_consensus.cc:374] T 00000000000000000000000000000000 P e07c93ca865d4d9088d69b1c4f0f2972 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:38:30.053934 13702 raft_consensus.cc:729] T 00000000000000000000000000000000 P e07c93ca865d4d9088d69b1c4f0f2972 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e07c93ca865d4d9088d69b1c4f0f2972, State: Initialized, Role: FOLLOWER
I20260808 14:38:30.054430 13702 consensus_queue.cc:260] T 00000000000000000000000000000000 P e07c93ca865d4d9088d69b1c4f0f2972 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e07c93ca865d4d9088d69b1c4f0f2972" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 45069 } }
I20260808 14:38:30.054584 13702 raft_consensus.cc:388] T 00000000000000000000000000000000 P e07c93ca865d4d9088d69b1c4f0f2972 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:38:30.054672 13702 raft_consensus.cc:482] T 00000000000000000000000000000000 P e07c93ca865d4d9088d69b1c4f0f2972 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:38:30.054774 13702 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e07c93ca865d4d9088d69b1c4f0f2972 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:38:30.055747 13702 raft_consensus.cc:504] T 00000000000000000000000000000000 P e07c93ca865d4d9088d69b1c4f0f2972 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e07c93ca865d4d9088d69b1c4f0f2972" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 45069 } }
I20260808 14:38:30.056165 13708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:30.052042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33667 (local address 127.11.131.254:45069)
0808 14:38:30.052167 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:30.052173 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:30.052314 (+ 141us) server_negotiation.cc:407] Connection header received
0808 14:38:30.052413 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:30.052417 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:30.052464 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:30.052549 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:30.052795 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:30.053530 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:30.054411 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:30.054798 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:30.054921 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:30.055706 (+ 785us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:30.055710 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:30.055712 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:38:30.055726 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:30.055758 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:38:30.055774 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:30.055866 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:30.055994 (+ 128us) server_negotiation.cc:299] Negotiation successful
0808 14:38:30.056043 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 14:38:30.056118 13702 leader_election.cc:302] T 00000000000000000000000000000000 P e07c93ca865d4d9088d69b1c4f0f2972 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e07c93ca865d4d9088d69b1c4f0f2972; no voters:
I20260808 14:38:30.056494 13702 leader_election.cc:288] T 00000000000000000000000000000000 P e07c93ca865d4d9088d69b1c4f0f2972 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:38:30.056604 13717 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e07c93ca865d4d9088d69b1c4f0f2972 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:38:30.056852 13717 raft_consensus.cc:686] T 00000000000000000000000000000000 P e07c93ca865d4d9088d69b1c4f0f2972 [term 1 LEADER]: Becoming Leader. State: Replica: e07c93ca865d4d9088d69b1c4f0f2972, State: Running, Role: LEADER
I20260808 14:38:30.057225 13717 consensus_queue.cc:237] T 00000000000000000000000000000000 P e07c93ca865d4d9088d69b1c4f0f2972 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e07c93ca865d4d9088d69b1c4f0f2972" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 45069 } }
I20260808 14:38:30.057830 13702 sys_catalog.cc:564] T 00000000000000000000000000000000 P e07c93ca865d4d9088d69b1c4f0f2972 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:38:30.059224 13718 sys_catalog.cc:455] T 00000000000000000000000000000000 P e07c93ca865d4d9088d69b1c4f0f2972 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e07c93ca865d4d9088d69b1c4f0f2972" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e07c93ca865d4d9088d69b1c4f0f2972" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 45069 } } }
I20260808 14:38:30.059366 13718 sys_catalog.cc:458] T 00000000000000000000000000000000 P e07c93ca865d4d9088d69b1c4f0f2972 [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:30.059235 13719 sys_catalog.cc:455] T 00000000000000000000000000000000 P e07c93ca865d4d9088d69b1c4f0f2972 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e07c93ca865d4d9088d69b1c4f0f2972. Latest consensus state: current_term: 1 leader_uuid: "e07c93ca865d4d9088d69b1c4f0f2972" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e07c93ca865d4d9088d69b1c4f0f2972" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 45069 } } }
I20260808 14:38:30.059783 13719 sys_catalog.cc:458] T 00000000000000000000000000000000 P e07c93ca865d4d9088d69b1c4f0f2972 [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:30.060132 13732 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:38:30.062994 13732 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:38:30.068356 13732 catalog_manager.cc:1347] Generated new cluster ID: 9557427f621347afbe89320d8e03c21e
I20260808 14:38:30.068424 13732 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:38:30.073386 13732 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:38:30.074285 13732 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:38:30.081534 13732 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e07c93ca865d4d9088d69b1c4f0f2972: Generated new TSK 0
I20260808 14:38:30.082197 13732 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:38:30.088658 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 13593
2026-08-08T14:38:30Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1633 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786199615258783-11791-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:38:30 dist-test-slave-twwt krb5kdc[13754](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:38:30 dist-test-slave-twwt krb5kdc[13754](info): set up 2 sockets
Aug 08 14:38:30 dist-test-slave-twwt krb5kdc[13754](info): commencing operation
krb5kdc: starting...
W20260808 14:38:31.369544 11791 mini_kdc.cc:121] Time spent starting KDC: real 1.246s user 0.003s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Aug 08 14:38:31 dist-test-slave-twwt krb5kdc[13754](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199911, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:38:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:38:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.131.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
I20260808 14:38:31.501925 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:46817
--webserver_interface=127.11.131.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:33639
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:46817
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:38:31.618708 13780 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:31.619024 13780 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:31.619100 13780 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:31.623126 13780 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:38:31.623210 13780 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:31.623248 13780 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:31.623307 13780 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:38:31.623342 13780 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:38:31.628575 13780 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:33639
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786199615258783-11791-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:46817
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:46817
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.131.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13780
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:38:31.629724 13780 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:31.630898 13780 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:31.639819 13787 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:31.639874 13790 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:31.640072 13780 server_base.cc:1034] running on GCE node
W20260808 14:38:31.639819 13793 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:31.640664 13780 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:31.641847 13780 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:31.643038 13780 hybrid_clock.cc:648] HybridClock initialized: now 1786199911643016 us; error 30 us; skew 500 ppm
Aug 08 14:38:31 dist-test-slave-twwt krb5kdc[13754](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199911, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:31.645906 13780 init.cc:377] Logged in from keytab as kudu/127.11.131.254@KRBTEST.COM (short username kudu)
I20260808 14:38:31.646871 13780 webserver.cc:460] Webserver started at http://127.11.131.254:43835/ using document root <none> and password file <none>
I20260808 14:38:31.647403 13780 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:31.647459 13780 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:31.647627 13780 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:38:31.649691 13780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786199615258783-11791-0/minicluster-data/master-0/data/instance:
uuid: "3c92d40fe2844a5fb07de617ebaccbe2"
format_stamp: "Formatted at 2026-08-08 14:38:31 on dist-test-slave-twwt"
server_key: "109b63b7f5ca8c0cf3318ece79e6333f"
server_key_iv: "dc93e4d4253a7611a844a4b3cc6fb341"
server_key_version: "encryptionkey@0"
I20260808 14:38:31.650249 13780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786199615258783-11791-0/minicluster-data/master-0/wal/instance:
uuid: "3c92d40fe2844a5fb07de617ebaccbe2"
format_stamp: "Formatted at 2026-08-08 14:38:31 on dist-test-slave-twwt"
server_key: "109b63b7f5ca8c0cf3318ece79e6333f"
server_key_iv: "dc93e4d4253a7611a844a4b3cc6fb341"
server_key_version: "encryptionkey@0"
I20260808 14:38:31.653985 13780 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 14:38:31.656417 13801 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:31.657650 13780 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 14:38:31.657783 13780 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "3c92d40fe2844a5fb07de617ebaccbe2"
format_stamp: "Formatted at 2026-08-08 14:38:31 on dist-test-slave-twwt"
server_key: "109b63b7f5ca8c0cf3318ece79e6333f"
server_key_iv: "dc93e4d4253a7611a844a4b3cc6fb341"
server_key_version: "encryptionkey@0"
I20260808 14:38:31.657887 13780 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:31.662580 13780 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:31.665930 13780 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:31.666126 13780 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:31.674067 13780 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.254:46817
I20260808 14:38:31.674095 13875 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.254:46817 every 8 connection(s)
I20260808 14:38:31.675120 13780 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:38:31.677922 13876 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:38:31.678673 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 13780
I20260808 14:38:31.678838 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786199615258783-11791-0/minicluster-data/master-0/wal/instance
I20260808 14:38:31.679147 11791 external_mini_cluster.cc:1428] Setting key 3ab1499ddfe0a626d91ba4e453cc1915
I20260808 14:38:31.684386 13882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:31.680626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53227 (local address 127.11.131.254:46817)
0808 14:38:31.681077 (+ 451us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:31.681091 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:31.681126 (+ 35us) server_negotiation.cc:407] Connection header received
0808 14:38:31.681762 (+ 636us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:31.681780 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:31.682058 (+ 278us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:31.682407 (+ 349us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:31.683185 (+ 778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:31.683190 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:31.683211 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:38:31.683222 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:31.683280 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:38:31.683299 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:31.683454 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:31.683533 (+ 79us) server_negotiation.cc:299] Negotiation successful
0808 14:38:31.683696 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":307,"thread_start_us":134,"threads_started":1}
I20260808 14:38:31.684454 13876 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c92d40fe2844a5fb07de617ebaccbe2: Bootstrap starting.
I20260808 14:38:31.686813 13876 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3c92d40fe2844a5fb07de617ebaccbe2: Neither blocks nor log segments found. Creating new log.
I20260808 14:38:31.687186 11791 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:38:31.687672 13876 log.cc:824] T 00000000000000000000000000000000 P 3c92d40fe2844a5fb07de617ebaccbe2: Log is configured to *not* fsync() on all Append() calls
I20260808 14:38:31.690032 13876 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c92d40fe2844a5fb07de617ebaccbe2: No bootstrap required, opened a new log
I20260808 14:38:31.690873 13882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:31.689288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60669 (local address 127.11.131.254:46817)
0808 14:38:31.689434 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:31.689437 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:31.689564 (+ 127us) server_negotiation.cc:407] Connection header received
0808 14:38:31.689683 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:31.689685 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:31.689713 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:31.689777 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:31.690482 (+ 705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:31.690485 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:31.690487 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 14:38:31.690497 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:31.690520 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 14:38:31.690529 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:31.690595 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:31.690731 (+ 136us) server_negotiation.cc:299] Negotiation successful
0808 14:38:31.690762 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 14:38:31.693996 13876 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3c92d40fe2844a5fb07de617ebaccbe2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c92d40fe2844a5fb07de617ebaccbe2" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46817 } }
I20260808 14:38:31.694216 13876 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3c92d40fe2844a5fb07de617ebaccbe2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 14:38:31.694311 13876 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3c92d40fe2844a5fb07de617ebaccbe2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c92d40fe2844a5fb07de617ebaccbe2, State: Initialized, Role: FOLLOWER
I20260808 14:38:31.694801 13876 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3c92d40fe2844a5fb07de617ebaccbe2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c92d40fe2844a5fb07de617ebaccbe2" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46817 } }
I20260808 14:38:31.694953 13876 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3c92d40fe2844a5fb07de617ebaccbe2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 14:38:31.695021 13876 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3c92d40fe2844a5fb07de617ebaccbe2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 14:38:31.695129 13876 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3c92d40fe2844a5fb07de617ebaccbe2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:38:31.696062 13876 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3c92d40fe2844a5fb07de617ebaccbe2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c92d40fe2844a5fb07de617ebaccbe2" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46817 } }
I20260808 14:38:31.696416 13876 leader_election.cc:302] T 00000000000000000000000000000000 P 3c92d40fe2844a5fb07de617ebaccbe2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3c92d40fe2844a5fb07de617ebaccbe2; no voters:
I20260808 14:38:31.696766 13876 leader_election.cc:288] T 00000000000000000000000000000000 P 3c92d40fe2844a5fb07de617ebaccbe2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 14:38:31.696902 13890 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3c92d40fe2844a5fb07de617ebaccbe2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:38:31.697132 13890 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3c92d40fe2844a5fb07de617ebaccbe2 [term 1 LEADER]: Becoming Leader. State: Replica: 3c92d40fe2844a5fb07de617ebaccbe2, State: Running, Role: LEADER
I20260808 14:38:31.697487 13890 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3c92d40fe2844a5fb07de617ebaccbe2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c92d40fe2844a5fb07de617ebaccbe2" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46817 } }
I20260808 14:38:31.698076 13876 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3c92d40fe2844a5fb07de617ebaccbe2 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:38:31.699221 13893 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c92d40fe2844a5fb07de617ebaccbe2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3c92d40fe2844a5fb07de617ebaccbe2. Latest consensus state: current_term: 1 leader_uuid: "3c92d40fe2844a5fb07de617ebaccbe2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c92d40fe2844a5fb07de617ebaccbe2" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46817 } } }
I20260808 14:38:31.699358 13893 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c92d40fe2844a5fb07de617ebaccbe2 [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:31.699550 13891 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c92d40fe2844a5fb07de617ebaccbe2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3c92d40fe2844a5fb07de617ebaccbe2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c92d40fe2844a5fb07de617ebaccbe2" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 46817 } } }
I20260808 14:38:31.699697 13891 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c92d40fe2844a5fb07de617ebaccbe2 [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:31.699769 13906 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:38:31.703122 13906 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:38:31.708938 13906 catalog_manager.cc:1347] Generated new cluster ID: 87b3643e333743b4930e8fb702b9f28d
I20260808 14:38:31.709012 13906 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:38:31.725457 13906 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:38:31.725854 13906 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:38:31.731244 13906 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3c92d40fe2844a5fb07de617ebaccbe2: Generated new TSK 0
I20260808 14:38:31.731971 13906 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 14:38:31.737386 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 13780
2026-08-08T14:38:31Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1649 ms)
[----------] 18 tests from AuthTokenIssuingTest (29863 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:38:31 dist-test-slave-twwt krb5kdc[13928](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:38:31 dist-test-slave-twwt krb5kdc[13928](info): set up 2 sockets
Aug 08 14:38:31 dist-test-slave-twwt krb5kdc[13928](info): commencing operation
krb5kdc: starting...
W20260808 14:38:33.005640 11791 mini_kdc.cc:121] Time spent starting KDC: real 1.233s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Aug 08 14:38:33 dist-test-slave-twwt krb5kdc[13928](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199913, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:38:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:38:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.131.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
I20260808 14:38:33.145429 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:43805
--webserver_interface=127.11.131.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:44409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:43805,127.11.131.253:46213,127.11.131.252:40445
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:38:33.265465 13948 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 14:38:33.265825 13948 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:33.265902 13948 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:33.265980 13948 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:33.270020 13948 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:38:33.270121 13948 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:33.270161 13948 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:33.270200 13948 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:38:33.270236 13948 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:38:33.275766 13948 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:44409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:43805,127.11.131.253:46213,127.11.131.252:40445
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:43805
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.131.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13948
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:38:33.276975 13948 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:33.278093 13948 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:33.287253 13960 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:33.287245 13957 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:33.287375 13948 server_base.cc:1034] running on GCE node
W20260808 14:38:33.287248 13962 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:33.288096 13948 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:33.289302 13948 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:33.290503 13948 hybrid_clock.cc:648] HybridClock initialized: now 1786199913290488 us; error 28 us; skew 500 ppm
Aug 08 14:38:33 dist-test-slave-twwt krb5kdc[13928](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199913, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:33.293515 13948 init.cc:377] Logged in from keytab as kudu/127.11.131.254@KRBTEST.COM (short username kudu)
I20260808 14:38:33.294538 13948 webserver.cc:460] Webserver started at http://127.11.131.254:42519/ using document root <none> and password file <none>
I20260808 14:38:33.295195 13948 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:33.295293 13948 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:33.295539 13948 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:38:33.297662 13948 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/minicluster-data/master-0/data/instance:
uuid: "f60375dbcdd9492f8c06d361eb430ed7"
format_stamp: "Formatted at 2026-08-08 14:38:33 on dist-test-slave-twwt"
server_key: "91988ee2dee8cc238f10da723a74e1a3"
server_key_iv: "dfa7dc08e56a107fcd9be1bee8ceb0f7"
server_key_version: "encryptionkey@0"
I20260808 14:38:33.298256 13948 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/minicluster-data/master-0/wal/instance:
uuid: "f60375dbcdd9492f8c06d361eb430ed7"
format_stamp: "Formatted at 2026-08-08 14:38:33 on dist-test-slave-twwt"
server_key: "91988ee2dee8cc238f10da723a74e1a3"
server_key_iv: "dfa7dc08e56a107fcd9be1bee8ceb0f7"
server_key_version: "encryptionkey@0"
I20260808 14:38:33.302098 13948 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 14:38:33.304597 13973 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:33.305863 13948 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 14:38:33.306007 13948 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "f60375dbcdd9492f8c06d361eb430ed7"
format_stamp: "Formatted at 2026-08-08 14:38:33 on dist-test-slave-twwt"
server_key: "91988ee2dee8cc238f10da723a74e1a3"
server_key_iv: "dfa7dc08e56a107fcd9be1bee8ceb0f7"
server_key_version: "encryptionkey@0"
I20260808 14:38:33.306123 13948 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:33.349701 13948 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:33.353068 13948 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:33.353319 13948 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:33.361021 13948 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.254:43805
I20260808 14:38:33.361322 14052 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.254:43805 every 8 connection(s)
I20260808 14:38:33.362056 13948 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:38:33.364545 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 13948
I20260808 14:38:33.364697 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/minicluster-data/master-0/wal/instance
I20260808 14:38:33.365031 11791 external_mini_cluster.cc:1428] Setting key bbb2a4c8f4c2e609a53af058105ecb89
I20260808 14:38:33.365357 14055 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:38:33.369639 14055 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.131.254" port: 43805 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.11.131.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.253@KRBTEST.COM" created.
Aug 08 14:38:33 dist-test-slave-twwt krb5kdc[13928](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199913, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:38:33.386355 14060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:33.372107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50544 (local address 127.11.131.254:43805)
0808 14:38:33.372665 (+ 558us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:33.372680 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:33.372749 (+ 69us) server_negotiation.cc:407] Connection header received
0808 14:38:33.373878 (+ 1129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:33.373888 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:33.374130 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:33.374335 (+ 205us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:33.375264 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:33.376200 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:33.377458 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:33.377969 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:33.378088 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:33.380833 (+ 2745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:33.380843 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:33.380860 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:33.380892 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:33.383061 (+ 2169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:33.383566 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:33.383575 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:33.383579 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:33.383735 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:33.384073 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:33.384080 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:33.384084 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:33.384630 (+ 546us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:33.384804 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:33.385244 (+ 440us) server_negotiation.cc:299] Negotiation successful
0808 14:38:33.385520 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":66,"server-negotiator.queue_time_us":431,"spinlock_wait_cycles":16256,"thread_start_us":142,"threads_started":1}
I20260808 14:38:33.386356 14059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:33.372107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:43805 (local address 127.0.0.1:50544)
0808 14:38:33.372580 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:33.372633 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:33.373528 (+ 895us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:33.374360 (+ 832us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:33.374396 (+ 36us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:33.374847 (+ 451us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:38:33.375118 (+ 271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:33.375131 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:33.376333 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:33.376336 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:33.377309 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:33.377320 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:33.378151 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:33.378164 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:33.378315 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:33.378984 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:38:33.379011 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:38:33.380677 (+ 1666us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:38:33.383186 (+ 2509us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:33.383197 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:33.383206 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:33.383441 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:33.383855 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:33.383858 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:33.383859 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:33.383972 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:33.384819 (+ 847us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:38:33.384825 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:38:33.384961 (+ 136us) client_negotiation.cc:769] Sending connection context
0808 14:38:33.385126 (+ 165us) client_negotiation.cc:240] Negotiation successful
0808 14:38:33.385413 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":128,"threads_started":1}
I20260808 14:38:33.389366 14055 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.131.253" port: 46213 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:38:33.390311 14059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:33.390010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.253:46213 (local address 127.0.0.1:57414)
0808 14:38:33.390142 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:33.390218 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.253:46213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260808 14:38:33.390730 13975 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.131.253:46213: connect: Connection refused (error 111)
I20260808 14:38:33.391788 14059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:33.391525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.253:46213 (local address 127.0.0.1:57420)
0808 14:38:33.391640 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:33.391689 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.253:46213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260808 14:38:33.391999 14055 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.131.253:46213: Network error: Client connection negotiation failed: client connection to 127.11.131.253:46213: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.253.keytab.
Entry for principal kudu/127.11.131.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.253.keytab.
I20260808 14:38:33.398343 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.253:46213
--webserver_interface=127.11.131.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.253.keytab
--principal=kudu/127.11.131.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:44409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:43805,127.11.131.253:46213,127.11.131.252:40445
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:38:33.441287 14055 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.131.253" port: 46213 } attempt: 1
I20260808 14:38:33.442343 14059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:33.442011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.253:46213 (local address 127.0.0.1:57436)
0808 14:38:33.442183 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:33.442257 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.253:46213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260808 14:38:33.443194 14059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:33.442956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.253:46213 (local address 127.0.0.1:57440)
0808 14:38:33.443077 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:33.443135 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.253:46213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260808 14:38:33.443344 14055 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.131.253:46213: Network error: Client connection negotiation failed: client connection to 127.11.131.253:46213: connect: Connection refused (error 111)
I20260808 14:38:33.511507 14055 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.131.253" port: 46213 } attempt: 2
I20260808 14:38:33.512365 14059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:33.512048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.253:46213 (local address 127.0.0.1:57452)
0808 14:38:33.512210 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:33.512287 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.253:46213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260808 14:38:33.513105 14059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:33.512879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.253:46213 (local address 127.0.0.1:57460)
0808 14:38:33.512998 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:33.513050 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.253:46213: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260808 14:38:33.513273 14055 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.131.253:46213: Network error: Client connection negotiation failed: client connection to 127.11.131.253:46213: connect: Connection refused (error 111)
W20260808 14:38:33.516017 14067 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 14:38:33.516335 14067 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:33.516397 14067 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:33.516479 14067 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:33.520664 14067 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:38:33.520741 14067 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:33.520794 14067 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:33.520853 14067 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:38:33.520891 14067 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:38:33.526181 14067 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:44409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:43805,127.11.131.253:46213,127.11.131.252:40445
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.253.keytab
--principal=kudu/127.11.131.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.253:46213
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.131.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14067
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:38:33.527360 14067 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:33.528414 14067 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:33.537052 14075 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:33.537030 14078 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:33.537037 14076 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:33.537395 14067 server_base.cc:1034] running on GCE node
I20260808 14:38:33.537904 14067 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:33.539040 14067 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:33.540206 14067 hybrid_clock.cc:648] HybridClock initialized: now 1786199913540188 us; error 30 us; skew 500 ppm
Aug 08 14:38:33 dist-test-slave-twwt krb5kdc[13928](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199913, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:33.546237 14067 init.cc:377] Logged in from keytab as kudu/127.11.131.253@KRBTEST.COM (short username kudu)
I20260808 14:38:33.547283 14067 webserver.cc:460] Webserver started at http://127.11.131.253:41305/ using document root <none> and password file <none>
I20260808 14:38:33.547891 14067 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:33.547958 14067 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:33.548208 14067 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:38:33.550314 14067 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/minicluster-data/master-1/data/instance:
uuid: "993f9f99e1934852b0fe23b11ca4cc88"
format_stamp: "Formatted at 2026-08-08 14:38:33 on dist-test-slave-twwt"
server_key: "f694dac38eb70b9df7008f85e6702781"
server_key_iv: "7e5f9e3c6f45a5cb1115339701761e04"
server_key_version: "encryptionkey@0"
I20260808 14:38:33.550938 14067 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/minicluster-data/master-1/wal/instance:
uuid: "993f9f99e1934852b0fe23b11ca4cc88"
format_stamp: "Formatted at 2026-08-08 14:38:33 on dist-test-slave-twwt"
server_key: "f694dac38eb70b9df7008f85e6702781"
server_key_iv: "7e5f9e3c6f45a5cb1115339701761e04"
server_key_version: "encryptionkey@0"
I20260808 14:38:33.554809 14067 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 14:38:33.557253 14088 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:33.558535 14067 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 14:38:33.558715 14067 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/minicluster-data/master-1/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/minicluster-data/master-1/wal
uuid: "993f9f99e1934852b0fe23b11ca4cc88"
format_stamp: "Formatted at 2026-08-08 14:38:33 on dist-test-slave-twwt"
server_key: "f694dac38eb70b9df7008f85e6702781"
server_key_iv: "7e5f9e3c6f45a5cb1115339701761e04"
server_key_version: "encryptionkey@0"
I20260808 14:38:33.558859 14067 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:33.576077 14067 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:33.579161 14067 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:33.579376 14067 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:33.587002 14067 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.253:46213
I20260808 14:38:33.587302 14172 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.253:46213 every 8 connection(s)
I20260808 14:38:33.588104 14067 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/minicluster-data/master-1/data/info.pb
I20260808 14:38:33.591076 14173 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:38:33.595026 14173 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.131.254" port: 43805 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:38:33.596168 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 14067
I20260808 14:38:33.596304 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/minicluster-data/master-1/wal/instance
I20260808 14:38:33.596581 11791 external_mini_cluster.cc:1428] Setting key dcbef0e9a49d21b7dd2aa5afcc5a0dab
I20260808 14:38:33.604417 14055 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.131.253" port: 46213 } attempt: 3
Aug 08 14:38:33 dist-test-slave-twwt krb5kdc[13928](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199913, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.253@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.131.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.252@KRBTEST.COM" created.
Aug 08 14:38:33 dist-test-slave-twwt krb5kdc[13928](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199913, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for kudu/127.11.131.253@KRBTEST.COM
I20260808 14:38:33.612355 14060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:33.597088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50548 (local address 127.11.131.254:43805)
0808 14:38:33.597278 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:33.597286 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:33.598234 (+ 948us) server_negotiation.cc:407] Connection header received
0808 14:38:33.599456 (+ 1222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:33.599463 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:33.599534 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:33.599644 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:33.601022 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:33.601542 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:33.603478 (+ 1936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:33.603721 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:33.603839 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:33.607131 (+ 3292us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:33.607140 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:33.607142 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:33.607186 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:33.609673 (+ 2487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:33.610475 (+ 802us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:33.610482 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:33.610487 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:33.610583 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:33.610990 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:33.610994 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:33.610996 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:33.611183 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:33.611295 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:33.611953 (+ 658us) server_negotiation.cc:299] Negotiation successful
0808 14:38:33.612103 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 14:38:33.613296 14178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:33.597489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:43805 (local address 127.0.0.1:50548)
0808 14:38:33.598039 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:33.598101 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:33.599230 (+ 1129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:33.599800 (+ 570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:33.599807 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:33.600149 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:38:33.600856 (+ 707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:33.600880 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:33.601686 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:33.601693 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:33.603314 (+ 1621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:33.603329 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:33.603923 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:33.603929 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:33.604183 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:33.605205 (+ 1022us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:38:33.605243 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:38:33.606984 (+ 1741us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:38:33.609797 (+ 2813us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:33.609803 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:33.609817 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:33.610300 (+ 483us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:33.610695 (+ 395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:33.610698 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:33.610700 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:33.610898 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:33.611306 (+ 408us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:38:33.611315 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:38:33.611588 (+ 273us) client_negotiation.cc:769] Sending connection context
0808 14:38:33.611836 (+ 248us) client_negotiation.cc:240] Negotiation successful
0808 14:38:33.612162 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":118,"threads_started":1}
I20260808 14:38:33.615255 14173 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.131.253" port: 46213 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:38:33.615813 14059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:33.604952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.253:46213 (local address 127.0.0.1:57470)
0808 14:38:33.605103 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:33.605118 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:33.605207 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:33.605840 (+ 633us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:33.605843 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:33.606046 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:38:33.606176 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:33.606184 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:33.607655 (+ 1471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:33.607660 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:33.608257 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:33.608270 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:33.608869 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:33.608874 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:33.609001 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:33.609590 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:38:33.609608 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:38:33.611202 (+ 1594us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:38:33.613976 (+ 2774us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:33.613979 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:33.613981 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:33.614220 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:33.614627 (+ 407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:33.614633 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:33.614638 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:33.614740 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:33.615323 (+ 583us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:38:33.615326 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:38:33.615439 (+ 113us) client_negotiation.cc:769] Sending connection context
0808 14:38:33.615551 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 14:38:33.615702 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65}
I20260808 14:38:33.616096 14181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:33.605062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57470 (local address 127.11.131.253:46213)
0808 14:38:33.605465 (+ 403us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:33.605475 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:33.605495 (+ 20us) server_negotiation.cc:407] Connection header received
0808 14:38:33.605530 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:33.605534 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:33.605685 (+ 151us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:33.605856 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:33.606318 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:33.607527 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:33.608389 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:33.608736 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:33.608823 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:33.611379 (+ 2556us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:33.611392 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:33.611411 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:33.611444 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:33.613848 (+ 2404us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:33.614385 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:33.614391 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:33.614392 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:33.614487 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:33.614850 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:33.614856 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:33.614861 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:33.615204 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:33.615358 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:33.615660 (+ 302us) server_negotiation.cc:299] Negotiation successful
0808 14:38:33.615825 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":316,"thread_start_us":123,"threads_started":1}
I20260808 14:38:33.618381 14055 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.131.252" port: 40445 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:38:33.619127 14059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:33.618893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.252:40445 (local address 127.0.0.1:59210)
0808 14:38:33.619010 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:33.619068 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.252:40445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260808 14:38:33.620042 14059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:33.619698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.252:40445 (local address 127.0.0.1:59220)
0808 14:38:33.619868 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:33.619953 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.252:40445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
W20260808 14:38:33.620221 14055 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.131.252:40445: Network error: Client connection negotiation failed: client connection to 127.11.131.252:40445: connect: Connection refused (error 111)
Aug 08 14:38:33 dist-test-slave-twwt krb5kdc[13928](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199913, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.253@KRBTEST.COM for kudu/127.11.131.253@KRBTEST.COM
I20260808 14:38:33.628029 14178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:33.616175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.253:46213 (local address 127.0.0.1:57472)
0808 14:38:33.617102 (+ 927us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:33.617113 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:33.617219 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:33.617456 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:33.617459 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:33.617619 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:38:33.617710 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:33.617716 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:33.618679 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:33.618685 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:33.620648 (+ 1963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:33.620664 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:33.621245 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:33.621252 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:33.621377 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:33.621832 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:38:33.621844 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:38:33.624418 (+ 2574us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:38:33.626365 (+ 1947us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:33.626372 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:33.626375 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:33.626680 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:33.627022 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:33.627025 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:33.627026 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:33.627109 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:33.627591 (+ 482us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:38:33.627594 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:38:33.627685 (+ 91us) client_negotiation.cc:769] Sending connection context
0808 14:38:33.627770 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 14:38:33.627902 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":870}
I20260808 14:38:33.628201 14181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:33.616552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57472 (local address 127.11.131.253:46213)
0808 14:38:33.616696 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:33.616700 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:33.617182 (+ 482us) server_negotiation.cc:407] Connection header received
0808 14:38:33.617316 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:33.617319 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:33.617357 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:33.617446 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:33.617819 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:33.618519 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:33.620816 (+ 2297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:33.621101 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:33.621203 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:33.624574 (+ 3371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:33.624578 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:33.624580 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:33.624606 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:33.626197 (+ 1591us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:33.626790 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:33.626793 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:33.626794 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:33.626902 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:33.627208 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:33.627211 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:33.627213 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:33.627436 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:33.627629 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:33.627841 (+ 212us) server_negotiation.cc:299] Negotiation successful
0808 14:38:33.627970 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":53}
I20260808 14:38:33.629019 14173 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.131.252" port: 40445 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:38:33.629839 14178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:33.629565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.252:40445 (local address 127.0.0.1:59224)
0808 14:38:33.629695 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:33.629782 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.252:40445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.252.keytab.
Entry for principal kudu/127.11.131.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.252.keytab.
W20260808 14:38:33.630543 14096 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.131.252:40445: connect: Connection refused (error 111)
I20260808 14:38:33.631218 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.252:40445
--webserver_interface=127.11.131.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.252.keytab
--principal=kudu/127.11.131.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:44409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:43805,127.11.131.253:46213,127.11.131.252:40445
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:38:33.633213 14178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:33.631431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.252:40445 (local address 127.0.0.1:59232)
0808 14:38:33.633105 (+ 1674us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:33.633151 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.252:40445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1601}
W20260808 14:38:33.633409 14173 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.131.252:40445: Network error: Client connection negotiation failed: client connection to 127.11.131.252:40445: connect: Connection refused (error 111)
I20260808 14:38:33.651384 14055 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.131.252" port: 40445 } attempt: 1
I20260808 14:38:33.652313 14059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:33.652005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.252:40445 (local address 127.0.0.1:59246)
0808 14:38:33.652158 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:33.652231 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.252:40445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260808 14:38:33.653168 14059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:33.652936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.252:40445 (local address 127.0.0.1:59254)
0808 14:38:33.653054 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:33.653110 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.252:40445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260808 14:38:33.653357 14055 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.131.252:40445: Network error: Client connection negotiation failed: client connection to 127.11.131.252:40445: connect: Connection refused (error 111)
I20260808 14:38:33.682736 14173 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.131.252" port: 40445 } attempt: 1
I20260808 14:38:33.683823 14178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:33.683386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.252:40445 (local address 127.0.0.1:59270)
0808 14:38:33.683561 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:33.683664 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.252:40445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260808 14:38:33.684615 14178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:33.684386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.252:40445 (local address 127.0.0.1:59282)
0808 14:38:33.684500 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:33.684556 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.252:40445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260808 14:38:33.684760 14173 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.131.252:40445: Network error: Client connection negotiation failed: client connection to 127.11.131.252:40445: connect: Connection refused (error 111)
I20260808 14:38:33.728556 14055 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.131.252" port: 40445 } attempt: 2
I20260808 14:38:33.729509 14059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:33.729158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.252:40445 (local address 127.0.0.1:59294)
0808 14:38:33.729347 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:33.729425 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.252:40445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260808 14:38:33.730343 14059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:33.730104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.252:40445 (local address 127.0.0.1:59304)
0808 14:38:33.730227 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:33.730284 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.252:40445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260808 14:38:33.730487 14055 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.131.252:40445: Network error: Client connection negotiation failed: client connection to 127.11.131.252:40445: connect: Connection refused (error 111)
W20260808 14:38:33.751230 14185 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 14:38:33.751523 14185 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:33.751546 14185 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:33.751585 14185 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260808 14:38:33.752936 14173 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.131.252" port: 40445 } attempt: 2
I20260808 14:38:33.753837 14178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:33.753522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.252:40445 (local address 127.0.0.1:59314)
0808 14:38:33.753686 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:33.753749 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.252:40445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260808 14:38:33.754730 14178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:33.754467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.252:40445 (local address 127.0.0.1:59322)
0808 14:38:33.754576 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:33.754677 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.252:40445: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260808 14:38:33.754935 14173 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.131.252:40445: Network error: Client connection negotiation failed: client connection to 127.11.131.252:40445: connect: Connection refused (error 111)
W20260808 14:38:33.756281 14185 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:38:33.756368 14185 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:33.756413 14185 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:33.756448 14185 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:38:33.756484 14185 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:38:33.761979 14185 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:44409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:43805,127.11.131.253:46213,127.11.131.252:40445
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.252.keytab
--principal=kudu/127.11.131.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.252:40445
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.131.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14185
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:38:33.763379 14185 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:33.764485 14185 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:33.773607 14192 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:33.773672 14191 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:33.773605 14194 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:33.773878 14185 server_base.cc:1034] running on GCE node
I20260808 14:38:33.774713 14185 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:33.775964 14185 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:33.777184 14185 hybrid_clock.cc:648] HybridClock initialized: now 1786199913777163 us; error 36 us; skew 500 ppm
Aug 08 14:38:33 dist-test-slave-twwt krb5kdc[13928](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199913, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:33.780443 14185 init.cc:377] Logged in from keytab as kudu/127.11.131.252@KRBTEST.COM (short username kudu)
I20260808 14:38:33.781399 14185 webserver.cc:460] Webserver started at http://127.11.131.252:39617/ using document root <none> and password file <none>
I20260808 14:38:33.781992 14185 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:33.782089 14185 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:33.782352 14185 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:38:33.784555 14185 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/minicluster-data/master-2/data/instance:
uuid: "71be8d8285b6449fb924cf3d73c2c8a5"
format_stamp: "Formatted at 2026-08-08 14:38:33 on dist-test-slave-twwt"
server_key: "15eaa97c0ac37b5f2f0f2711fc4cf20e"
server_key_iv: "7c90bead9305010e6837c5f26d95beb7"
server_key_version: "encryptionkey@0"
I20260808 14:38:33.785136 14185 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/minicluster-data/master-2/wal/instance:
uuid: "71be8d8285b6449fb924cf3d73c2c8a5"
format_stamp: "Formatted at 2026-08-08 14:38:33 on dist-test-slave-twwt"
server_key: "15eaa97c0ac37b5f2f0f2711fc4cf20e"
server_key_iv: "7c90bead9305010e6837c5f26d95beb7"
server_key_version: "encryptionkey@0"
I20260808 14:38:33.788996 14185 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 14:38:33.791901 14201 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:33.793300 14185 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 14:38:33.793453 14185 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/minicluster-data/master-2/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/minicluster-data/master-2/wal
uuid: "71be8d8285b6449fb924cf3d73c2c8a5"
format_stamp: "Formatted at 2026-08-08 14:38:33 on dist-test-slave-twwt"
server_key: "15eaa97c0ac37b5f2f0f2711fc4cf20e"
server_key_iv: "7c90bead9305010e6837c5f26d95beb7"
server_key_version: "encryptionkey@0"
I20260808 14:38:33.793577 14185 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:33.810834 14185 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:33.814164 14185 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:33.814389 14185 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:33.821837 14185 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.252:40445
I20260808 14:38:33.822191 14277 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.252:40445 every 8 connection(s)
I20260808 14:38:33.822916 14185 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/minicluster-data/master-2/data/info.pb
I20260808 14:38:33.825802 14281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:38:33.829432 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 14185
I20260808 14:38:33.829636 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786199615258783-11791-0/minicluster-data/master-2/wal/instance
I20260808 14:38:33.829656 14055 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.131.252" port: 40445 } attempt: 3
I20260808 14:38:33.829993 11791 external_mini_cluster.cc:1428] Setting key 3fc0835620e9517505250d3bd666d824
I20260808 14:38:33.829810 14281 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.131.254" port: 43805 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:38:33 dist-test-slave-twwt krb5kdc[13928](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199913, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for kudu/127.11.131.252@KRBTEST.COM
Aug 08 14:38:33 dist-test-slave-twwt krb5kdc[13928](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199913, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.252@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
Aug 08 14:38:33 dist-test-slave-twwt krb5kdc[13928](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199913, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.131.252@KRBTEST.COM
I20260808 14:38:33.844925 14059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:33.830243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.252:40445 (local address 127.0.0.1:59330)
0808 14:38:33.830464 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:33.830481 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:33.830581 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:33.833163 (+ 2582us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:33.833170 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:33.833399 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:38:33.833558 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:33.833568 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:33.835238 (+ 1670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:33.835244 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:33.836093 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:33.836104 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:33.836868 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:33.836872 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:33.836965 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:33.837533 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:38:33.837554 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:38:33.839849 (+ 2295us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:38:33.842217 (+ 2368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:33.842220 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:33.842222 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:33.842509 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:33.842886 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:33.842891 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:33.842896 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:33.843343 (+ 447us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:33.844412 (+ 1069us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:38:33.844418 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:38:33.844532 (+ 114us) client_negotiation.cc:769] Sending connection context
0808 14:38:33.844622 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 14:38:33.844773 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"spinlock_wait_cycles":5888}
I20260808 14:38:33.845683 14287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:33.831126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59330 (local address 127.11.131.252:40445)
0808 14:38:33.831627 (+ 501us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:33.831646 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:33.831683 (+ 37us) server_negotiation.cc:407] Connection header received
0808 14:38:33.832562 (+ 879us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:33.832584 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:33.832962 (+ 378us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:33.833194 (+ 232us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:33.833753 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:33.835127 (+ 1374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:33.836240 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:33.836748 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:33.836918 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:33.840003 (+ 3085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:33.840010 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:33.840027 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:33.840059 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:33.842084 (+ 2025us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:33.842678 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:33.842684 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:33.842686 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:33.842776 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:33.844040 (+ 1264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:33.844046 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:33.844051 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:33.844279 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:33.845146 (+ 867us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:33.845231 (+ 85us) server_negotiation.cc:299] Negotiation successful
0808 14:38:33.845334 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":261,"server-negotiator.queue_time_us":359,"spinlock_wait_cycles":4352,"thread_start_us":140,"threads_started":1}
I20260808 14:38:33.845687 14289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:33.831127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59338 (local address 127.11.131.252:40445)
0808 14:38:33.831682 (+ 555us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:33.831688 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:33.831702 (+ 14us) server_negotiation.cc:407] Connection header received
0808 14:38:33.832573 (+ 871us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:33.832586 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:33.832966 (+ 380us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:33.833959 (+ 993us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:33.834081 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:33.835139 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:33.836359 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:33.836752 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:33.837269 (+ 517us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:33.840145 (+ 2876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:33.840152 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:33.840158 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:33.840189 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:33.842696 (+ 2507us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:33.843189 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:33.843191 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:33.843192 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:33.843258 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:33.843545 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:33.843549 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:33.843550 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:33.843834 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:33.844048 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:33.844279 (+ 231us) server_negotiation.cc:299] Negotiation successful
0808 14:38:33.844724 (+ 445us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":111,"server-negotiator.queue_time_us":475,"spinlock_wait_cycles":7936,"thread_start_us":117,"threads_started":1}
I20260808 14:38:33.846333 14060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:33.832279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50558 (local address 127.11.131.254:43805)
0808 14:38:33.832418 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:33.832423 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:33.832760 (+ 337us) server_negotiation.cc:407] Connection header received
0808 14:38:33.833733 (+ 973us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:33.833738 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:33.833783 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:33.833859 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:33.834788 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:33.835449 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:33.836526 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:33.836877 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:33.836978 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:33.839750 (+ 2772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:33.839757 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:33.839763 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:33.839795 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:33.841556 (+ 1761us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:33.842258 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:33.842262 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:33.842264 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:33.842382 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:33.842867 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:33.842874 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:33.842878 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:33.843161 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:33.843239 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:33.846111 (+ 2872us) server_negotiation.cc:299] Negotiation successful
0808 14:38:33.846213 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":58,"spinlock_wait_cycles":2432}
I20260808 14:38:33.846657 14173 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.131.252" port: 40445 } attempt: 3
I20260808 14:38:33.846971 14290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:33.832214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:43805 (local address 127.0.0.1:50558)
0808 14:38:33.832609 (+ 395us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:33.832656 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:33.832947 (+ 291us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:33.833949 (+ 1002us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:33.833955 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:33.834415 (+ 460us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:38:33.834631 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:33.834646 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:33.835564 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:33.835567 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:33.836399 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:33.836407 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:33.837161 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:33.837166 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:33.837282 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:33.837899 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:38:33.837920 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:38:33.839584 (+ 1664us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:38:33.841691 (+ 2107us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:33.841702 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:33.841715 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:33.842177 (+ 462us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:33.842505 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:33.842508 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:33.842510 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:33.842741 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:33.843494 (+ 753us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:38:33.843503 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:38:33.843840 (+ 337us) client_negotiation.cc:769] Sending connection context
0808 14:38:33.846555 (+ 2715us) client_negotiation.cc:240] Negotiation successful
0808 14:38:33.846771 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":227,"mutex_wait_us":4,"thread_start_us":130,"threads_started":1}
I20260808 14:38:33.848582 14281 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.131.253" port: 46213 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:38:33.850435 14055 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f60375dbcdd9492f8c06d361eb430ed7: Bootstrap starting.
Aug 08 14:38:33 dist-test-slave-twwt krb5kdc[13928](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199913, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.253@KRBTEST.COM for kudu/127.11.131.252@KRBTEST.COM
I20260808 14:38:33.854266 14055 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f60375dbcdd9492f8c06d361eb430ed7: Neither blocks nor log segments found. Creating new log.
Aug 08 14:38:33 dist-test-slave-twwt krb5kdc[13928](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199913, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.252@KRBTEST.COM for kudu/127.11.131.253@KRBTEST.COM
I20260808 14:38:33.855276 14055 log.cc:824] T 00000000000000000000000000000000 P f60375dbcdd9492f8c06d361eb430ed7: Log is configured to *not* fsync() on all Append() calls
Aug 08 14:38:33 dist-test-slave-twwt krb5kdc[13928](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199913, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:38:33.857663 14178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:33.847156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.252:40445 (local address 127.0.0.1:59340)
0808 14:38:33.847294 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:33.847320 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:33.847417 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:33.847924 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:33.847928 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:33.848133 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:38:33.848250 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:33.848257 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:33.849290 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:33.849294 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:33.849969 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:33.849978 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:33.850592 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:33.850595 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:33.850724 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:33.851202 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:38:33.851217 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:38:33.852743 (+ 1526us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:38:33.855144 (+ 2401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:33.855148 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:33.855152 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:33.855562 (+ 410us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:33.856149 (+ 587us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:33.856155 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:33.856158 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:33.856262 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:33.856728 (+ 466us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:38:33.856733 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:38:33.856842 (+ 109us) client_negotiation.cc:769] Sending connection context
0808 14:38:33.857320 (+ 478us) client_negotiation.cc:240] Negotiation successful
0808 14:38:33.857465 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57,"mutex_wait_us":3}
I20260808 14:38:33.857733 14055 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f60375dbcdd9492f8c06d361eb430ed7: No bootstrap required, opened a new log
I20260808 14:38:33.858304 14289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:33.847450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59340 (local address 127.11.131.252:40445)
0808 14:38:33.847674 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:33.847678 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:33.847690 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:38:33.847723 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:33.847725 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:33.847764 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:33.848367 (+ 603us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:33.848454 (+ 87us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:33.849158 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:33.850109 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:33.850472 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:33.850961 (+ 489us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:33.852888 (+ 1927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:33.852898 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:33.852900 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:33.852921 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:33.855013 (+ 2092us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:33.855663 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:33.855668 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:33.855671 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:33.855762 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:33.856363 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:33.856369 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:33.856372 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:33.856601 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:33.856911 (+ 310us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:33.858017 (+ 1106us) server_negotiation.cc:299] Negotiation successful
0808 14:38:33.858131 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162}
I20260808 14:38:33.859166 14181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:33.849137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57486 (local address 127.11.131.253:46213)
0808 14:38:33.849255 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:33.849261 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:33.849275 (+ 14us) server_negotiation.cc:407] Connection header received
0808 14:38:33.849384 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:33.849386 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:33.849429 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:33.849504 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:33.849948 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:33.850671 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:33.851777 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:33.852155 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:33.852237 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:33.855260 (+ 3023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:33.855263 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:33.855266 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:33.855287 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:33.857049 (+ 1762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:33.857532 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:33.857535 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:33.857537 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:33.857620 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:33.857957 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:33.857960 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:33.857962 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:33.858164 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:33.858235 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:33.858652 (+ 417us) server_negotiation.cc:299] Negotiation successful
0808 14:38:33.858772 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 14:38:33.859546 14290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:33.849062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.253:46213 (local address 127.0.0.1:57486)
0808 14:38:33.849212 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:33.849227 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:33.849296 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:33.849538 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:33.849541 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:33.849709 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:38:33.849821 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:33.849828 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:33.850791 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:33.850796 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:33.851620 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:33.851636 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:33.852410 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:33.852416 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:33.852518 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:33.853176 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:38:33.853192 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:38:33.855128 (+ 1936us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:38:33.857157 (+ 2029us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:33.857161 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:33.857162 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:33.857420 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:33.857742 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:33.857748 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:33.857751 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:33.857846 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:33.858326 (+ 480us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:38:33.858330 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:38:33.858432 (+ 102us) client_negotiation.cc:769] Sending connection context
0808 14:38:33.859326 (+ 894us) client_negotiation.cc:240] Negotiation successful
0808 14:38:33.859446 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":90}
I20260808 14:38:33.861506 14173 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 993f9f99e1934852b0fe23b11ca4cc88: Bootstrap starting.
I20260808 14:38:33.862139 14055 raft_consensus.cc:348] T 00000000000000000000000000000000 P f60375dbcdd9492f8c06d361eb430ed7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f60375dbcdd9492f8c06d361eb430ed7" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 43805 } } peers { permanent_uuid: "993f9f99e1934852b0fe23b11ca4cc88" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 46213 } } peers { permanent_uuid: "71be8d8285b6449fb924cf3d73c2c8a5" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 40445 } }
I20260808 14:38:33.862386 14055 raft_consensus.cc:729] T 00000000000000000000000000000000 P f60375dbcdd9492f8c06d361eb430ed7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f60375dbcdd9492f8c06d361eb430ed7, State: Initialized, Role: FOLLOWER
I20260808 14:38:33.862753 14055 consensus_queue.cc:260] T 00000000000000000000000000000000 P f60375dbcdd9492f8c06d361eb430ed7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f60375dbcdd9492f8c06d361eb430ed7" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 43805 } } peers { permanent_uuid: "993f9f99e1934852b0fe23b11ca4cc88" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 46213 } } peers { permanent_uuid: "71be8d8285b6449fb924cf3d73c2c8a5" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 40445 } }
I20260808 14:38:33.863406 14292 sys_catalog.cc:455] T 00000000000000000000000000000000 P f60375dbcdd9492f8c06d361eb430ed7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f60375dbcdd9492f8c06d361eb430ed7" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 43805 } } peers { permanent_uuid: "993f9f99e1934852b0fe23b11ca4cc88" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 46213 } } peers { permanent_uuid: "71be8d8285b6449fb924cf3d73c2c8a5" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 40445 } } }
I20260808 14:38:33.863582 14292 sys_catalog.cc:458] T 00000000000000000000000000000000 P f60375dbcdd9492f8c06d361eb430ed7 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:38:33.864234 14055 sys_catalog.cc:564] T 00000000000000000000000000000000 P f60375dbcdd9492f8c06d361eb430ed7 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:38:33.864380 14173 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 993f9f99e1934852b0fe23b11ca4cc88: Neither blocks nor log segments found. Creating new log.
I20260808 14:38:33.865314 14173 log.cc:824] T 00000000000000000000000000000000 P 993f9f99e1934852b0fe23b11ca4cc88: Log is configured to *not* fsync() on all Append() calls
I20260808 14:38:33.867496 14281 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.131.252" port: 40445 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:38:33.867764 14173 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 993f9f99e1934852b0fe23b11ca4cc88: No bootstrap required, opened a new log
W20260808 14:38:33.870337 14309 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f60375dbcdd9492f8c06d361eb430ed7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:38:33.870411 14309 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:38:33.872504 14173 raft_consensus.cc:348] T 00000000000000000000000000000000 P 993f9f99e1934852b0fe23b11ca4cc88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f60375dbcdd9492f8c06d361eb430ed7" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 43805 } } peers { permanent_uuid: "993f9f99e1934852b0fe23b11ca4cc88" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 46213 } } peers { permanent_uuid: "71be8d8285b6449fb924cf3d73c2c8a5" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 40445 } }
I20260808 14:38:33.872802 14173 raft_consensus.cc:729] T 00000000000000000000000000000000 P 993f9f99e1934852b0fe23b11ca4cc88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 993f9f99e1934852b0fe23b11ca4cc88, State: Initialized, Role: FOLLOWER
Aug 08 14:38:33 dist-test-slave-twwt krb5kdc[13928](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199913, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.252@KRBTEST.COM for kudu/127.11.131.252@KRBTEST.COM
I20260808 14:38:33.873199 14173 consensus_queue.cc:260] T 00000000000000000000000000000000 P 993f9f99e1934852b0fe23b11ca4cc88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f60375dbcdd9492f8c06d361eb430ed7" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 43805 } } peers { permanent_uuid: "993f9f99e1934852b0fe23b11ca4cc88" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 46213 } } peers { permanent_uuid: "71be8d8285b6449fb924cf3d73c2c8a5" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 40445 } }
I20260808 14:38:33.869956 13948 master_runner.cc:186] Error getting master registration for 127.11.131.253:46213: OK, instance_id { permanent_uuid: "993f9f99e1934852b0fe23b11ca4cc88" instance_seqno: 1786199913584901 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 14:38:33.874267 13948 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 14:38:33.874881 14173 sys_catalog.cc:564] T 00000000000000000000000000000000 P 993f9f99e1934852b0fe23b11ca4cc88 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:38:33.876807 14060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:33.851234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50560 (local address 127.11.131.254:43805)
0808 14:38:33.851359 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:33.851363 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:33.851378 (+ 15us) server_negotiation.cc:407] Connection header received
0808 14:38:33.851411 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:33.851413 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:33.851450 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:33.851522 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:33.852373 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:33.853128 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:33.854308 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:33.854785 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:33.854862 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:33.858345 (+ 3483us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:33.858551 (+ 206us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:33.858555 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:33.858582 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:33.871469 (+ 12887us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:33.875132 (+ 3663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:33.875136 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:33.875138 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:33.875243 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:33.875603 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:33.875607 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:33.875609 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:33.875868 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:33.876062 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:33.876485 (+ 423us) server_negotiation.cc:299] Negotiation successful
0808 14:38:33.876626 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 14:38:33.877503 14290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:33.868039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.252:40445 (local address 127.0.0.1:59350)
0808 14:38:33.868296 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:33.868310 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:33.868396 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:33.868708 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:33.868710 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:33.868895 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:38:33.868987 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:33.868994 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:33.869971 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:33.869974 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:33.870792 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:33.870804 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:33.871443 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:33.871447 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:33.871528 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:33.872046 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:38:33.872061 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:38:33.873688 (+ 1627us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:38:33.875846 (+ 2158us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:33.875853 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:33.875857 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:33.876127 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:33.876424 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:33.876427 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:33.876429 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:33.876506 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:33.876988 (+ 482us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:38:33.876991 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:38:33.877088 (+ 97us) client_negotiation.cc:769] Sending connection context
0808 14:38:33.877187 (+ 99us) client_negotiation.cc:240] Negotiation successful
0808 14:38:33.877341 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180}
I20260808 14:38:33.877982 14289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:33.868269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59350 (local address 127.11.131.252:40445)
0808 14:38:33.868365 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:33.868369 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:33.868382 (+ 13us) server_negotiation.cc:407] Connection header received
0808 14:38:33.868496 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:33.868499 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:33.868536 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:33.868594 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:33.869108 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:33.869847 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:33.870923 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:33.871236 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:33.871331 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:33.873857 (+ 2526us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:33.873861 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:33.873863 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:33.873885 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:33.875718 (+ 1833us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:33.876234 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:33.876237 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:33.876238 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:33.876327 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:33.876593 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:33.876596 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:33.876598 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:33.876842 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:33.876948 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:33.877786 (+ 838us) server_negotiation.cc:299] Negotiation successful
0808 14:38:33.877882 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 14:38:33.878952 14311 sys_catalog.cc:455] T 00000000000000000000000000000000 P 993f9f99e1934852b0fe23b11ca4cc88 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f60375dbcdd9492f8c06d361eb430ed7" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 43805 } } peers { permanent_uuid: "993f9f99e1934852b0fe23b11ca4cc88" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 46213 } } peers { permanent_uuid: "71be8d8285b6449fb924cf3d73c2c8a5" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 40445 } } }
I20260808 14:38:33.879172 14311 sys_catalog.cc:458] T 00000000000000000000000000000000 P 993f9f99e1934852b0fe23b11ca4cc88 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:38:33.881374 14281 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71be8d8285b6449fb924cf3d73c2c8a5: Bootstrap starting.
I20260808 14:38:33.884474 14281 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 71be8d8285b6449fb924cf3d73c2c8a5: Neither blocks nor log segments found. Creating new log.
I20260808 14:38:33.885439 14281 log.cc:824] T 00000000000000000000000000000000 P 71be8d8285b6449fb924cf3d73c2c8a5: Log is configured to *not* fsync() on all Append() calls
W20260808 14:38:33.886152 14325 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 993f9f99e1934852b0fe23b11ca4cc88: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:38:33.886263 14325 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:38:33.889374 14281 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71be8d8285b6449fb924cf3d73c2c8a5: No bootstrap required, opened a new log
I20260808 14:38:33.885485 14067 master_runner.cc:186] Error getting master registration for 127.11.131.252:40445: OK, instance_id { permanent_uuid: "71be8d8285b6449fb924cf3d73c2c8a5" instance_seqno: 1786199913819820 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 14:38:33.889679 14067 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 14:38:33.893853 14281 raft_consensus.cc:348] T 00000000000000000000000000000000 P 71be8d8285b6449fb924cf3d73c2c8a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f60375dbcdd9492f8c06d361eb430ed7" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 43805 } } peers { permanent_uuid: "993f9f99e1934852b0fe23b11ca4cc88" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 46213 } } peers { permanent_uuid: "71be8d8285b6449fb924cf3d73c2c8a5" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 40445 } }
I20260808 14:38:33.894143 14281 raft_consensus.cc:729] T 00000000000000000000000000000000 P 71be8d8285b6449fb924cf3d73c2c8a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71be8d8285b6449fb924cf3d73c2c8a5, State: Initialized, Role: FOLLOWER
I20260808 14:38:33.894538 14281 consensus_queue.cc:260] T 00000000000000000000000000000000 P 71be8d8285b6449fb924cf3d73c2c8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f60375dbcdd9492f8c06d361eb430ed7" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 43805 } } peers { permanent_uuid: "993f9f99e1934852b0fe23b11ca4cc88" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 46213 } } peers { permanent_uuid: "71be8d8285b6449fb924cf3d73c2c8a5" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 40445 } }
I20260808 14:38:33.896148 14281 sys_catalog.cc:564] T 00000000000000000000000000000000 P 71be8d8285b6449fb924cf3d73c2c8a5 [sys.catalog]: configured and running, proceeding with master startup.
Aug 08 14:38:33 dist-test-slave-twwt krb5kdc[13928](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199913, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.131.253@KRBTEST.COM
I20260808 14:38:33.902361 14181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:33.880442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57492 (local address 127.11.131.253:46213)
0808 14:38:33.880633 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:33.880638 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:33.880650 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:38:33.880687 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:33.880690 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:33.880756 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:33.880840 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:33.881816 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:33.882600 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:33.889795 (+ 7195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:33.890338 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:33.890479 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:33.897192 (+ 6713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:33.897196 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:33.897200 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:33.897235 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:33.899175 (+ 1940us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:33.900124 (+ 949us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:33.900128 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:33.900130 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:33.900218 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:33.900536 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:33.900540 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:33.900541 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:33.900802 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:33.901007 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:33.902049 (+ 1042us) server_negotiation.cc:299] Negotiation successful
0808 14:38:33.902173 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120}
I20260808 14:38:33.905866 11791 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:38:33.907727 14185 master_runner.cc:263] No leader master found from master 71be8d8285b6449fb924cf3d73c2c8a5
I20260808 14:38:33.907817 14185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 14:38:33.908242 14016 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "f60375dbcdd9492f8c06d361eb430ed7"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50560
I20260808 14:38:33.908581 14016 raft_consensus.cc:482] T 00000000000000000000000000000000 P f60375dbcdd9492f8c06d361eb430ed7 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 14:38:33.908723 14016 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f60375dbcdd9492f8c06d361eb430ed7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:38:33.910220 14016 raft_consensus.cc:504] T 00000000000000000000000000000000 P f60375dbcdd9492f8c06d361eb430ed7 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f60375dbcdd9492f8c06d361eb430ed7" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 43805 } } peers { permanent_uuid: "993f9f99e1934852b0fe23b11ca4cc88" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 46213 } } peers { permanent_uuid: "71be8d8285b6449fb924cf3d73c2c8a5" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 40445 } }
W20260808 14:38:33.910837 14348 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 71be8d8285b6449fb924cf3d73c2c8a5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:38:33.910960 14348 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:38:33.911311 14016 leader_election.cc:288] T 00000000000000000000000000000000 P f60375dbcdd9492f8c06d361eb430ed7 [CANDIDATE]: Term 1 election: Requested vote from peers 993f9f99e1934852b0fe23b11ca4cc88 (127.11.131.253:46213), 71be8d8285b6449fb924cf3d73c2c8a5 (127.11.131.252:40445)
I20260808 14:38:33.911834 14135 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f60375dbcdd9492f8c06d361eb430ed7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "993f9f99e1934852b0fe23b11ca4cc88"
I20260808 14:38:33.912000 14239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f60375dbcdd9492f8c06d361eb430ed7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "71be8d8285b6449fb924cf3d73c2c8a5"
I20260808 14:38:33.912101 14135 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 993f9f99e1934852b0fe23b11ca4cc88 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:38:33.912223 14239 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 71be8d8285b6449fb924cf3d73c2c8a5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:38:33.913573 14239 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 71be8d8285b6449fb924cf3d73c2c8a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f60375dbcdd9492f8c06d361eb430ed7 in term 1.
I20260808 14:38:33.913655 14135 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 993f9f99e1934852b0fe23b11ca4cc88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f60375dbcdd9492f8c06d361eb430ed7 in term 1.
I20260808 14:38:33.914129 13978 leader_election.cc:302] T 00000000000000000000000000000000 P f60375dbcdd9492f8c06d361eb430ed7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71be8d8285b6449fb924cf3d73c2c8a5, f60375dbcdd9492f8c06d361eb430ed7; no voters:
I20260808 14:38:33.914222 14333 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71be8d8285b6449fb924cf3d73c2c8a5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f60375dbcdd9492f8c06d361eb430ed7" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 43805 } } peers { permanent_uuid: "993f9f99e1934852b0fe23b11ca4cc88" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 46213 } } peers { permanent_uuid: "71be8d8285b6449fb924cf3d73c2c8a5" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 40445 } } }
I20260808 14:38:33.914337 14333 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71be8d8285b6449fb924cf3d73c2c8a5 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:38:33.914634 14292 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f60375dbcdd9492f8c06d361eb430ed7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:38:33.914855 14292 raft_consensus.cc:686] T 00000000000000000000000000000000 P f60375dbcdd9492f8c06d361eb430ed7 [term 1 LEADER]: Becoming Leader. State: Replica: f60375dbcdd9492f8c06d361eb430ed7, State: Running, Role: LEADER
I20260808 14:38:33.915186 14292 consensus_queue.cc:237] T 00000000000000000000000000000000 P f60375dbcdd9492f8c06d361eb430ed7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f60375dbcdd9492f8c06d361eb430ed7" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 43805 } } peers { permanent_uuid: "993f9f99e1934852b0fe23b11ca4cc88" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 46213 } } peers { permanent_uuid: "71be8d8285b6449fb924cf3d73c2c8a5" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 40445 } }
I20260808 14:38:33.917068 14292 sys_catalog.cc:455] T 00000000000000000000000000000000 P f60375dbcdd9492f8c06d361eb430ed7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f60375dbcdd9492f8c06d361eb430ed7. Latest consensus state: current_term: 1 leader_uuid: "f60375dbcdd9492f8c06d361eb430ed7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f60375dbcdd9492f8c06d361eb430ed7" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 43805 } } peers { permanent_uuid: "993f9f99e1934852b0fe23b11ca4cc88" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 46213 } } peers { permanent_uuid: "71be8d8285b6449fb924cf3d73c2c8a5" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 40445 } } }
I20260808 14:38:33.917176 14292 sys_catalog.cc:458] T 00000000000000000000000000000000 P f60375dbcdd9492f8c06d361eb430ed7 [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:33.917946 14362 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:38:33.919042 14362 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 14:38:33.926805 14239 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 71be8d8285b6449fb924cf3d73c2c8a5 [term 1 FOLLOWER]: Refusing update from remote peer f60375dbcdd9492f8c06d361eb430ed7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:38:33.927632 14292 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f60375dbcdd9492f8c06d361eb430ed7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71be8d8285b6449fb924cf3d73c2c8a5" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 40445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:38:33.931794 14333 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71be8d8285b6449fb924cf3d73c2c8a5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f60375dbcdd9492f8c06d361eb430ed7. Latest consensus state: current_term: 1 leader_uuid: "f60375dbcdd9492f8c06d361eb430ed7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f60375dbcdd9492f8c06d361eb430ed7" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 43805 } } peers { permanent_uuid: "993f9f99e1934852b0fe23b11ca4cc88" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 46213 } } peers { permanent_uuid: "71be8d8285b6449fb924cf3d73c2c8a5" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 40445 } } }
I20260808 14:38:33.931919 14333 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71be8d8285b6449fb924cf3d73c2c8a5 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:38:33.933023 14135 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 993f9f99e1934852b0fe23b11ca4cc88 [term 1 FOLLOWER]: Refusing update from remote peer f60375dbcdd9492f8c06d361eb430ed7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:38:33.933686 14292 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f60375dbcdd9492f8c06d361eb430ed7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "993f9f99e1934852b0fe23b11ca4cc88" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 46213 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:38:33.937680 14311 sys_catalog.cc:455] T 00000000000000000000000000000000 P 993f9f99e1934852b0fe23b11ca4cc88 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f60375dbcdd9492f8c06d361eb430ed7. Latest consensus state: current_term: 1 leader_uuid: "f60375dbcdd9492f8c06d361eb430ed7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f60375dbcdd9492f8c06d361eb430ed7" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 43805 } } peers { permanent_uuid: "993f9f99e1934852b0fe23b11ca4cc88" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 46213 } } peers { permanent_uuid: "71be8d8285b6449fb924cf3d73c2c8a5" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 40445 } } }
I20260808 14:38:33.937811 14311 sys_catalog.cc:458] T 00000000000000000000000000000000 P 993f9f99e1934852b0fe23b11ca4cc88 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:38:33.944173 14292 sys_catalog.cc:455] T 00000000000000000000000000000000 P f60375dbcdd9492f8c06d361eb430ed7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f60375dbcdd9492f8c06d361eb430ed7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f60375dbcdd9492f8c06d361eb430ed7" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 43805 } } peers { permanent_uuid: "993f9f99e1934852b0fe23b11ca4cc88" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 46213 } } peers { permanent_uuid: "71be8d8285b6449fb924cf3d73c2c8a5" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 40445 } } }
I20260808 14:38:33.944327 14292 sys_catalog.cc:458] T 00000000000000000000000000000000 P f60375dbcdd9492f8c06d361eb430ed7 [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:33.944434 14311 sys_catalog.cc:455] T 00000000000000000000000000000000 P 993f9f99e1934852b0fe23b11ca4cc88 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f60375dbcdd9492f8c06d361eb430ed7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f60375dbcdd9492f8c06d361eb430ed7" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 43805 } } peers { permanent_uuid: "993f9f99e1934852b0fe23b11ca4cc88" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 46213 } } peers { permanent_uuid: "71be8d8285b6449fb924cf3d73c2c8a5" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 40445 } } }
I20260808 14:38:33.944550 14311 sys_catalog.cc:458] T 00000000000000000000000000000000 P 993f9f99e1934852b0fe23b11ca4cc88 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:38:33.947113 14369 mvcc.cc:205] Tried to move back new op lower bound from 7316274847435898880 to 7316274847400189952. Current Snapshot: MvccSnapshot[applied={T|T < 7316274847435898880}]
I20260808 14:38:33.948058 14292 sys_catalog.cc:455] T 00000000000000000000000000000000 P f60375dbcdd9492f8c06d361eb430ed7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f60375dbcdd9492f8c06d361eb430ed7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f60375dbcdd9492f8c06d361eb430ed7" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 43805 } } peers { permanent_uuid: "993f9f99e1934852b0fe23b11ca4cc88" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 46213 } } peers { permanent_uuid: "71be8d8285b6449fb924cf3d73c2c8a5" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 40445 } } }
I20260808 14:38:33.948175 14292 sys_catalog.cc:458] T 00000000000000000000000000000000 P f60375dbcdd9492f8c06d361eb430ed7 [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:33.949586 14333 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71be8d8285b6449fb924cf3d73c2c8a5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f60375dbcdd9492f8c06d361eb430ed7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f60375dbcdd9492f8c06d361eb430ed7" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 43805 } } peers { permanent_uuid: "993f9f99e1934852b0fe23b11ca4cc88" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 46213 } } peers { permanent_uuid: "71be8d8285b6449fb924cf3d73c2c8a5" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 40445 } } }
I20260808 14:38:33.949712 14333 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71be8d8285b6449fb924cf3d73c2c8a5 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:38:33.948626 14181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:33.915587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57500 (local address 127.11.131.253:46213)
0808 14:38:33.915707 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:33.915711 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:33.922926 (+ 7215us) server_negotiation.cc:407] Connection header received
0808 14:38:33.923153 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:33.923157 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:33.923230 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:33.923289 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:33.924657 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:33.925550 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:33.930325 (+ 4775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:33.930696 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:33.930782 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:33.939952 (+ 9170us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:33.939956 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:33.939960 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:33.939992 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:33.941731 (+ 1739us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:33.942289 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:33.942293 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:33.942295 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:33.942385 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:33.944481 (+ 2096us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:33.944485 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:33.944487 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:33.944730 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:33.944849 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:33.948331 (+ 3482us) server_negotiation.cc:299] Negotiation successful
0808 14:38:33.948466 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 14:38:33.951887 14366 mvcc.cc:205] Tried to move back new op lower bound from 7316274847435898880 to 7316274847400189952. Current Snapshot: MvccSnapshot[applied={T|T < 7316274847435898880}]
I20260808 14:38:33.956941 14060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:33.917411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50572 (local address 127.11.131.254:43805)
0808 14:38:33.917538 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:33.917542 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:33.924576 (+ 7034us) server_negotiation.cc:407] Connection header received
0808 14:38:33.926722 (+ 2146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:33.926727 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:33.926798 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:33.926857 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:33.928298 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:33.929107 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:33.935790 (+ 6683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:33.936145 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:33.936228 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:33.945215 (+ 8987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:33.945220 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:33.945223 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:33.945253 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:33.947095 (+ 1842us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:33.954718 (+ 7623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:33.954723 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:33.954725 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:33.954846 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:33.955850 (+ 1004us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:33.955854 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:33.955856 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:33.956107 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:33.956275 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:33.956639 (+ 364us) server_negotiation.cc:299] Negotiation successful
0808 14:38:33.956780 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 14:38:33.960788 14289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:33.915055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59364 (local address 127.11.131.252:40445)
0808 14:38:33.915184 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:33.915188 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:33.931722 (+ 16534us) server_negotiation.cc:407] Connection header received
0808 14:38:33.934844 (+ 3122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:33.934847 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:33.934900 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:33.934950 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:33.937960 (+ 3010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:33.938773 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:33.947660 (+ 8887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:33.948034 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:33.948113 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:33.956978 (+ 8865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:33.956982 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:33.956985 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:33.957017 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:33.958834 (+ 1817us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:33.959341 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:33.959346 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:33.959348 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:33.959434 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:33.959755 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:33.959759 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:33.959761 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:33.959974 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:33.960093 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:33.960472 (+ 379us) server_negotiation.cc:299] Negotiation successful
0808 14:38:33.960596 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 14:38:33.963232 14362 catalog_manager.cc:1347] Generated new cluster ID: 04f94e09731f4f54af5cb720f767dbd1
I20260808 14:38:33.963297 14362 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:38:34.014739 14362 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:38:34.016170 14362 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:38:34.041972 14362 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f60375dbcdd9492f8c06d361eb430ed7: Generated new TSK 0
I20260808 14:38:34.043066 14362 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 14:38:34.084324 14060 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:38:34.078962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50578 (local address 127.11.131.254:43805)
0808 14:38:34.079097 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:34.079102 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:34.082588 (+ 3486us) server_negotiation.cc:407] Connection header received
0808 14:38:34.083016 (+ 428us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:34.083021 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:34.083082 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:34.083140 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:34.084152 (+ 1012us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50578: BlockingRecv error: recv got EOF from 127.0.0.1:50578 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260808 14:38:34.085338 14289 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:38:34.079451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59368 (local address 127.11.131.252:40445)
0808 14:38:34.079566 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:34.079570 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:34.082308 (+ 2738us) server_negotiation.cc:407] Connection header received
0808 14:38:34.083321 (+ 1013us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:34.083325 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:34.083382 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:34.083435 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:34.085207 (+ 1772us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59368: BlockingRecv error: recv got EOF from 127.0.0.1:59368 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260808 14:38:34.087049 14181 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:38:34.080629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57516 (local address 127.11.131.253:46213)
0808 14:38:34.080751 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:34.080755 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:34.085984 (+ 5229us) server_negotiation.cc:407] Connection header received
0808 14:38:34.086335 (+ 351us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:34.086339 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:34.086390 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:34.086440 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:34.086929 (+ 489us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57516: BlockingRecv error: recv got EOF from 127.0.0.1:57516 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260808 14:38:34.091759 14181 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:38:34.090273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57528 (local address 127.11.131.253:46213)
0808 14:38:34.090381 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:34.090385 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:34.090828 (+ 443us) server_negotiation.cc:407] Connection header received
0808 14:38:34.091034 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:34.091038 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:34.091111 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:34.091162 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:34.091656 (+ 494us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57528: BlockingRecv error: recv got EOF from 127.0.0.1:57528 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
W20260808 14:38:34.097517 14181 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:38:34.095681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57532 (local address 127.11.131.253:46213)
0808 14:38:34.095790 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:34.095794 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:34.096301 (+ 507us) server_negotiation.cc:407] Connection header received
0808 14:38:34.096563 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:34.096566 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:34.096640 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:34.096697 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:34.097401 (+ 704us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57532: BlockingRecv error: recv got EOF from 127.0.0.1:57532 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260808 14:38:34.102751 14181 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:38:34.101528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57536 (local address 127.11.131.253:46213)
0808 14:38:34.101642 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:34.101646 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:34.101883 (+ 237us) server_negotiation.cc:407] Connection header received
0808 14:38:34.102047 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:34.102052 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:34.102101 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:34.102192 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:34.102633 (+ 441us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57536: BlockingRecv error: recv got EOF from 127.0.0.1:57536 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260808 14:38:34.109611 14181 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:38:34.108359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57550 (local address 127.11.131.253:46213)
0808 14:38:34.108528 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:34.108533 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:34.108739 (+ 206us) server_negotiation.cc:407] Connection header received
0808 14:38:34.108883 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:34.108887 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:34.108937 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:34.109029 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:34.109485 (+ 456us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57550: BlockingRecv error: recv got EOF from 127.0.0.1:57550 (error 108)
Metrics: {"server-negotiator.queue_time_us":91}
W20260808 14:38:34.121171 14181 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:38:34.119782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57566 (local address 127.11.131.253:46213)
0808 14:38:34.119934 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:34.119939 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:34.120201 (+ 262us) server_negotiation.cc:407] Connection header received
0808 14:38:34.120384 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:34.120393 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:34.120444 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:34.120538 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:34.121042 (+ 504us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57566: BlockingRecv error: recv got EOF from 127.0.0.1:57566 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
W20260808 14:38:34.140901 14181 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:38:34.139721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57568 (local address 127.11.131.253:46213)
0808 14:38:34.139873 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:34.139878 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:34.140033 (+ 155us) server_negotiation.cc:407] Connection header received
0808 14:38:34.140144 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:34.140147 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:34.140216 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:34.140318 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:34.140775 (+ 457us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57568: BlockingRecv error: recv got EOF from 127.0.0.1:57568 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
W20260808 14:38:34.176657 14181 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:38:34.175297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57584 (local address 127.11.131.253:46213)
0808 14:38:34.175470 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:34.175477 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:34.175650 (+ 173us) server_negotiation.cc:407] Connection header received
0808 14:38:34.175844 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:34.175847 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:34.175897 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:34.175972 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:34.176495 (+ 523us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57584: BlockingRecv error: recv got EOF from 127.0.0.1:57584 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
W20260808 14:38:34.244604 14181 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:38:34.243091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57594 (local address 127.11.131.253:46213)
0808 14:38:34.243345 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:34.243351 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:34.243372 (+ 21us) server_negotiation.cc:407] Connection header received
0808 14:38:34.243599 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:34.243603 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:34.243662 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:34.243802 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:34.244446 (+ 644us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57594: BlockingRecv error: recv got EOF from 127.0.0.1:57594 (error 108)
Metrics: {"server-negotiator.queue_time_us":136}
W20260808 14:38:34.376272 14181 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:38:34.374960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57602 (local address 127.11.131.253:46213)
0808 14:38:34.375137 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:34.375146 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:34.375292 (+ 146us) server_negotiation.cc:407] Connection header received
0808 14:38:34.375419 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:34.375422 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:34.375478 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:34.375561 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:34.376117 (+ 556us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57602: BlockingRecv error: recv got EOF from 127.0.0.1:57602 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
W20260808 14:38:34.636018 14181 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:38:34.634723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57612 (local address 127.11.131.253:46213)
0808 14:38:34.634927 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:34.634931 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:34.634977 (+ 46us) server_negotiation.cc:407] Connection header received
0808 14:38:34.635188 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:34.635191 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:34.635246 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:34.635336 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:34.635881 (+ 545us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57612: BlockingRecv error: recv got EOF from 127.0.0.1:57612 (error 108)
Metrics: {"server-negotiator.queue_time_us":99}
I20260808 14:38:34.887743 14325 catalog_manager.cc:1259] Loaded cluster ID: 04f94e09731f4f54af5cb720f767dbd1
I20260808 14:38:34.887825 14325 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 993f9f99e1934852b0fe23b11ca4cc88: loading cluster ID for follower catalog manager: success
I20260808 14:38:34.889616 14325 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 993f9f99e1934852b0fe23b11ca4cc88: acquiring CA information for follower catalog manager: success
I20260808 14:38:34.890908 14325 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 993f9f99e1934852b0fe23b11ca4cc88: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 14:38:34.912348 14348 catalog_manager.cc:1259] Loaded cluster ID: 04f94e09731f4f54af5cb720f767dbd1
I20260808 14:38:34.912465 14348 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 71be8d8285b6449fb924cf3d73c2c8a5: loading cluster ID for follower catalog manager: success
I20260808 14:38:34.914218 14348 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 71be8d8285b6449fb924cf3d73c2c8a5: acquiring CA information for follower catalog manager: success
I20260808 14:38:34.915475 14348 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 71be8d8285b6449fb924cf3d73c2c8a5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 14:38:35.154572 14482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:35.150401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57614 (local address 127.11.131.253:46213)
0808 14:38:35.150723 (+ 322us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:35.150729 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:35.150748 (+ 19us) server_negotiation.cc:407] Connection header received
0808 14:38:35.150921 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:35.150925 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:35.151070 (+ 145us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:35.151202 (+ 132us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:38:35.151479 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:35.152028 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:35.152957 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:35.153200 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:35.153321 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:35.153678 (+ 357us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:38:35.154135 (+ 457us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:38:35.154289 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:35.154334 (+ 45us) server_negotiation.cc:299] Negotiation successful
0808 14:38:35.154393 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":220,"thread_start_us":96,"threads_started":1}
I20260808 14:38:35.161646 14492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:35.157866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59370 (local address 127.11.131.252:40445)
0808 14:38:35.158089 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:35.158093 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:35.158105 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:38:35.158196 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:35.158199 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:35.158320 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:35.158432 (+ 112us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:38:35.158733 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:35.159273 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:35.160172 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:35.160423 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:35.160528 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:35.160799 (+ 271us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:38:35.161263 (+ 464us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:38:35.161359 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:35.161421 (+ 62us) server_negotiation.cc:299] Negotiation successful
0808 14:38:35.161478 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":76,"threads_started":1}
I20260808 14:38:35.169301 14482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:35.165058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57620 (local address 127.11.131.253:46213)
0808 14:38:35.165196 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:35.165201 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:35.165871 (+ 670us) server_negotiation.cc:407] Connection header received
0808 14:38:35.165993 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:35.165996 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:35.166084 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:35.166153 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:38:35.166570 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:35.167145 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:35.168197 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:35.168443 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:35.168558 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:35.168827 (+ 269us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:38:35.168908 (+ 81us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:38:35.168987 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:35.169079 (+ 92us) server_negotiation.cc:299] Negotiation successful
0808 14:38:35.169134 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 14:38:35.169991 14492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:35.165123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59380 (local address 127.11.131.252:40445)
0808 14:38:35.165538 (+ 415us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:35.165543 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:35.165563 (+ 20us) server_negotiation.cc:407] Connection header received
0808 14:38:35.165708 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:35.165711 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:35.165766 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:35.165876 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:38:35.166231 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:35.167099 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:35.168661 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:35.169004 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:35.169118 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:35.169511 (+ 393us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:38:35.169593 (+ 82us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:38:35.169668 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:35.169809 (+ 141us) server_negotiation.cc:299] Negotiation successful
0808 14:38:35.169866 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":332}
I20260808 14:38:35.170732 14500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:35.165021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50588 (local address 127.11.131.254:43805)
0808 14:38:35.165326 (+ 305us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:35.165331 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:35.165504 (+ 173us) server_negotiation.cc:407] Connection header received
0808 14:38:35.165756 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:35.165760 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:35.165942 (+ 182us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:35.166072 (+ 130us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:38:35.166350 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:35.167179 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:35.168661 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:35.169019 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:35.169478 (+ 459us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:35.169632 (+ 154us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:38:35.170056 (+ 424us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:38:35.170441 (+ 385us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:35.170479 (+ 38us) server_negotiation.cc:299] Negotiation successful
0808 14:38:35.170541 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":224,"thread_start_us":97,"threads_started":1}
I20260808 14:38:35.174185 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 13948
I20260808 14:38:35.188146 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 14067
I20260808 14:38:35.205595 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 14185
2026-08-08T14:38:35Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3464 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 14:38:35 dist-test-slave-twwt krb5kdc[14517](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 14:38:35 dist-test-slave-twwt krb5kdc[14517](info): set up 2 sockets
Aug 08 14:38:35 dist-test-slave-twwt krb5kdc[14517](info): commencing operation
krb5kdc: starting...
W20260808 14:38:36.542939 11791 mini_kdc.cc:121] Time spent starting KDC: real 1.306s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/krb5kdc/test-user.keytab.
Aug 08 14:38:36 dist-test-slave-twwt krb5kdc[14517](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199916, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T14:38:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T14:38:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.131.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
Entry for principal kudu/127.11.131.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab.
I20260808 14:38:36.678086 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:38159
--webserver_interface=127.11.131.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:45871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:38159,127.11.131.253:34827,127.11.131.252:37429
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 14:38:36.811595 14533 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 14:38:36.811894 14533 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:36.811919 14533 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:36.811960 14533 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:36.816033 14533 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:38:36.816092 14533 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:36.816111 14533 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:36.816164 14533 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:38:36.816197 14533 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:38:36.821482 14533 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:45871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:38159,127.11.131.253:34827,127.11.131.252:37429
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.254.keytab
--principal=kudu/127.11.131.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.254:38159
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.131.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14533
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:38:36.822780 14533 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:36.823863 14533 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:36.832839 14547 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:36.832813 14550 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:36.832840 14544 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:36.833088 14533 server_base.cc:1034] running on GCE node
I20260808 14:38:36.833742 14533 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:36.834977 14533 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:36.836156 14533 hybrid_clock.cc:648] HybridClock initialized: now 1786199916836148 us; error 36 us; skew 500 ppm
Aug 08 14:38:36 dist-test-slave-twwt krb5kdc[14517](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199916, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:36.839152 14533 init.cc:377] Logged in from keytab as kudu/127.11.131.254@KRBTEST.COM (short username kudu)
I20260808 14:38:36.840096 14533 webserver.cc:460] Webserver started at http://127.11.131.254:36195/ using document root <none> and password file <none>
I20260808 14:38:36.840706 14533 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:36.840806 14533 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:36.841054 14533 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:38:36.843266 14533 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/minicluster-data/master-0/data/instance:
uuid: "55183e944f854053ba167527c60d3fd1"
format_stamp: "Formatted at 2026-08-08 14:38:36 on dist-test-slave-twwt"
server_key: "67af43bbef95c4f0573286e840e5b0fc"
server_key_iv: "7211285290decc35c780bceee2d92e8f"
server_key_version: "encryptionkey@0"
I20260808 14:38:36.843871 14533 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/minicluster-data/master-0/wal/instance:
uuid: "55183e944f854053ba167527c60d3fd1"
format_stamp: "Formatted at 2026-08-08 14:38:36 on dist-test-slave-twwt"
server_key: "67af43bbef95c4f0573286e840e5b0fc"
server_key_iv: "7211285290decc35c780bceee2d92e8f"
server_key_version: "encryptionkey@0"
I20260808 14:38:36.847687 14533 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 14:38:36.850167 14557 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:36.851516 14533 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 14:38:36.851658 14533 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/minicluster-data/master-0/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/minicluster-data/master-0/wal
uuid: "55183e944f854053ba167527c60d3fd1"
format_stamp: "Formatted at 2026-08-08 14:38:36 on dist-test-slave-twwt"
server_key: "67af43bbef95c4f0573286e840e5b0fc"
server_key_iv: "7211285290decc35c780bceee2d92e8f"
server_key_version: "encryptionkey@0"
I20260808 14:38:36.851773 14533 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:36.862151 14533 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:36.865103 14533 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:36.865319 14533 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:36.872668 14533 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.254:38159
I20260808 14:38:36.873011 14643 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.254:38159 every 8 connection(s)
I20260808 14:38:36.873726 14533 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/minicluster-data/master-0/data/info.pb
I20260808 14:38:36.875157 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 14533
I20260808 14:38:36.875283 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/minicluster-data/master-0/wal/instance
I20260808 14:38:36.875640 11791 external_mini_cluster.cc:1428] Setting key 4d856991c5bfeeda7d18acc26acf9ad6
I20260808 14:38:36.877404 14644 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:38:36.881525 14644 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38159 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.11.131.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.253@KRBTEST.COM" created.
Aug 08 14:38:36 dist-test-slave-twwt krb5kdc[14517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199916, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:38:36.898324 14649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:36.884027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:38159 (local address 127.0.0.1:51056)
0808 14:38:36.884637 (+ 610us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:36.884674 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:36.885593 (+ 919us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:36.886305 (+ 712us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:36.886311 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:36.886781 (+ 470us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:38:36.887034 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:36.887048 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:36.888277 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:36.888279 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:36.889461 (+ 1182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:36.889476 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:36.890194 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:36.890198 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:36.890292 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:36.890986 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:38:36.891004 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:38:36.892544 (+ 1540us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:38:36.895188 (+ 2644us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:36.895198 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:36.895207 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:36.895455 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:36.895870 (+ 415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:36.895872 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:36.895873 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:36.895985 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:36.896818 (+ 833us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:38:36.896823 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:38:36.896966 (+ 143us) client_negotiation.cc:769] Sending connection context
0808 14:38:36.897111 (+ 145us) client_negotiation.cc:240] Negotiation successful
0808 14:38:36.897397 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":440,"spinlock_wait_cycles":3840,"thread_start_us":195,"threads_started":1}
I20260808 14:38:36.898329 14648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:36.884026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51056 (local address 127.11.131.254:38159)
0808 14:38:36.884492 (+ 466us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:36.884511 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:36.884781 (+ 270us) server_negotiation.cc:407] Connection header received
0808 14:38:36.885918 (+ 1137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:36.885923 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:36.886115 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:36.886307 (+ 192us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:36.887190 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:36.888090 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:36.889607 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:36.890009 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:36.890206 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:36.892730 (+ 2524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:36.892741 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:36.892759 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:36.892793 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:36.895065 (+ 2272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:36.895580 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:36.895590 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:36.895594 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:36.895748 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:36.896085 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:36.896089 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:36.896090 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:36.896685 (+ 595us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:36.896838 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:36.897244 (+ 406us) server_negotiation.cc:299] Negotiation successful
0808 14:38:36.897523 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":36,"server-negotiator.queue_time_us":299,"thread_start_us":147,"threads_started":1}
I20260808 14:38:36.900962 14644 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.131.253" port: 34827 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:38:36.901759 14649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:36.901494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.253:34827 (local address 127.0.0.1:38426)
0808 14:38:36.901619 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:36.901693 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.253:34827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260808 14:38:36.901968 14562 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.131.253:34827: connect: Connection refused (error 111)
I20260808 14:38:36.903288 14649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:36.902993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.253:34827 (local address 127.0.0.1:38438)
0808 14:38:36.903125 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:36.903205 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.253:34827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260808 14:38:36.903913 14644 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.131.253:34827: Network error: Client connection negotiation failed: client connection to 127.11.131.253:34827: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.253.keytab.
Entry for principal kudu/127.11.131.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.253.keytab.
I20260808 14:38:36.908006 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.253:34827
--webserver_interface=127.11.131.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.253.keytab
--principal=kudu/127.11.131.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:45871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:38159,127.11.131.253:34827,127.11.131.252:37429
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:38:36.953233 14644 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.131.253" port: 34827 } attempt: 1
I20260808 14:38:36.954217 14649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:36.953901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.253:34827 (local address 127.0.0.1:38448)
0808 14:38:36.954071 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:36.954137 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.253:34827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260808 14:38:36.955055 14649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:36.954817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.253:34827 (local address 127.0.0.1:38458)
0808 14:38:36.954941 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:36.954996 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.253:34827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260808 14:38:36.955230 14644 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.131.253:34827: Network error: Client connection negotiation failed: client connection to 127.11.131.253:34827: connect: Connection refused (error 111)
I20260808 14:38:37.023443 14644 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.131.253" port: 34827 } attempt: 2
I20260808 14:38:37.024430 14649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:37.024059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.253:34827 (local address 127.0.0.1:38470)
0808 14:38:37.024245 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:37.024324 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.253:34827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260808 14:38:37.025238 14649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:37.025003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.253:34827 (local address 127.0.0.1:38476)
0808 14:38:37.025114 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:37.025169 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.253:34827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260808 14:38:37.025406 14644 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.131.253:34827: Network error: Client connection negotiation failed: client connection to 127.11.131.253:34827: connect: Connection refused (error 111)
W20260808 14:38:37.025525 14653 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 14:38:37.025853 14653 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:37.025898 14653 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:37.025992 14653 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 14:38:37.030319 14653 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:38:37.030375 14653 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:37.030395 14653 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:37.030453 14653 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:38:37.030479 14653 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:38:37.035969 14653 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:45871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:38159,127.11.131.253:34827,127.11.131.252:37429
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.253.keytab
--principal=kudu/127.11.131.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.253:34827
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.131.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14653
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:38:37.037081 14653 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:37.038159 14653 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 14:38:37.047169 14663 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:37.047180 14660 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:37.047188 14659 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:37.047540 14653 server_base.cc:1034] running on GCE node
I20260808 14:38:37.048136 14653 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:37.049288 14653 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:37.050486 14653 hybrid_clock.cc:648] HybridClock initialized: now 1786199917050462 us; error 34 us; skew 500 ppm
Aug 08 14:38:37 dist-test-slave-twwt krb5kdc[14517](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199917, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:37.053366 14653 init.cc:377] Logged in from keytab as kudu/127.11.131.253@KRBTEST.COM (short username kudu)
I20260808 14:38:37.054240 14653 webserver.cc:460] Webserver started at http://127.11.131.253:33637/ using document root <none> and password file <none>
I20260808 14:38:37.054967 14653 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:37.055061 14653 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:37.055282 14653 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:38:37.057468 14653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/minicluster-data/master-1/data/instance:
uuid: "e67a4b753a784a7ebb0ef34782e12d7a"
format_stamp: "Formatted at 2026-08-08 14:38:37 on dist-test-slave-twwt"
server_key: "7fab41baf5c177552c3e941e59f7410d"
server_key_iv: "531e4a3fb58303c31ca734c1c1223d6e"
server_key_version: "encryptionkey@0"
I20260808 14:38:37.058058 14653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/minicluster-data/master-1/wal/instance:
uuid: "e67a4b753a784a7ebb0ef34782e12d7a"
format_stamp: "Formatted at 2026-08-08 14:38:37 on dist-test-slave-twwt"
server_key: "7fab41baf5c177552c3e941e59f7410d"
server_key_iv: "531e4a3fb58303c31ca734c1c1223d6e"
server_key_version: "encryptionkey@0"
I20260808 14:38:37.061926 14653 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 14:38:37.064522 14674 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:37.065793 14653 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 14:38:37.065955 14653 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/minicluster-data/master-1/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/minicluster-data/master-1/wal
uuid: "e67a4b753a784a7ebb0ef34782e12d7a"
format_stamp: "Formatted at 2026-08-08 14:38:37 on dist-test-slave-twwt"
server_key: "7fab41baf5c177552c3e941e59f7410d"
server_key_iv: "531e4a3fb58303c31ca734c1c1223d6e"
server_key_version: "encryptionkey@0"
I20260808 14:38:37.066072 14653 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:37.090849 14653 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:37.093998 14653 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:37.094213 14653 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:37.101636 14653 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.253:34827
I20260808 14:38:37.101948 14760 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.253:34827 every 8 connection(s)
I20260808 14:38:37.102730 14653 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/minicluster-data/master-1/data/info.pb
I20260808 14:38:37.105520 14762 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:38:37.105867 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 14653
I20260808 14:38:37.106014 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/minicluster-data/master-1/wal/instance
I20260808 14:38:37.106308 11791 external_mini_cluster.cc:1428] Setting key 55816b90dfeb5d7f0614be3473dd6b27
I20260808 14:38:37.109531 14762 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38159 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.11.131.252@KRBTEST.COM; defaulting to no policy
I20260808 14:38:37.116590 14644 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.131.253" port: 34827 } attempt: 3
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.131.252@KRBTEST.COM" created.
Aug 08 14:38:37 dist-test-slave-twwt krb5kdc[14517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199917, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.253@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
Aug 08 14:38:37 dist-test-slave-twwt krb5kdc[14517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199916, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for kudu/127.11.131.253@KRBTEST.COM
I20260808 14:38:37.125918 14648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:37.111670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51072 (local address 127.11.131.254:38159)
0808 14:38:37.111825 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:37.111829 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:37.112921 (+ 1092us) server_negotiation.cc:407] Connection header received
0808 14:38:37.113896 (+ 975us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:37.113900 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:37.113969 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:37.114082 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:37.115349 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:37.115941 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:37.117492 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:37.117857 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:37.117962 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:37.121049 (+ 3087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:37.121054 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:37.121059 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:37.121094 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:37.123142 (+ 2048us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:37.123678 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:37.123683 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:37.123684 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:37.123769 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:37.124181 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:37.124188 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:37.124193 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:37.124465 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:37.124585 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:37.125605 (+ 1020us) server_negotiation.cc:299] Negotiation successful
0808 14:38:37.125727 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 14:38:37.127010 14766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:37.112194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:38159 (local address 127.0.0.1:51072)
0808 14:38:37.112756 (+ 562us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:37.112800 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:37.113676 (+ 876us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:37.114268 (+ 592us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:37.114276 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:37.114689 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:38:37.115194 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:37.115208 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:37.116082 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:37.116085 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:37.117360 (+ 1275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:37.117373 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:37.118087 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:37.118091 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:37.118310 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:37.119115 (+ 805us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:38:37.119141 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:38:37.120840 (+ 1699us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:38:37.123278 (+ 2438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:37.123290 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:37.123303 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:37.123565 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:37.123865 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:37.123869 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:37.123872 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:37.124057 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:37.124901 (+ 844us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:38:37.124908 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:38:37.125253 (+ 345us) client_negotiation.cc:769] Sending connection context
0808 14:38:37.125544 (+ 291us) client_negotiation.cc:240] Negotiation successful
0808 14:38:37.125865 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":161,"threads_started":1}
I20260808 14:38:37.128722 14762 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.131.253" port: 34827 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:38:37.128804 14649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:37.117050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.253:34827 (local address 127.0.0.1:38488)
0808 14:38:37.117169 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:37.117183 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:37.117261 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:37.117990 (+ 729us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:37.117994 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:37.118193 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:38:37.118312 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:37.118319 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:37.119752 (+ 1433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:37.119756 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:37.120611 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:37.120623 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:37.121348 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:37.121352 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:37.121470 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:37.122552 (+ 1082us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:38:37.122564 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:38:37.124237 (+ 1673us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:38:37.127099 (+ 2862us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:37.127102 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:37.127104 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:37.127344 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:37.127720 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:37.127723 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:37.127724 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:37.127814 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:37.128379 (+ 565us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:38:37.128382 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:38:37.128482 (+ 100us) client_negotiation.cc:769] Sending connection context
0808 14:38:37.128570 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 14:38:37.128695 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260808 14:38:37.129503 14767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:37.117161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38488 (local address 127.11.131.253:34827)
0808 14:38:37.117515 (+ 354us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:37.117528 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:37.117550 (+ 22us) server_negotiation.cc:407] Connection header received
0808 14:38:37.117590 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:37.117595 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:37.117782 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:37.117975 (+ 193us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:37.118434 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:37.119605 (+ 1171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:37.120758 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:37.121218 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:37.121333 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:37.124400 (+ 3067us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:37.124410 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:37.124421 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:37.124442 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:37.126965 (+ 2523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:37.127480 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:37.127509 (+ 29us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:37.127513 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:37.127609 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:37.127941 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:37.127944 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:37.127945 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:37.128254 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:37.129047 (+ 793us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:37.129150 (+ 103us) server_negotiation.cc:299] Negotiation successful
0808 14:38:37.129329 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":234,"thread_start_us":125,"threads_started":1}
I20260808 14:38:37.131260 14644 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.131.252" port: 37429 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:38:37.131973 14649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:37.131763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.252:37429 (local address 127.0.0.1:45898)
0808 14:38:37.131868 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:37.131916 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.252:37429: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260808 14:38:37.132844 14649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:37.132494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.252:37429 (local address 127.0.0.1:45906)
0808 14:38:37.132714 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:37.132764 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.252:37429: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143}
W20260808 14:38:37.132999 14644 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.131.252:37429: Network error: Client connection negotiation failed: client connection to 127.11.131.252:37429: connect: Connection refused (error 111)
Aug 08 14:38:37 dist-test-slave-twwt krb5kdc[14517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199917, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.253@KRBTEST.COM for kudu/127.11.131.253@KRBTEST.COM
I20260808 14:38:37.137951 14766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:37.129444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.253:34827 (local address 127.0.0.1:38490)
0808 14:38:37.129808 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:37.129820 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:37.129928 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:37.130143 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:37.130146 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:37.130317 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:38:37.130415 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:37.130421 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:37.131245 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:37.131251 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:37.131988 (+ 737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:37.131997 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:37.132581 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:37.132584 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:37.132712 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:37.133280 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:38:37.133292 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:38:37.134774 (+ 1482us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:38:37.136483 (+ 1709us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:37.136486 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:37.136487 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:37.136769 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:37.137036 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:37.137039 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:37.137040 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:37.137115 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:37.137537 (+ 422us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:38:37.137540 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:38:37.137621 (+ 81us) client_negotiation.cc:769] Sending connection context
0808 14:38:37.137706 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 14:38:37.137815 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":305}
I20260808 14:38:37.138069 14767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:37.129516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38490 (local address 127.11.131.253:34827)
0808 14:38:37.129701 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:37.129705 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:37.129883 (+ 178us) server_negotiation.cc:407] Connection header received
0808 14:38:37.130008 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:37.130011 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:37.130047 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:37.130132 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:37.130528 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:37.131138 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:37.132134 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:37.132459 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:37.132542 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:37.134928 (+ 2386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:37.134934 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:37.134940 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:37.134963 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:37.136375 (+ 1412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:37.136870 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:37.136873 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:37.136874 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:37.136952 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:37.137197 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:37.137199 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:37.137200 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:37.137377 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:37.137504 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:37.137781 (+ 277us) server_negotiation.cc:299] Negotiation successful
0808 14:38:37.137883 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":128,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.131.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.252.keytab.
Entry for principal kudu/127.11.131.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.252.keytab.
I20260808 14:38:37.138938 14762 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.131.252" port: 37429 } has no permanent_uuid. Determining permanent_uuid...
I20260808 14:38:37.139592 11791 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
/tmp/dist-test-taskR7JPPN/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.252:37429
--webserver_interface=127.11.131.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.252.keytab
--principal=kudu/127.11.131.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.131.212:45871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.131.254:38159,127.11.131.253:34827,127.11.131.252:37429
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 14:38:37.139736 14766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:37.139418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.252:37429 (local address 127.0.0.1:45922)
0808 14:38:37.139556 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:37.139657 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.252:37429: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260808 14:38:37.140432 14678 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.131.252:37429: connect: Connection refused (error 111)
I20260808 14:38:37.141461 14766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:37.141184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.252:37429 (local address 127.0.0.1:45936)
0808 14:38:37.141315 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:37.141378 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.252:37429: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260808 14:38:37.141626 14762 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.131.252:37429: Network error: Client connection negotiation failed: client connection to 127.11.131.252:37429: connect: Connection refused (error 111)
I20260808 14:38:37.164188 14644 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.131.252" port: 37429 } attempt: 1
I20260808 14:38:37.165155 14649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:37.164793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.252:37429 (local address 127.0.0.1:45942)
0808 14:38:37.164980 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:37.165058 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.252:37429: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260808 14:38:37.166023 14649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:37.165767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.252:37429 (local address 127.0.0.1:45954)
0808 14:38:37.165895 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:37.165953 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.252:37429: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260808 14:38:37.166181 14644 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.131.252:37429: Network error: Client connection negotiation failed: client connection to 127.11.131.252:37429: connect: Connection refused (error 111)
I20260808 14:38:37.190960 14762 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.131.252" port: 37429 } attempt: 1
I20260808 14:38:37.192013 14766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:37.191669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.252:37429 (local address 127.0.0.1:45958)
0808 14:38:37.191861 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:37.191928 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.252:37429: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260808 14:38:37.192829 14766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:37.192551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.252:37429 (local address 127.0.0.1:45964)
0808 14:38:37.192666 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:37.192768 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.252:37429: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260808 14:38:37.192970 14762 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.131.252:37429: Network error: Client connection negotiation failed: client connection to 127.11.131.252:37429: connect: Connection refused (error 111)
I20260808 14:38:37.241390 14644 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.131.252" port: 37429 } attempt: 2
I20260808 14:38:37.242353 14649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:37.241945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.252:37429 (local address 127.0.0.1:45968)
0808 14:38:37.242150 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:37.242234 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.252:37429: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260808 14:38:37.243487 14649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:37.243192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.252:37429 (local address 127.0.0.1:45974)
0808 14:38:37.243340 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:37.243399 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.252:37429: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260808 14:38:37.243680 14644 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.131.252:37429: Network error: Client connection negotiation failed: client connection to 127.11.131.252:37429: connect: Connection refused (error 111)
I20260808 14:38:37.261133 14762 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.131.252" port: 37429 } attempt: 2
I20260808 14:38:37.261966 14766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:37.261649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.252:37429 (local address 127.0.0.1:45976)
0808 14:38:37.261802 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:37.261889 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.252:37429: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260808 14:38:37.261873 14773 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 14:38:37.262253 14773 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 14:38:37.262303 14773 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 14:38:37.262359 14773 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260808 14:38:37.262801 14766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:37.262533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.252:37429 (local address 127.0.0.1:45984)
0808 14:38:37.262684 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:37.262741 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.131.252:37429: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260808 14:38:37.262964 14762 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.131.252:37429: Network error: Client connection negotiation failed: client connection to 127.11.131.252:37429: connect: Connection refused (error 111)
W20260808 14:38:37.266561 14773 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 14:38:37.266664 14773 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 14:38:37.266712 14773 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 14:38:37.266749 14773 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 14:38:37.266784 14773 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 14:38:37.272235 14773 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.131.212:45871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.131.254:38159,127.11.131.253:34827,127.11.131.252:37429
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/krb5kdc/kudu_127.11.131.252.keytab
--principal=kudu/127.11.131.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.131.252:37429
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.131.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14773
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 13:56:08 UTC on ccycloud.quasar-tfdlcx.root.comops.site
build id 4574926
I20260808 14:38:37.273379 14773 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 14:38:37.274441 14773 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 14:38:37.283214 14773 server_base.cc:1034] running on GCE node
W20260808 14:38:37.283182 14786 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:37.283165 14783 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 14:38:37.283177 14791 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 14:38:37.284137 14773 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 14:38:37.285169 14773 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 14:38:37.286341 14773 hybrid_clock.cc:648] HybridClock initialized: now 1786199917286326 us; error 27 us; skew 500 ppm
Aug 08 14:38:37 dist-test-slave-twwt krb5kdc[14517](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199917, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 14:38:37.289317 14773 init.cc:377] Logged in from keytab as kudu/127.11.131.252@KRBTEST.COM (short username kudu)
I20260808 14:38:37.290185 14773 webserver.cc:460] Webserver started at http://127.11.131.252:34129/ using document root <none> and password file <none>
I20260808 14:38:37.290817 14773 fs_manager.cc:359] Metadata directory not provided
I20260808 14:38:37.290884 14773 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 14:38:37.291126 14773 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 14:38:37.293202 14773 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/minicluster-data/master-2/data/instance:
uuid: "10cdf6c8811a494ebe7ee2c0bcf87804"
format_stamp: "Formatted at 2026-08-08 14:38:37 on dist-test-slave-twwt"
server_key: "c596a8dcad4053f517897854570d9a41"
server_key_iv: "e911ee33dfd1dee3b91832db09edec44"
server_key_version: "encryptionkey@0"
I20260808 14:38:37.293804 14773 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/minicluster-data/master-2/wal/instance:
uuid: "10cdf6c8811a494ebe7ee2c0bcf87804"
format_stamp: "Formatted at 2026-08-08 14:38:37 on dist-test-slave-twwt"
server_key: "c596a8dcad4053f517897854570d9a41"
server_key_iv: "e911ee33dfd1dee3b91832db09edec44"
server_key_version: "encryptionkey@0"
I20260808 14:38:37.297504 14773 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20260808 14:38:37.299983 14799 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 14:38:37.301209 14773 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 14:38:37.301358 14773 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/minicluster-data/master-2/data,/tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/minicluster-data/master-2/wal
uuid: "10cdf6c8811a494ebe7ee2c0bcf87804"
format_stamp: "Formatted at 2026-08-08 14:38:37 on dist-test-slave-twwt"
server_key: "c596a8dcad4053f517897854570d9a41"
server_key_iv: "e911ee33dfd1dee3b91832db09edec44"
server_key_version: "encryptionkey@0"
I20260808 14:38:37.301471 14773 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 14:38:37.312038 14773 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 14:38:37.315452 14773 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 14:38:37.315668 14773 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 14:38:37.323309 14773 rpc_server.cc:307] RPC server started. Bound to: 127.11.131.252:37429
I20260808 14:38:37.323613 14886 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.131.252:37429 every 8 connection(s)
I20260808 14:38:37.324361 14773 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/minicluster-data/master-2/data/info.pb
I20260808 14:38:37.327430 14888 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 14:38:37.327661 11791 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu as pid 14773
I20260808 14:38:37.327785 11791 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskR7JPPN/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786199615258783-11791-0/minicluster-data/master-2/wal/instance
I20260808 14:38:37.328130 11791 external_mini_cluster.cc:1428] Setting key efbc82f6876a79df3da3527e7d27b06b
I20260808 14:38:37.332922 14888 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38159 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:38:37 dist-test-slave-twwt krb5kdc[14517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199916, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.131.252@KRBTEST.COM
Aug 08 14:38:37 dist-test-slave-twwt krb5kdc[14517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199917, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.252@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:38:37.342846 14644 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.131.252" port: 37429 } attempt: 3
I20260808 14:38:37.344519 14895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:37.329538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45988 (local address 127.11.131.252:37429)
0808 14:38:37.329973 (+ 435us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:37.329992 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:37.330036 (+ 44us) server_negotiation.cc:407] Connection header received
0808 14:38:37.331210 (+ 1174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:37.331236 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:37.331687 (+ 451us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:37.332059 (+ 372us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:37.332850 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:37.334391 (+ 1541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:37.335668 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:37.336122 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:37.336332 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:37.339036 (+ 2704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:37.339041 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:37.339051 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:37.339077 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:37.340772 (+ 1695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:37.341280 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:37.341285 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:37.341291 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:37.341442 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:37.341766 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:37.341772 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:37.341777 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:37.342349 (+ 572us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:37.342581 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:37.343168 (+ 587us) server_negotiation.cc:299] Negotiation successful
0808 14:38:37.343478 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":281,"thread_start_us":130,"threads_started":1}
I20260808 14:38:37.345220 14648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:37.334958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51076 (local address 127.11.131.254:38159)
0808 14:38:37.335083 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:37.335090 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:37.335440 (+ 350us) server_negotiation.cc:407] Connection header received
0808 14:38:37.335610 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:37.335613 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:37.335668 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:37.335754 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:37.336500 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:37.337169 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:37.338263 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:37.338551 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:37.338709 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:37.341303 (+ 2594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:37.341306 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:37.341309 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:37.341338 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:37.343001 (+ 1663us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:37.343812 (+ 811us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:37.343816 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:37.343818 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:37.343915 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:37.344230 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:37.344233 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:37.344235 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:37.344496 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:37.344605 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:37.344957 (+ 352us) server_negotiation.cc:299] Negotiation successful
0808 14:38:37.345075 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":47}
I20260808 14:38:37.345260 14896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:37.334915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.254:38159 (local address 127.0.0.1:51076)
0808 14:38:37.335301 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:37.335340 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:37.335492 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:37.335811 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:37.335817 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:37.336189 (+ 372us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:38:37.336367 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:37.336373 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:37.337299 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:37.337304 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:37.338122 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:37.338135 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:37.338759 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:37.338764 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:37.338879 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:37.339481 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:38:37.339503 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:38:37.341163 (+ 1660us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:38:37.343109 (+ 1946us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:37.343121 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:37.343132 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:37.343713 (+ 581us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:37.344022 (+ 309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:37.344025 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:37.344027 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:37.344132 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:37.344617 (+ 485us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:38:37.344625 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:38:37.344750 (+ 125us) client_negotiation.cc:769] Sending connection context
0808 14:38:37.344898 (+ 148us) client_negotiation.cc:240] Negotiation successful
0808 14:38:37.345075 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":137,"threads_started":1}
I20260808 14:38:37.347235 14888 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.131.253" port: 34827 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:38:37 dist-test-slave-twwt krb5kdc[14517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199916, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.254@KRBTEST.COM for kudu/127.11.131.252@KRBTEST.COM
Aug 08 14:38:37 dist-test-slave-twwt krb5kdc[14517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199916, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.131.254@KRBTEST.COM
I20260808 14:38:37.353228 14649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:37.343385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.252:37429 (local address 127.0.0.1:45992)
0808 14:38:37.343504 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:37.343520 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:37.343598 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:37.344158 (+ 560us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:37.344164 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:37.344329 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:38:37.344510 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:37.344516 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:37.345639 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:37.345646 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:37.346403 (+ 757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:37.346424 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:37.347189 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:37.347192 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:37.347277 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:37.347714 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:38:37.347730 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:38:37.349177 (+ 1447us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:38:37.351222 (+ 2045us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:37.351229 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:37.351232 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:37.351507 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:37.351869 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:37.351876 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:37.351880 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:37.351986 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:37.352618 (+ 632us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:38:37.352621 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:38:37.352742 (+ 121us) client_negotiation.cc:769] Sending connection context
0808 14:38:37.352863 (+ 121us) client_negotiation.cc:240] Negotiation successful
0808 14:38:37.353031 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47,"mutex_wait_us":49}
I20260808 14:38:37.353268 14898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:37.343457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45992 (local address 127.11.131.252:37429)
0808 14:38:37.343901 (+ 444us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:37.343918 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:37.343927 (+ 9us) server_negotiation.cc:407] Connection header received
0808 14:38:37.343950 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:37.343952 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:37.344015 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:37.344386 (+ 371us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:37.344649 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:37.345494 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:37.346731 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:37.347069 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:37.347166 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:37.349304 (+ 2138us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:37.349308 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:37.349311 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:37.349335 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:37.351103 (+ 1768us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:37.351646 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:37.351650 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:37.351652 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:37.351735 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:37.352110 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:37.352113 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:37.352115 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:37.352473 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:37.352642 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:37.352949 (+ 307us) server_negotiation.cc:299] Negotiation successful
0808 14:38:37.353070 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":95,"threads_started":1}
Aug 08 14:38:37 dist-test-slave-twwt krb5kdc[14517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199917, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.252@KRBTEST.COM for kudu/127.11.131.253@KRBTEST.COM
I20260808 14:38:37.354107 14762 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.131.252" port: 37429 } attempt: 3
I20260808 14:38:37.357419 14648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:37.346783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51090 (local address 127.11.131.254:38159)
0808 14:38:37.347283 (+ 500us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:37.347287 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:37.347299 (+ 12us) server_negotiation.cc:407] Connection header received
0808 14:38:37.347330 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:37.347334 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:37.347393 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:37.347469 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:37.348334 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:37.349092 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:37.350044 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:37.350262 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:37.350361 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:37.353065 (+ 2704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:37.353068 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:37.353070 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:37.353093 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:37.355259 (+ 2166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:37.355735 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:37.355739 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:37.355740 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:37.355822 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:37.356146 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:37.356149 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:37.356151 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:37.356349 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:37.356533 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:37.357167 (+ 634us) server_negotiation.cc:299] Negotiation successful
0808 14:38:37.357270 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":436}
I20260808 14:38:37.357888 14896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:37.347701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.253:34827 (local address 127.0.0.1:38502)
0808 14:38:37.347800 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:37.347818 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:37.347893 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:37.348290 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:37.348293 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:37.348463 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:38:37.348937 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:37.348949 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:37.350499 (+ 1550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:37.350505 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:37.351323 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:37.351332 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:37.351817 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:37.351821 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:37.351919 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:37.352403 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:38:37.352425 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:38:37.354078 (+ 1653us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:38:37.356280 (+ 2202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:37.356283 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:37.356285 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:37.356547 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:37.356875 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:37.356882 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:37.356885 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:37.356975 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:37.357437 (+ 462us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:38:37.357440 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:38:37.357528 (+ 88us) client_negotiation.cc:769] Sending connection context
0808 14:38:37.357627 (+ 99us) client_negotiation.cc:240] Negotiation successful
0808 14:38:37.357744 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31,"spinlock_wait_cycles":1920}
I20260808 14:38:37.358011 14644 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 55183e944f854053ba167527c60d3fd1: Bootstrap starting.
I20260808 14:38:37.358321 14767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:37.347977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38502 (local address 127.11.131.253:34827)
0808 14:38:37.348084 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:37.348089 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:37.348108 (+ 19us) server_negotiation.cc:407] Connection header received
0808 14:38:37.348145 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:37.348147 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:37.348184 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:37.348275 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:37.349073 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:37.350087 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:37.351453 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:37.351699 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:37.351813 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:37.354231 (+ 2418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:37.354235 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:37.354237 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:37.354264 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:37.356161 (+ 1897us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:37.356669 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:37.356673 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:37.356674 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:37.356763 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:37.357086 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:37.357091 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:37.357093 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:37.357291 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:37.357379 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:37.358078 (+ 699us) server_negotiation.cc:299] Negotiation successful
0808 14:38:37.358188 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 14:38:37.359790 14888 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.131.252" port: 37429 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 14:38:37 dist-test-slave-twwt krb5kdc[14517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199917, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.253@KRBTEST.COM for kudu/127.11.131.252@KRBTEST.COM
I20260808 14:38:37.362003 14644 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 55183e944f854053ba167527c60d3fd1: Neither blocks nor log segments found. Creating new log.
I20260808 14:38:37.363242 14644 log.cc:824] T 00000000000000000000000000000000 P 55183e944f854053ba167527c60d3fd1: Log is configured to *not* fsync() on all Append() calls
Aug 08 14:38:37 dist-test-slave-twwt krb5kdc[14517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199916, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.131.253@KRBTEST.COM
I20260808 14:38:37.364660 14766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:37.354525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.252:37429 (local address 127.0.0.1:45994)
0808 14:38:37.354683 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:37.354697 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:37.354777 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:37.355169 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:37.355172 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:37.355370 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:38:37.355478 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:37.355485 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:37.356632 (+ 1147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:37.356636 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:37.357388 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:37.357400 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:37.358686 (+ 1286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:37.358690 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:37.358781 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:37.359229 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:38:37.359250 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:38:37.360787 (+ 1537us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:38:37.362764 (+ 1977us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:37.362767 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:37.362769 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:37.363041 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:37.363463 (+ 422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:37.363468 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:37.363470 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:37.363576 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:37.364144 (+ 568us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:38:37.364148 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:38:37.364258 (+ 110us) client_negotiation.cc:769] Sending connection context
0808 14:38:37.364385 (+ 127us) client_negotiation.cc:240] Negotiation successful
0808 14:38:37.364519 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260808 14:38:37.365175 14898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:37.354777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45994 (local address 127.11.131.252:37429)
0808 14:38:37.354901 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:37.354908 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:37.354921 (+ 13us) server_negotiation.cc:407] Connection header received
0808 14:38:37.354958 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:37.354964 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:37.355011 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:37.355591 (+ 580us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:37.355680 (+ 89us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:37.356491 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:37.357749 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:37.358327 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:37.358988 (+ 661us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:37.360917 (+ 1929us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:37.360920 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:37.360923 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:37.360947 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:37.362627 (+ 1680us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:37.363165 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:37.363169 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:37.363173 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:37.363260 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:37.363708 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:37.363714 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:37.363718 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:37.364004 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:37.364152 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:37.364467 (+ 315us) server_negotiation.cc:299] Negotiation successful
0808 14:38:37.364578 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":30,"server-negotiator.queue_time_us":27,"spinlock_wait_cycles":3968}
Aug 08 14:38:37 dist-test-slave-twwt krb5kdc[14517](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786199917, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.131.252@KRBTEST.COM for kudu/127.11.131.252@KRBTEST.COM
I20260808 14:38:37.366019 14644 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 55183e944f854053ba167527c60d3fd1: No bootstrap required, opened a new log
I20260808 14:38:37.369066 14762 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e67a4b753a784a7ebb0ef34782e12d7a: Bootstrap starting.
I20260808 14:38:37.369694 14767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:37.358640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38516 (local address 127.11.131.253:34827)
0808 14:38:37.358730 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:37.358734 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:37.358806 (+ 72us) server_negotiation.cc:407] Connection header received
0808 14:38:37.358965 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:37.358969 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:37.359013 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:37.359102 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:37.359926 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:37.360651 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:37.361756 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:37.362186 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:37.362287 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:37.365165 (+ 2878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:37.365169 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:37.365172 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:37.365198 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:37.367236 (+ 2038us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:37.368038 (+ 802us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:37.368043 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:37.368046 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:37.368140 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:37.368494 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:37.368499 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:37.368502 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:37.368714 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:37.368907 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:37.369435 (+ 528us) server_negotiation.cc:299] Negotiation successful
0808 14:38:37.369549 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 14:38:37.370232 14896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:37.360244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.131.252:37429 (local address 127.0.0.1:46010)
0808 14:38:37.360549 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0808 14:38:37.360561 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 14:38:37.360633 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 14:38:37.360899 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 14:38:37.360901 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 14:38:37.361090 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0808 14:38:37.361172 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:37.361183 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:37.362188 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:37.362191 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:37.363003 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 14:38:37.363018 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 14:38:37.363750 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 14:38:37.363757 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 14:38:37.363903 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:37.364824 (+ 921us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 14:38:37.364838 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 14:38:37.366165 (+ 1327us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 14:38:37.368728 (+ 2563us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:37.368731 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:37.368735 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:37.368989 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:37.369266 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 14:38:37.369268 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 14:38:37.369270 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 14:38:37.369357 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 14:38:37.369767 (+ 410us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 14:38:37.369771 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 14:38:37.369876 (+ 105us) client_negotiation.cc:769] Sending connection context
0808 14:38:37.369964 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 14:38:37.370087 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"mutex_wait_us":23,"spinlock_wait_cycles":1792}
I20260808 14:38:37.370127 14644 raft_consensus.cc:348] T 00000000000000000000000000000000 P 55183e944f854053ba167527c60d3fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55183e944f854053ba167527c60d3fd1" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38159 } } peers { permanent_uuid: "e67a4b753a784a7ebb0ef34782e12d7a" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 34827 } } peers { permanent_uuid: "10cdf6c8811a494ebe7ee2c0bcf87804" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 37429 } }
I20260808 14:38:37.370364 14644 raft_consensus.cc:729] T 00000000000000000000000000000000 P 55183e944f854053ba167527c60d3fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55183e944f854053ba167527c60d3fd1, State: Initialized, Role: FOLLOWER
I20260808 14:38:37.370777 14895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:37.360400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46010 (local address 127.11.131.252:37429)
0808 14:38:37.360497 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:37.360501 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:37.360703 (+ 202us) server_negotiation.cc:407] Connection header received
0808 14:38:37.360728 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:37.360730 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:37.360762 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:37.360819 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:37.361297 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:37.362067 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:37.363134 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:37.363458 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:37.363570 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:37.366293 (+ 2723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:37.366298 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:37.366302 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:37.366329 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:37.368624 (+ 2295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:37.369085 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:37.369088 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:37.369090 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:37.369172 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:37.369450 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:37.369452 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:37.369454 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:37.369634 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:37.369727 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:37.370498 (+ 771us) server_negotiation.cc:299] Negotiation successful
0808 14:38:37.370641 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 14:38:37.370730 14644 consensus_queue.cc:260] T 00000000000000000000000000000000 P 55183e944f854053ba167527c60d3fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55183e944f854053ba167527c60d3fd1" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38159 } } peers { permanent_uuid: "e67a4b753a784a7ebb0ef34782e12d7a" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 34827 } } peers { permanent_uuid: "10cdf6c8811a494ebe7ee2c0bcf87804" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 37429 } }
I20260808 14:38:37.371984 14762 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e67a4b753a784a7ebb0ef34782e12d7a: Neither blocks nor log segments found. Creating new log.
I20260808 14:38:37.372185 14644 sys_catalog.cc:564] T 00000000000000000000000000000000 P 55183e944f854053ba167527c60d3fd1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:38:37.372910 14762 log.cc:824] T 00000000000000000000000000000000 P e67a4b753a784a7ebb0ef34782e12d7a: Log is configured to *not* fsync() on all Append() calls
I20260808 14:38:37.373577 14888 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10cdf6c8811a494ebe7ee2c0bcf87804: Bootstrap starting.
I20260808 14:38:37.375186 14900 sys_catalog.cc:455] T 00000000000000000000000000000000 P 55183e944f854053ba167527c60d3fd1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55183e944f854053ba167527c60d3fd1" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38159 } } peers { permanent_uuid: "e67a4b753a784a7ebb0ef34782e12d7a" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 34827 } } peers { permanent_uuid: "10cdf6c8811a494ebe7ee2c0bcf87804" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 37429 } } }
I20260808 14:38:37.375329 14900 sys_catalog.cc:458] T 00000000000000000000000000000000 P 55183e944f854053ba167527c60d3fd1 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:38:37.375926 14888 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 10cdf6c8811a494ebe7ee2c0bcf87804: Neither blocks nor log segments found. Creating new log.
I20260808 14:38:37.376348 14762 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e67a4b753a784a7ebb0ef34782e12d7a: No bootstrap required, opened a new log
I20260808 14:38:37.376696 14888 log.cc:824] T 00000000000000000000000000000000 P 10cdf6c8811a494ebe7ee2c0bcf87804: Log is configured to *not* fsync() on all Append() calls
I20260808 14:38:37.378396 14888 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10cdf6c8811a494ebe7ee2c0bcf87804: No bootstrap required, opened a new log
W20260808 14:38:37.381999 14924 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 55183e944f854053ba167527c60d3fd1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:38:37.382107 14924 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:38:37.383152 14888 raft_consensus.cc:348] T 00000000000000000000000000000000 P 10cdf6c8811a494ebe7ee2c0bcf87804 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55183e944f854053ba167527c60d3fd1" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38159 } } peers { permanent_uuid: "e67a4b753a784a7ebb0ef34782e12d7a" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 34827 } } peers { permanent_uuid: "10cdf6c8811a494ebe7ee2c0bcf87804" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 37429 } }
I20260808 14:38:37.383373 14888 raft_consensus.cc:729] T 00000000000000000000000000000000 P 10cdf6c8811a494ebe7ee2c0bcf87804 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10cdf6c8811a494ebe7ee2c0bcf87804, State: Initialized, Role: FOLLOWER
I20260808 14:38:37.383663 14888 consensus_queue.cc:260] T 00000000000000000000000000000000 P 10cdf6c8811a494ebe7ee2c0bcf87804 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55183e944f854053ba167527c60d3fd1" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38159 } } peers { permanent_uuid: "e67a4b753a784a7ebb0ef34782e12d7a" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 34827 } } peers { permanent_uuid: "10cdf6c8811a494ebe7ee2c0bcf87804" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 37429 } }
I20260808 14:38:37.384397 14929 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10cdf6c8811a494ebe7ee2c0bcf87804 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55183e944f854053ba167527c60d3fd1" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38159 } } peers { permanent_uuid: "e67a4b753a784a7ebb0ef34782e12d7a" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 34827 } } peers { permanent_uuid: "10cdf6c8811a494ebe7ee2c0bcf87804" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 37429 } } }
I20260808 14:38:37.384586 14929 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10cdf6c8811a494ebe7ee2c0bcf87804 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:38:37.380944 14533 master_runner.cc:186] Error getting master registration for 127.11.131.253:34827: OK, instance_id { permanent_uuid: "e67a4b753a784a7ebb0ef34782e12d7a" instance_seqno: 1786199917099692 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 14:38:37.385010 14533 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 14:38:37.385097 14888 sys_catalog.cc:564] T 00000000000000000000000000000000 P 10cdf6c8811a494ebe7ee2c0bcf87804 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:38:37.385635 11791 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 14:38:37.385716 14762 raft_consensus.cc:348] T 00000000000000000000000000000000 P e67a4b753a784a7ebb0ef34782e12d7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55183e944f854053ba167527c60d3fd1" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38159 } } peers { permanent_uuid: "e67a4b753a784a7ebb0ef34782e12d7a" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 34827 } } peers { permanent_uuid: "10cdf6c8811a494ebe7ee2c0bcf87804" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 37429 } }
I20260808 14:38:37.385946 14762 raft_consensus.cc:729] T 00000000000000000000000000000000 P e67a4b753a784a7ebb0ef34782e12d7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e67a4b753a784a7ebb0ef34782e12d7a, State: Initialized, Role: FOLLOWER
I20260808 14:38:37.386272 14762 consensus_queue.cc:260] T 00000000000000000000000000000000 P e67a4b753a784a7ebb0ef34782e12d7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55183e944f854053ba167527c60d3fd1" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38159 } } peers { permanent_uuid: "e67a4b753a784a7ebb0ef34782e12d7a" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 34827 } } peers { permanent_uuid: "10cdf6c8811a494ebe7ee2c0bcf87804" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 37429 } }
I20260808 14:38:37.387349 14598 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "55183e944f854053ba167527c60d3fd1"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51090
I20260808 14:38:37.387607 14598 raft_consensus.cc:482] T 00000000000000000000000000000000 P 55183e944f854053ba167527c60d3fd1 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 14:38:37.387740 14598 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 55183e944f854053ba167527c60d3fd1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:38:37.389158 14598 raft_consensus.cc:504] T 00000000000000000000000000000000 P 55183e944f854053ba167527c60d3fd1 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55183e944f854053ba167527c60d3fd1" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38159 } } peers { permanent_uuid: "e67a4b753a784a7ebb0ef34782e12d7a" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 34827 } } peers { permanent_uuid: "10cdf6c8811a494ebe7ee2c0bcf87804" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 37429 } }
I20260808 14:38:37.390172 14598 leader_election.cc:288] T 00000000000000000000000000000000 P 55183e944f854053ba167527c60d3fd1 [CANDIDATE]: Term 1 election: Requested vote from peers e67a4b753a784a7ebb0ef34782e12d7a (127.11.131.253:34827), 10cdf6c8811a494ebe7ee2c0bcf87804 (127.11.131.252:37429)
W20260808 14:38:37.390813 14950 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 10cdf6c8811a494ebe7ee2c0bcf87804: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:38:37.390951 14950 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:38:37.390920 14844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "55183e944f854053ba167527c60d3fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "10cdf6c8811a494ebe7ee2c0bcf87804"
I20260808 14:38:37.391156 14844 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 10cdf6c8811a494ebe7ee2c0bcf87804 [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:38:37.392740 14844 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 10cdf6c8811a494ebe7ee2c0bcf87804 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55183e944f854053ba167527c60d3fd1 in term 1.
I20260808 14:38:37.393196 14563 leader_election.cc:302] T 00000000000000000000000000000000 P 55183e944f854053ba167527c60d3fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10cdf6c8811a494ebe7ee2c0bcf87804, 55183e944f854053ba167527c60d3fd1; no voters:
I20260808 14:38:37.393466 14900 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 55183e944f854053ba167527c60d3fd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 14:38:37.393693 14900 raft_consensus.cc:686] T 00000000000000000000000000000000 P 55183e944f854053ba167527c60d3fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 55183e944f854053ba167527c60d3fd1, State: Running, Role: LEADER
I20260808 14:38:37.394057 14900 consensus_queue.cc:237] T 00000000000000000000000000000000 P 55183e944f854053ba167527c60d3fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55183e944f854053ba167527c60d3fd1" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38159 } } peers { permanent_uuid: "e67a4b753a784a7ebb0ef34782e12d7a" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 34827 } } peers { permanent_uuid: "10cdf6c8811a494ebe7ee2c0bcf87804" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 37429 } }
I20260808 14:38:37.396029 14900 sys_catalog.cc:455] T 00000000000000000000000000000000 P 55183e944f854053ba167527c60d3fd1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 55183e944f854053ba167527c60d3fd1. Latest consensus state: current_term: 1 leader_uuid: "55183e944f854053ba167527c60d3fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55183e944f854053ba167527c60d3fd1" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38159 } } peers { permanent_uuid: "e67a4b753a784a7ebb0ef34782e12d7a" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 34827 } } peers { permanent_uuid: "10cdf6c8811a494ebe7ee2c0bcf87804" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 37429 } } }
I20260808 14:38:37.396031 14714 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "55183e944f854053ba167527c60d3fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "e67a4b753a784a7ebb0ef34782e12d7a"
I20260808 14:38:37.396150 14900 sys_catalog.cc:458] T 00000000000000000000000000000000 P 55183e944f854053ba167527c60d3fd1 [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:37.396292 14714 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e67a4b753a784a7ebb0ef34782e12d7a [term 0 FOLLOWER]: Advancing to term 1
I20260808 14:38:37.397691 14714 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e67a4b753a784a7ebb0ef34782e12d7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55183e944f854053ba167527c60d3fd1 in term 1.
I20260808 14:38:37.395965 14762 sys_catalog.cc:564] T 00000000000000000000000000000000 P e67a4b753a784a7ebb0ef34782e12d7a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 14:38:37.395084 14773 master_runner.cc:186] Error getting master registration for 127.11.131.253:34827: OK, instance_id { permanent_uuid: "e67a4b753a784a7ebb0ef34782e12d7a" instance_seqno: 1786199917099692 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 14:38:37.398780 14773 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 14:38:37.401108 14964 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 14:38:37.402086 14964 catalog_manager.cc:1484] Initializing Kudu cluster ID...
W20260808 14:38:37.403918 14988 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e67a4b753a784a7ebb0ef34782e12d7a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 14:38:37.404001 14988 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 14:38:37.404618 14941 sys_catalog.cc:455] T 00000000000000000000000000000000 P e67a4b753a784a7ebb0ef34782e12d7a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55183e944f854053ba167527c60d3fd1" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38159 } } peers { permanent_uuid: "e67a4b753a784a7ebb0ef34782e12d7a" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 34827 } } peers { permanent_uuid: "10cdf6c8811a494ebe7ee2c0bcf87804" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 37429 } } }
I20260808 14:38:37.404747 14941 sys_catalog.cc:458] T 00000000000000000000000000000000 P e67a4b753a784a7ebb0ef34782e12d7a [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:38:37.421536 14895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:37.393910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46022 (local address 127.11.131.252:37429)
0808 14:38:37.394025 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:37.394030 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:37.394943 (+ 913us) server_negotiation.cc:407] Connection header received
0808 14:38:37.396366 (+ 1423us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:37.396369 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:37.396420 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:37.396467 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:37.398823 (+ 2356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:37.399580 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:37.409026 (+ 9446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:37.409407 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:37.409488 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:37.413702 (+ 4214us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:37.413706 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:37.413709 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:37.413737 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:37.415703 (+ 1966us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:37.418523 (+ 2820us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:37.418527 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:37.418529 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:37.418643 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:37.419336 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:37.419340 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:37.419342 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:37.419580 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:37.419694 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:37.421217 (+ 1523us) server_negotiation.cc:299] Negotiation successful
0808 14:38:37.421365 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 14:38:37.423206 14767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:37.393852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38518 (local address 127.11.131.253:34827)
0808 14:38:37.394193 (+ 341us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:37.394197 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:37.408844 (+ 14647us) server_negotiation.cc:407] Connection header received
0808 14:38:37.408970 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:37.408973 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:37.409026 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:37.409113 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:37.411797 (+ 2684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:37.412566 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:37.413727 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:37.414061 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:37.414133 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:37.419645 (+ 5512us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:37.419648 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:37.419651 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:37.419682 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:37.421265 (+ 1583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:37.421773 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:37.421777 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:37.421778 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:37.421874 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:37.422193 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:37.422196 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:37.422198 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:37.422455 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:37.422564 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:37.422940 (+ 376us) server_negotiation.cc:299] Negotiation successful
0808 14:38:37.423060 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":239}
I20260808 14:38:37.423183 14844 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 10cdf6c8811a494ebe7ee2c0bcf87804 [term 1 FOLLOWER]: Refusing update from remote peer 55183e944f854053ba167527c60d3fd1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:38:37.423880 14648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:37.394153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51100 (local address 127.11.131.254:38159)
0808 14:38:37.394263 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:37.394268 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:37.394581 (+ 313us) server_negotiation.cc:407] Connection header received
0808 14:38:37.395017 (+ 436us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:37.395021 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:37.395076 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:37.395130 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:37.397453 (+ 2323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:37.398222 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:37.409646 (+ 11424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:37.409996 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:37.410076 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:37.416236 (+ 6160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 14:38:37.416240 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 14:38:37.416243 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 14:38:37.416273 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 14:38:37.418021 (+ 1748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:37.418960 (+ 939us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:37.418964 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:37.418966 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:37.419051 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 14:38:37.420209 (+ 1158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 14:38:37.420214 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 14:38:37.420215 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 14:38:37.420716 (+ 501us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 14:38:37.420831 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:37.423597 (+ 2766us) server_negotiation.cc:299] Negotiation successful
0808 14:38:37.423729 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 14:38:37.423924 14962 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 55183e944f854053ba167527c60d3fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10cdf6c8811a494ebe7ee2c0bcf87804" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 37429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:38:37.425216 14714 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e67a4b753a784a7ebb0ef34782e12d7a [term 1 FOLLOWER]: Refusing update from remote peer 55183e944f854053ba167527c60d3fd1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 14:38:37.425740 14962 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 55183e944f854053ba167527c60d3fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e67a4b753a784a7ebb0ef34782e12d7a" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 34827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 14:38:37.427893 14929 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10cdf6c8811a494ebe7ee2c0bcf87804 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 55183e944f854053ba167527c60d3fd1. Latest consensus state: current_term: 1 leader_uuid: "55183e944f854053ba167527c60d3fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55183e944f854053ba167527c60d3fd1" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38159 } } peers { permanent_uuid: "e67a4b753a784a7ebb0ef34782e12d7a" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 34827 } } peers { permanent_uuid: "10cdf6c8811a494ebe7ee2c0bcf87804" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 37429 } } }
I20260808 14:38:37.428002 14929 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10cdf6c8811a494ebe7ee2c0bcf87804 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:38:37.429162 14941 sys_catalog.cc:455] T 00000000000000000000000000000000 P e67a4b753a784a7ebb0ef34782e12d7a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 55183e944f854053ba167527c60d3fd1. Latest consensus state: current_term: 1 leader_uuid: "55183e944f854053ba167527c60d3fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55183e944f854053ba167527c60d3fd1" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38159 } } peers { permanent_uuid: "e67a4b753a784a7ebb0ef34782e12d7a" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 34827 } } peers { permanent_uuid: "10cdf6c8811a494ebe7ee2c0bcf87804" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 37429 } } }
I20260808 14:38:37.429284 14941 sys_catalog.cc:458] T 00000000000000000000000000000000 P e67a4b753a784a7ebb0ef34782e12d7a [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:38:37.439625 14962 sys_catalog.cc:455] T 00000000000000000000000000000000 P 55183e944f854053ba167527c60d3fd1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "55183e944f854053ba167527c60d3fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55183e944f854053ba167527c60d3fd1" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38159 } } peers { permanent_uuid: "e67a4b753a784a7ebb0ef34782e12d7a" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 34827 } } peers { permanent_uuid: "10cdf6c8811a494ebe7ee2c0bcf87804" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 37429 } } }
I20260808 14:38:37.439760 14962 sys_catalog.cc:458] T 00000000000000000000000000000000 P 55183e944f854053ba167527c60d3fd1 [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:37.439879 14991 mvcc.cc:205] Tried to move back new op lower bound from 7316274861755543552 to 7316274861650034688. Current Snapshot: MvccSnapshot[applied={T|T < 7316274861755543552}]
I20260808 14:38:37.440861 14929 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10cdf6c8811a494ebe7ee2c0bcf87804 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "55183e944f854053ba167527c60d3fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55183e944f854053ba167527c60d3fd1" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38159 } } peers { permanent_uuid: "e67a4b753a784a7ebb0ef34782e12d7a" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 34827 } } peers { permanent_uuid: "10cdf6c8811a494ebe7ee2c0bcf87804" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 37429 } } }
I20260808 14:38:37.440968 14929 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10cdf6c8811a494ebe7ee2c0bcf87804 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:38:37.442701 14964 catalog_manager.cc:1347] Generated new cluster ID: 958cb97e57194c65acf685f6b2c32c63
I20260808 14:38:37.442773 14964 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 14:38:37.443030 14900 sys_catalog.cc:455] T 00000000000000000000000000000000 P 55183e944f854053ba167527c60d3fd1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "55183e944f854053ba167527c60d3fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55183e944f854053ba167527c60d3fd1" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38159 } } peers { permanent_uuid: "e67a4b753a784a7ebb0ef34782e12d7a" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 34827 } } peers { permanent_uuid: "10cdf6c8811a494ebe7ee2c0bcf87804" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 37429 } } }
I20260808 14:38:37.443140 14900 sys_catalog.cc:458] T 00000000000000000000000000000000 P 55183e944f854053ba167527c60d3fd1 [sys.catalog]: This master's current role is: LEADER
I20260808 14:38:37.444259 14941 sys_catalog.cc:455] T 00000000000000000000000000000000 P e67a4b753a784a7ebb0ef34782e12d7a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "55183e944f854053ba167527c60d3fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55183e944f854053ba167527c60d3fd1" member_type: VOTER last_known_addr { host: "127.11.131.254" port: 38159 } } peers { permanent_uuid: "e67a4b753a784a7ebb0ef34782e12d7a" member_type: VOTER last_known_addr { host: "127.11.131.253" port: 34827 } } peers { permanent_uuid: "10cdf6c8811a494ebe7ee2c0bcf87804" member_type: VOTER last_known_addr { host: "127.11.131.252" port: 37429 } } }
I20260808 14:38:37.444367 14941 sys_catalog.cc:458] T 00000000000000000000000000000000 P e67a4b753a784a7ebb0ef34782e12d7a [sys.catalog]: This master's current role is: FOLLOWER
I20260808 14:38:37.444977 14994 mvcc.cc:205] Tried to move back new op lower bound from 7316274861755543552 to 7316274861650034688. Current Snapshot: MvccSnapshot[applied={T|T < 7316274861755543552}]
I20260808 14:38:37.478196 14964 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 14:38:37.480868 14964 catalog_manager.cc:1504] Loading token signing keys...
I20260808 14:38:37.505836 14964 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 55183e944f854053ba167527c60d3fd1: Generated new TSK 0
I20260808 14:38:37.506835 14964 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 14:38:37.545203 14648 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:38:37.542174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51116 (local address 127.11.131.254:38159)
0808 14:38:37.542306 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:37.542311 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:37.544065 (+ 1754us) server_negotiation.cc:407] Connection header received
0808 14:38:37.544285 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:37.544289 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:37.544342 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:37.544395 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:37.545061 (+ 666us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51116: BlockingRecv error: recv got EOF from 127.0.0.1:51116 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260808 14:38:37.546648 14895 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:38:37.543055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46036 (local address 127.11.131.252:37429)
0808 14:38:37.543192 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:37.543196 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:37.545705 (+ 2509us) server_negotiation.cc:407] Connection header received
0808 14:38:37.545821 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:37.545826 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:37.545887 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:37.545983 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:37.546499 (+ 516us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46036: BlockingRecv error: recv got EOF from 127.0.0.1:46036 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260808 14:38:37.546974 14767 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:38:37.543435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38528 (local address 127.11.131.253:34827)
0808 14:38:37.543553 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:37.543558 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:37.545996 (+ 2438us) server_negotiation.cc:407] Connection header received
0808 14:38:37.546166 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:37.546169 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:37.546218 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:37.546267 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:37.546843 (+ 576us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38528: BlockingRecv error: recv got EOF from 127.0.0.1:38528 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260808 14:38:37.551638 14767 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:38:37.550074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38544 (local address 127.11.131.253:34827)
0808 14:38:37.550176 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:37.550180 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:37.550597 (+ 417us) server_negotiation.cc:407] Connection header received
0808 14:38:37.550896 (+ 299us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:37.550899 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:37.550992 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:37.551045 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:37.551546 (+ 501us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38544: BlockingRecv error: recv got EOF from 127.0.0.1:38544 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260808 14:38:37.556780 14767 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:38:37.555188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38554 (local address 127.11.131.253:34827)
0808 14:38:37.555302 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:37.555306 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:37.555876 (+ 570us) server_negotiation.cc:407] Connection header received
0808 14:38:37.556065 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:37.556069 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:37.556117 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:37.556166 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:37.556690 (+ 524us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38554: BlockingRecv error: recv got EOF from 127.0.0.1:38554 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
W20260808 14:38:37.562412 14767 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:38:37.560954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38564 (local address 127.11.131.253:34827)
0808 14:38:37.561058 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:37.561062 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:37.561520 (+ 458us) server_negotiation.cc:407] Connection header received
0808 14:38:37.561699 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:37.561703 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:37.561752 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:37.561802 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:37.562310 (+ 508us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38564: BlockingRecv error: recv got EOF from 127.0.0.1:38564 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
W20260808 14:38:37.571355 14767 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:38:37.569545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38574 (local address 127.11.131.253:34827)
0808 14:38:37.569682 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:37.569686 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:37.570219 (+ 533us) server_negotiation.cc:407] Connection header received
0808 14:38:37.570485 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:37.570489 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:37.570541 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:37.570595 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:37.571246 (+ 651us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38574: BlockingRecv error: recv got EOF from 127.0.0.1:38574 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
W20260808 14:38:37.584120 14767 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:38:37.582246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38576 (local address 127.11.131.253:34827)
0808 14:38:37.582390 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:37.582395 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:37.583037 (+ 642us) server_negotiation.cc:407] Connection header received
0808 14:38:37.583261 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:37.583265 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:37.583323 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:37.583378 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:37.583992 (+ 614us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38576: BlockingRecv error: recv got EOF from 127.0.0.1:38576 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260808 14:38:37.604933 14767 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:38:37.602955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38582 (local address 127.11.131.253:34827)
0808 14:38:37.603095 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:37.603099 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:37.603721 (+ 622us) server_negotiation.cc:407] Connection header received
0808 14:38:37.603999 (+ 278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:37.604004 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:37.604068 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:37.604130 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:37.604794 (+ 664us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38582: BlockingRecv error: recv got EOF from 127.0.0.1:38582 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260808 14:38:37.641132 14767 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:38:37.639744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38592 (local address 127.11.131.253:34827)
0808 14:38:37.639946 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:37.639951 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:37.640117 (+ 166us) server_negotiation.cc:407] Connection header received
0808 14:38:37.640306 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:37.640310 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:37.640372 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:37.640471 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:37.640988 (+ 517us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38592: BlockingRecv error: recv got EOF from 127.0.0.1:38592 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
W20260808 14:38:37.708617 14767 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:38:37.707383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38594 (local address 127.11.131.253:34827)
0808 14:38:37.707542 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:37.707547 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:37.707720 (+ 173us) server_negotiation.cc:407] Connection header received
0808 14:38:37.707872 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:37.707875 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:37.707935 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:37.708013 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:37.708472 (+ 459us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38594: BlockingRecv error: recv got EOF from 127.0.0.1:38594 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260808 14:38:37.840072 14767 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:38:37.838823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38596 (local address 127.11.131.253:34827)
0808 14:38:37.838996 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:37.839002 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:37.839184 (+ 182us) server_negotiation.cc:407] Connection header received
0808 14:38:37.839313 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:37.839315 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:37.839370 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:37.839450 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:37.839938 (+ 488us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38596: BlockingRecv error: recv got EOF from 127.0.0.1:38596 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
W20260808 14:38:38.099742 14767 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 14:38:38.098441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38604 (local address 127.11.131.253:34827)
0808 14:38:38.098638 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:38.098662 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:38.098724 (+ 62us) server_negotiation.cc:407] Connection header received
0808 14:38:38.098865 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:38.098867 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:38.098965 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:38.099042 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 14:38:38.099608 (+ 566us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38604: BlockingRecv error: recv got EOF from 127.0.0.1:38604 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 14:38:38.392436 14950 catalog_manager.cc:1259] Loaded cluster ID: 958cb97e57194c65acf685f6b2c32c63
I20260808 14:38:38.392566 14950 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 10cdf6c8811a494ebe7ee2c0bcf87804: loading cluster ID for follower catalog manager: success
I20260808 14:38:38.394368 14950 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 10cdf6c8811a494ebe7ee2c0bcf87804: acquiring CA information for follower catalog manager: success
I20260808 14:38:38.395676 14950 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 10cdf6c8811a494ebe7ee2c0bcf87804: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 14:38:38.405540 14988 catalog_manager.cc:1259] Loaded cluster ID: 958cb97e57194c65acf685f6b2c32c63
I20260808 14:38:38.405629 14988 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e67a4b753a784a7ebb0ef34782e12d7a: loading cluster ID for follower catalog manager: success
I20260808 14:38:38.407434 14988 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e67a4b753a784a7ebb0ef34782e12d7a: acquiring CA information for follower catalog manager: success
I20260808 14:38:38.408588 14988 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e67a4b753a784a7ebb0ef34782e12d7a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 14:38:38.618211 15096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:38.614002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38610 (local address 127.11.131.253:34827)
0808 14:38:38.614264 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:38.614271 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:38.614405 (+ 134us) server_negotiation.cc:407] Connection header received
0808 14:38:38.614640 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:38.614643 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:38.614776 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:38.614930 (+ 154us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:38:38.615212 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:38.615741 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:38.616632 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:38.616871 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:38.616985 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:38.617324 (+ 339us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:38:38.617786 (+ 462us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:38:38.617946 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:38.617984 (+ 38us) server_negotiation.cc:299] Negotiation successful
0808 14:38:38.618042 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":73,"threads_started":1}
I20260808 14:38:38.625330 15104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:38.621525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46048 (local address 127.11.131.252:37429)
0808 14:38:38.621793 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:38.621797 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:38.621869 (+ 72us) server_negotiation.cc:407] Connection header received
0808 14:38:38.622024 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:38.622026 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:38.622162 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:38.622267 (+ 105us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:38:38.622493 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:38.623060 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:38.623879 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:38.624111 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:38.624197 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:38.624471 (+ 274us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:38:38.624918 (+ 447us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:38:38.625020 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:38.625073 (+ 53us) server_negotiation.cc:299] Negotiation successful
0808 14:38:38.625124 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":84,"threads_started":1}
I20260808 14:38:38.632625 15096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:38.628489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38622 (local address 127.11.131.253:34827)
0808 14:38:38.628643 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:38.628648 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:38.628917 (+ 269us) server_negotiation.cc:407] Connection header received
0808 14:38:38.629166 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:38.629174 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:38.629226 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:38.629323 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:38:38.629579 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:38.630402 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:38.631371 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:38.631635 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:38.631743 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:38.632089 (+ 346us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:38:38.632184 (+ 95us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:38:38.632253 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:38.632419 (+ 166us) server_negotiation.cc:299] Negotiation successful
0808 14:38:38.632477 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 14:38:38.633253 15104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:38.628900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46064 (local address 127.11.131.252:37429)
0808 14:38:38.629019 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:38.629025 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:38.629292 (+ 267us) server_negotiation.cc:407] Connection header received
0808 14:38:38.629440 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:38.629445 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:38.629499 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:38.629545 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:38:38.629894 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:38.630385 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:38.631652 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:38.631965 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:38.632064 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:38.632759 (+ 695us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:38:38.632836 (+ 77us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:38:38.632884 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:38.633076 (+ 192us) server_negotiation.cc:299] Negotiation successful
0808 14:38:38.633136 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 14:38:38.633579 15113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 14:38:38.628394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51132 (local address 127.11.131.254:38159)
0808 14:38:38.628649 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0808 14:38:38.628652 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 14:38:38.628898 (+ 246us) server_negotiation.cc:407] Connection header received
0808 14:38:38.629013 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 14:38:38.629017 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 14:38:38.629217 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 14:38:38.629338 (+ 121us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 14:38:38.629777 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:38.630557 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:38.631741 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 14:38:38.632080 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 14:38:38.632184 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 14:38:38.632744 (+ 560us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 14:38:38.633127 (+ 383us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 14:38:38.633217 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 14:38:38.633365 (+ 148us) server_negotiation.cc:299] Negotiation successful
0808 14:38:38.633426 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":72,"threads_started":1}
I20260808 14:38:38.640890 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 14533
I20260808 14:38:38.656047 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 14653
I20260808 14:38:38.668748 11791 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskR7JPPN/build/debug/bin/kudu with pid 14773
2026-08-08T14:38:38Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3459 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6923 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (303406 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST